Comment by colingauvin

Pretty much just this, but tweaked to have I think 64 active conversations be cacheable, which drops the context pool to ~2M.

https://github.com/MiaAI-Lab/GLM-5.3-Flash-EXL3-2x-DGX-Spark...

I also had to downclock my Sparks (Asus) slightly, to 2000 Mhz. Otherwise they'd overheat and crash.