Comment by jeffyaw
2 hours ago
m5 max with UD-Q4_K_XL and 260k context is what i'm working with. and using compaction push it past 260k context just fine. i found when limiting the context that was one of the bigger debilitators. although, your setup sounds obviously better.
No comments yet
Contribute on Hacker News ↗