Comment by taberiand
3 hours ago
Getting the context full to the point of compaction probably means you're already dealing with a severely degraded model, the more effective approach is to work in chunks that don't come close to filling the context window
No comments yet
Contribute on Hacker News ↗