Comment by pertymcpert
1 day ago
This isn’t talking about compaction. This refers to performance as the model is loaded with 500k to 1m tokens.
1 day ago
This isn’t talking about compaction. This refers to performance as the model is loaded with 500k to 1m tokens.
Ah, thanks, makes sense, I’ll read more about this