Comment by esafak
2 months ago
There's the nominal context length, and the effective one. You need a benchmark like the needle-in-a-haystack or RULER to determine the latter.
2 months ago
There's the nominal context length, and the effective one. You need a benchmark like the needle-in-a-haystack or RULER to determine the latter.
No comments yet
Contribute on Hacker News ↗