Comment by Aurornis
13 hours ago
> Yes, but how good will the recall performance be? Just because your prompt fits into context doesn't mean that the model won't be overwhelmed by it.
With current models it's very good.
Anthropic used a needle-in-haystack example with The Great Gatsby to demonstrate the performance of their large context windows all the way back in 2023: https://www.anthropic.com/news/100k-context-windows
Everything has become even better in the nearly 3 years since then.
> Sure, but then you're dependent on (you or the model) picking the right phrases to search for. With embeddings, you get much better search performance.
How do are those embeddings generated?
You're dependent on the embedding model to generate embeddings the way you expect.
That doesn’t match my experience, both in test and actual usage scenarios.
Gemini 3 Pro fails to satisfy pretty straightforward semantic content lookup requests for PDFs longer than a hundred pages for me, for example.
> for PDFs longer than a hundred pages for me
Your original comment that I responded to said a "few hundred lines of text", not hundred page PDFs.
It's you who misunderstood. They have one large word on each page.