Comment by llm_nerd

There is the needle in the haystack measure which is, as you probably guessed, hiding a small fact in a massive set of tokens and asking it to recall it.

Recent Gemini models actually do extraordinarily well.

https://cloud.google.com/blog/products/ai-machine-learning/t...