← Back to context

Comment by bender250

15 days ago

Exactly my first test on all Gemini models. It cannot recollect any of the top events since Feb 2025. The worst about this is that since 3.6 Flash Google devs stated "knowledge cutoff March 2026" in the system prompt, so the model is wrongly confident that it knows about the year that it was not trained on. Which means that it searches less than it would.

And at least Flash 3.7/3.8 were both difficult to persuade that they have wrong knowledge cutoff.

I reported it as a bug to Google, but as all of my reporting to Google, no response ever. This is just stupid!

They know it and they try to cover it up with a fake reported cutoff date. Claude reports June '26 but it has only partial 2026 data (tested it against the API and it's 25 as well). GPT refuses to answer but it's old 25 data.