Comment by spwa4

Here's a great explanation why:

https://www.youtube.com/watch?v=_A367W_qvc8

Google's messing with the context. LOTS of speed for a little worse long-context performance.