Comment by dapperdrake

I saw a presentation about this in 2022.

Someone found a way to get "something like" a tri-diagonal matrix that was equivalent to the LLM they were studying in 2022.

Apologies for being informal and hand-wavey. Been a long time and I probably forgot a few important points.