Comment by DrNosferatu

2 months ago

Well done!

Besides immediate speed gains, I guess this opens the door to ultra-long contexts. Larger than say, 16M tokens.