Comment by zamadatix

I mean if you don't care it's utilized properly you can make a lot of local models have > 10 million context length. I don't know why you would, the quality is already crappy enough when models are built around using it well from the ground up, but go ahead.