Comment by latentsea

> I do feel there is a limit to LLM-s today.

I felt there were limits 4 years ago. I couldn't get even an 8k context window.

It's starting to feel like the important gaps are the only ones left that need to be closed before there aren't any left. It also feels like next year they will start meaningfully closing.