Comment by qudat

Shrug. My intuition is LLMs predict the new word based on a tensor vector space of patterns using arithmetic and similarity scores.

What’s not intuitive to me is that through pattern matching it’s able to express logic and reasoning.