Comment by SyneRyder
1 day ago
I mostly agree. Though sometimes the models come up with useful concepts that I'm happy to be introduced to, like the "shape" of a problem (probably like intelligence being "spiky", and Kiki & Boba). I still don't quite 'grok' what the 'seams' concept is yet though.
But I have noticed that while "loosely held" is a convenient shorthand for uncertainty, I don't like that one slipping in to my daily language. Except maybe to communicate with models, but even then, it feels weird to be speaking in neuralese.
It's all starting to feel like the movie Arrival.
I suspect you're right that those concepts are now more widespread because of LLMs, but they didn't originate with LLMs. The word "Grok" came from Heinlein in the 60s and using it as "to understand" goes back to at least the 80s. Talking about the "shape of a problem" goes back decades. Ditto for "loosely held", though it's not about uncertainty; it's about being open to ideas and/or evidence that may conflict with your strongest opinions and beliefs.
Now, I'll grant that those concepts weren't common outside of techy circles. Just clarifying that the LLMs are amplifying them, not synthesizing.
https://en.wikipedia.org/wiki/Grok
https://wiki.c2.com/?ChadwickBoggs
Good point, and I probably shouldn't have put grok in quotes there, because I was using it in the Heinlein usage long before Musk hijacked it.
It's interesting then that LLMs are making these pre-existing ideas seem alien in the way they amplify them. I guess I must have known about "shape of a problem" and "loosely held" before Claude, but something about the way I'm using & absorbing those concepts from AI interaction feels weird & memetic. I'm saying that as someone who is pro-AI.
Definitely a good response. Thanks for replying!
For sure, I find many of the LLM-isms to be useful writing techniques and terms (although there's something uncanny-valley about the repetition and density of them).
But what I was more thinking about are truly unique jargon terms / phrases that get generated when deep in a problem. As an example of both of such a term and the phenomenon itself, Claude calls this "fluent compound coinage." They usually make sense in the original context, but get confusing when thrown around otherwise.
Allow me to offer a complementary point: I understand exactly what the poor "thing" means - and perhaps through some deformation or another I have done so since having had to read it - but something functional in the modus is still "off".-
... not to mention the fact that it stops making sense, beyond some point: If it takes us more cognitive load to understand the tools we use, meant to save us from intellectual work, what's the point?