Comment by intended

I think too many people call this intelligence, and it results in intuitions that are useless and waste time, pushing the day we understand this moment further into the future.

The best I’ve got is theres 2 frames of assessment people are using:

1) Output frame of reference: The output of an LLM is the same as what a human could make.

2) Process frame of reference: The process at play is not the same as human thinking

These 2 conversation streams end up with contradictions when they engage with each other. Yes, the tools are impressive. The tools aren’t thinking. etc.

A useful analogy is rote learning - many people have passed exams by memorizing textbooks. The output is indistinguishable from someone who manipulates a learned model of the subject to understand the question and provide the answer.