Comment by smokedetector1

Reasoning ability has to be independent of consciousness because there are different levels of intellectual ability among people but everyone is equally conscious.

Chiang is very right in saying that the lesson of LLMs isn't that LLMs are conscious, but that there are broad areas of reasoning that apparently don't require consciousness.