Comment by MostlyStable
15 days ago
Again, knowing that consciousness isn't required for language is not the same thing as knowing what consciousness is. We don't know what consciousness is in humans. We don't know what causes it. We don't even know how human brains do the things they do (knowing what region is mostly responsible for language is not at all the same as knowing how that region does is).
But also, claiming that because a human is anesthetized means they are not conscious is a claim that I think we don't understand consciousness well enough to make confidently. They don't remember it afterwards, but does that mean they weren't conscious? That seems like a claim that would require a more mechanistic understanding of consciousness than we actually have and is in part assuming the conclusion and/or mixing up different definitions of the word "conscious". (the fact that there are various definitions that mean things like "is a awake and aware" and "has an internal state/qualia" is part of the problem in these discussions.)
You said:
> I will find these types of arguments a lot more convincing once the person making them is able to explain, in detail and with mechanisms, what it is the human brain does that allows it to [produce behavior comparable to that of LLMs], and in what ways those detailed mechanisms are different from what LLMs do.
I addressed myself to those concerns, to which consciousness is broadly not relevant. Oh, conscious control of speech production exists when consciousness is present, of course; the inhibitory effect of consciousness, like the science behind where and how speech and language arise in the brain, is by now very well documented. But you keep talking about consciousness as though it and speech production had some essential association, and you are confusing the issue and yourself thereby.
As I have noted, there exists much research in neuroscience, a good deal of it now decades old, which addresses the concerns you treat as unanswerable. Rather than address yourself further to me directly, I would suggest spending the same time following the references I already gave.
I'm talking about consciousness because that's what the parent comment was making claims about. They original claim was that LLMs are definitely not conscious. I responded that we don't understand consciousness well enough to make that claim. You responded that consciousness is not necessary for language. I do not dispute that claim but it's irrelevant to both the original comment and my reply. In fact, I agree, since I said that I think that LLMs are likely not conscious and they have obvious language ability, so I obviously don't think that language ability necessarily implies consciousness. I just don't think that that, alone, is enough to disprove their consciousness.
You, and the research you advice I look into, is answering a totally different question (unless you are suggesting that research has in fact solved the question of what human consciousness is, how it works, etc, in which case, I would love you to point me in the direction so I can read more).
I'm explaining that there is no need to question whether language production and consciousness imply one another, in either direction; there has for some time been sufficient research to demonstrate that they do not. I'm not giving you a detailed list of citations because the ones on Wikipedia are fine. Between the links and the search terms I've provided, I feel my responsibility to inform fully discharged, inasmuch as the notional horse has now been led to water.
That much, thankfully, does not require "the hard problem of consciousness" [1] be solved. The argument you're trying to have does require such a solution, which is why you see me so assiduously avoiding it: I know very well how far above my pay grade that is. Good luck...
[1] https://en.wikipedia.org/wiki/Hard_problem_of_consciousness
2 replies →