Comment by orangecat
1 day ago
Yes. There are really three separate questions:
- Are current LLMs conscious?
- Is it possible that future versions of LLMs with similar architectures could be conscious?
- Can any AI be conscious?
I'd assign probabilities of around 0.1, 0.2, and 0.9. My completely ignorant take is that we probably need something more "dynamic" than a bunch of transformer layers in order to produce consciousness, but I wouldn't be shocked to be mistaken.
I assign probabilities of zero to all 3. Computer program being conscious leads to ridiculous and obviously false conclusions (think about a person running a program using pen and paper for memory).
why is that obviously false? To a functionalist, a pen and paper and a set of rules is sufficient for consciousness.
Gist of the argument:
If it was true, you can create extreme pain by running a program. You can run the program by simulating a CPU, using pen and paper for memory. So you're essentially claiming that some simulated being is in pain because there are some 1s and 0s on paper. In fact, you can decide to use an arbitrary encoding of the memory, so a sufficiently long sequence of 0s written on paper corresponds to a simulated being feeling pain in some encoding. That is clearly nonsense.
8 replies →
I think 10-20% chance is wildly generous. What specific mechanism makes you think there's a 10% chance that current LLMs are conscious?
Not GP but given we have no idea what conciousness is it seems foolhardy to go too low or too high for any of those numbers
I think the problem with this argument is that it's too inclusive. Is the bacteria that's adapted to an antibiotic conscious? It's showing intelligence right? I think if you're going to say something is potentially conscious, for me to take the argument seriously at least, there needs to be some plausible mechanism. I just don't see one for LLMs.
2 replies →