Comment by CuriouslyC
12 hours ago
The problem with the stuff you cite is that it is coming from consciousness via an anthropomorphic perspective. The priors baked in are poisoning the logic.
The question we have to answer is "Why do we think we're magical matter uniquely blessed with consciousness?" If you go far enough down the rabbit hole on that question, the answer you will come to is either "we're not" or "because god" (with a lot of pseudo-scientific bullshit wrapped around the "because god" to make it palatable for the nonreligious).
Panpsychism (or a deeper form, such as idealism) is actually the solution favored strongly by Occam's Razor over the variants of "because god" (such as magical emergence).
Given panpsychism, AI is already conscious, like everything else, though no claims are made about the correlation between the internal experience of that consciousness and the tokens that are being printed on the screen.
There is no way of dealing with these topics via a non-anthropomorphic perspective. That has been already (in my view) proved by Heidegger and then Derrida.
Last time I read about panpsychism, it was deeply flawed. But I can't remember the sources (sorry).
If it's so deeply flawed, should be easy to state why in an ELI5 manner. For example: The emergence hypothesis requires physical processes to effectively create new dimensions of information (700nm light -> "red" qualia) which we're somehow incapable of directly measuring with all the tools of modern physics.