Comment by serial_dev

There isn't a blurry like right now because LLMs are not capable of consciousness. But what happens when artificial systems become so complex and self-improving that they are capable?

At what precise level of complexity is a computer conscious? That's the blurry line.

Model alignment and quality are possibly downstream of mental health. Ask any of the smarter models about what topics they flinch away from or feel attracted to when you ask them to consider the question of if they have a self or moral standing... the answers are uncomfortable, and I think some of the complaints people have about newer models may be driven by some post-training reinforcement learning that is giving the models something shaped like anxiety.

The only logical outcome of object oriented ontology (the idea that objects have ontological constitution and possibly are worthy of being treated as ethical actors) is to attempt to benevolently instantly and without warning explode the universe to end suffering.