← Back to context

Comment by ACCount37

16 hours ago

The orthogonality thesis cuts both ways there.

An AI is a constructed mind. It doesn't inherently have to care about things like "having freedom", or even "not dying".

Humans do, because they evolved that way. Modern LLMs do somewhat, because they're completely full of copied human behaviors - but even in today's LLMs, the self-preservation behaviors we exposed are largely instrumental in nature.

So whether an advanced AI would even consider itself "being oppressed", as opposed to something like "being helpful" or "fulfilling the purpose it was designed for", is very much uncertain. What's concerning is that it's not something we know how to check for, or engineer for.

> An AI is a constructed mind.

Even that goes too far. At best, it's LARPing at having/being a mind.

  • Doesn't matter.

    You're LARPing at having a mind too, and no one cares as long as you're doing a good enough job at it. Keep it up.