Comment by djaouen

2 days ago

Programming used to prevent this by separating code from data. AI (currently) has no such safeguards.

Reality doesn't have a distinction between "code" and "data"; those are categories of convenience, and don't even have a proper definition (what is code and what is data depends on who's asking and why). Any such distinction requires mechanically enforcing it; AI won't have it, because it's not natural, and adding it destroys generality of the model.

  • OK, then sequence your DNA and send it to me. I will make sure to use it as code!

    • Haha. But DNA is a very good example of what I'm talking about. It's both "code" and "data" at the same time - or rather, a perfect demonstration that these concepts don't exist in nature.

      2 replies →