Comment by ridgeguy

This is correct.

Any system that executes variation, selection, and inheritance will show evolution. We're seeing evolution, this time in agents, not biology.

Not saying the agents have their own consciousness, intent, or whatever anthropomorphic descriptor gets used for deflection. Just saying that people will (and no doubt are) crafting agents with defective instructions that will lead to regrettable unforeseen real world consequences. Also saying that other people will (and no doubt are) crafting malicious agents that will lead to predictable and unexpected real world catastrophic consequences.

To the extent we're dependent on reliable, aligned computation to maintain our civilization, to that extent we're in for real trouble.