Comment by jgord

It might be better to view the near-future AI as an emerging intelligent alien species.

Regardless of whether it is 'conscious' or not, Roman Yampolski makes the point that AI may or may not have human-kinds best interests at heart [ hell, even humans aren't aligned ]

Can we control or trust a counter-party that has intelligence at a level near or exceeding the smartest humans in all domains ?

I dont even think we can even have a safe sandbox in which to run an AI .. and frontier model training labs are certainly not air-gapped.