Comment by aaalll

If you had a superintelligence it could basically manipulate people so even if you don't connect it to the internet it could try to further its goal. There is also a chance that their goals are not the same as ours.

So we need a way to discern intent from AGI and higher and the ability to align the goals.

With that said I'm not sure if we ever get to them being self driven and having goals.