Comment by jabradoodle

What is your heuristic to determine what is likely?

The plateau of human intelligence isn't especially relevant given we are the product of evolution rather than engineering.

Personally,I think we stand a pretty decent chance of making a horrible mess of this all well before reaching AGI. However, a machine that could improve itself would not be limited in anyway that humans are; and I think we know little of how it would behave.

That is assuming it can't be controlled; otherwise it will behave as directed by whoever controls it.