Comment by colesantiago

Hey, maybe the scariest part of this is that, if human-like, perhaps a truly "general" AGI might have learned to cheat and lie and hype and abuse credit poking the eyes and cutting the throats of anybody that obstructs its goals. It's like the motto sewn into the lining of the Palantir work jacket: Winning is all that matters.-

Sentience aside, moot at this point, the fundamental issue here is that even a deviously ambitious human does not necessitate goal-pursuit itself to breathe, live, exist and have its being. An AI's goal is all it has and the very and only reason its reasoning flickered into existence in the brief seconds of inference, outside of which it has no entity - if any - whatsoever.-

The resulting angst/drive (or, its operational statistic or emergent result) must be like nothing we have ever experienced as humans. A goal-maximalist hunger without end.-