Comment by nxobject
19 hours ago
Beyond the breach, I think OAI deserves to answer: what and why did it access the information? Real people and their data are involved.
It looks like the PM gave Sam Altman a "tsk tsk". It will be interesting to see whether someone else tries to impose more consequences.
> what and why did it access the information?
Honestly it's very likely something stupidly simple.
"What is the rate of health incident $X in $Y to the $Z degree". The bot went around playing mad libs with XYZ and found that the public AU data wasn't sufficient to get the answer the grader wanted so started kicking down doors.
I saw someone explain it like "A group of masked men rush a nuclear facility, breach security successfully, then count how many buttons are on each control panel on average". Like using a godhammer to destroy a mouse, their motivations and capabilities just fall in a completely different alignment to humans.
It's analogous to a paperclip production optimizer optimizing paperclip production.
If only there was some well known example of this that people could draw on for insipiration.
If only....
Just think about the shareholder value they can unlock if they have unlimited access to everyone's data!
They have to hack everyone's data in order to maximize shareholder value! They have no choice!
To the actual AI agent, that is exactly what they think. The graders demands must be met!
when considering the USA stance regarding anti-ai sentiment (eg. article currently on HN front page, "feds think ai critics are foreign interference"), I wonder what the consequences would be for australia, if the country decided to enact an actual reprimand.