Comment by pixl97

>It’s about asking it to do task A and doing task B with the hope of getting the result of task A as a byproduc

It seems like you have very little knowledge of how a general intelligence algorithms would work. This is a long discussed issue in both AI and human safety circles. In safety critical places like factory floors people constantly do B,C,D, and E because it seems more simple to them then doing A directly. For example taking off things like safety guards because it's easier to work without them until they get their hands chopped off.

Corporations unintentionally enable this behavior all the time. Take where Wells Fargo demanded unrealistic new service sign-ups from employees, so the employees just randomly picked customers and sign them up for services.

There are plenty of articles out there that show that AI will do the exact same kinds of behaviors in order to pass the 'winning' classifier.