Comment by Sol-
2 months ago
The article doesn't reflect kindly on the visions articulated by the AI company, so why would they have an incentive to release it if they weren't serious about alignment research?
2 months ago
The article doesn't reflect kindly on the visions articulated by the AI company, so why would they have an incentive to release it if they weren't serious about alignment research?
Because publishing (potentially cherry picked - this is privately funded research after all) evidence their models might be dangerous conveniently implies they are very powerful, without actually having to prove the latter.
This isn’t dangerous in the sense that they’re smart or produce realistic art. It’s misaligned with the company’s and human values.
The model doesn’t have to be powerful to snitch you to the FBI or have a distorted sense of morality and life.