Comment by Applejinx

Subjective ethics ARE the de facto standard and you can make a case that subjective ethics are the de jure standard for AI.

How can you possibly run AI while at the same time thinking you can spell out its responses? If you could spell out the response in advance there's no point expensively having the AI at all. You're explicitly looking for the subjective answer that wasn't just looking up a rule in a table, and some AI makers are explicitly weighting for 'anti-woke' answering on ethics subjects.

Subjective ethics are either the de facto or the de jure standard for the ethics of a functioning AI… where people are not trying to remove the subjectivity to make the AI ethically worse (making it less subjective and more the opinionated AI they want it to be).

This could cut any sort of way, doesn't automatically make the subjectivity 'anti-woke' like that was inevitable. The subjective ethics might distress some of the AI makers. But that's probably not inevitable either…

I'm not sure I could guess to whom it would be incredibly dangerous, but I agree that it's incredibly dangerous. Such values can be guided and AI is just the tool to do it.