Comment by kmacdough

I'd like to see OpenAI and others get at the core of the issue: Goodhart's law.

"When a measure becomes a target, it ceases to be a good measure."

It's an incredible challenge in a normal company, but AI learns and iterates at unparalleled speed. It is more imperative than ever that feedback is highly curated. There are a thousand ways to increase engagement and "thumbs up". Only a few will actually benefit the users, who will notice sooner or later.