← Back to context

Comment by ethbr1

2 years ago

When I read the original announcement, I had hoped it was more about the transparency of testing.

E.g. "What tests did you run? What results did you get? Where did you publish those results so they can be referenced?"

Unfortunately, this seems to be more targeted at banned topics.

No "How I make nukulear weapon?" is less interesting than "Oh, our tests didn't check whether output rental prices were different between protected classes."

Mandating open and verified test results would be an interesting, automatable, and useful regulation around ML models.