Comment by qeternity
5 years ago
Classic Goodhart’s law: “When a measure becomes a target, it ceases to be a good measure."
I don’t know the solution for this. But sheer number of PRs/commits is obviously meaningless. We just don’t have a better (cheaper) proxy to latch on to.
I think if people who get a `spam` or `invalid` tag to their PR should be instantly disqualified. That could work.
That is the case. The issue this year is the PRs have been essentially automated by some YouTuber telling people how to game the system