Comment by riskable
16 hours ago
> I'm pretty sure Western models have their own biases just in a different direction.
This statement warrants testing.
If we don't see an equivalent study out in a few days saying that this is true, it's clearly false. The methodology of the study was clear and easy to replicate (in short order, though you'll need the hardware/money for tokens). No reason why other groups shouldn't be performing the same exact tests with Western models (open weights or not).
Are you going to perform the work? If not, why do you expect someone else will?
Because these are ads. He may not have a company marketing products in this space, but others do.
Exactly. I don't have the power to replicate the testing but this is the type of thing that easily makes the news!
If you have the power to do so, why wouldn't you perform your own testing right now and release the results? It's a marketing/status gold mine.
If you find that western models don't have the described anti-china bias, then maybe you won't publish anything since it's not as interesting—that would be evidence there's no conspiracy.
Hence my conclusion that if we don't hear anything soon, the anti-china accusation is false.
If we don't see an equivalent study out in a few days saying that this is true, it's clearly false.
Yeah, that's not how evidence works, bud.