Comment by suddenlybananas
9 months ago
It's really not that implausible, they probably are adding stuff to the data-soup all the time and have a system in place for it.
9 months ago
It's really not that implausible, they probably are adding stuff to the data-soup all the time and have a system in place for it.
Yeah it is lol. You don't just train your model on whatever you like when you're expected to serve it. They're are a host of problems with doing that. The idea that they trained on this obscure benchmark released about the day of is actually very silly.