Comment by andai

5 days ago

Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?

0 comments