Comment by andai

3 months ago

Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?

0 comments