Comment by andai

1 year ago

Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?

0 comments