Comment by wolttam

Just my intuition about it but it does seem like a data issue.

V4 flash and V4 pro feel very similar, which would make sense if they were pre-trained on largely the same corpus.

All that would suggest to me is that V4 Flash is capable of absorbing the data they’re throwing at it, and we’re still nowhere near the data limits of their larger 1.6T model