Comment by throwawayffffas

He is surprised because he has misunderstood the bitter lesson.

The bitter lesson tells us that general _approaches_ outperform domain-specific understanding.

That doesn't mean a general model will outperform a domain specific one.

https://en.wikipedia.org/wiki/Bitter_lesson