Comment by Alien1Being

3 days ago

Google has got the IBM disease.

Large lumbering enterprise with massive inertia. Where innovators leave as soon as they get a better offer.

None of the authors of the seminal "Attention Is All You Need" paper are still at Google.

Fast forward a decade and Google will be reduced to hiring the kind of mediocrities who deign to work at IBM and Accenture.

2 comments

Alien1Being

Reply
luckjack47  3 days ago

I don’t think the skill set required to write the Vaswani paper is the same as training and shipping frontier models like Gemini so I am not sure why people keep bringing this up.

  • Alien1Being  3 days ago

    Training, tweaking and shipping frontier models like Gemini is something that a team of mediocre engineers can do.

    Google continuing to ship generations of Gemini using its mediocre teams is an existence proof of that

    For genuine advances one needs the Hintons and Vasvanis, not yet another bunch of mediocre Kookaid drinking product managers at Apple and Google