Comment by xnx
8 days ago
Google has come pretty close. Who knows how long it would've been before someone else came up with Attention is all you need.
8 days ago
Google has come pretty close. Who knows how long it would've been before someone else came up with Attention is all you need.
And yet they sat on transformers until OpenAI kicked off the AI boom by actually productizing that research in ChatGPT. Though it's possible they were just being cautious, my uncharitable view is that they knew this would disrupt their highly lucrative ads business, which is always the problem with monopolies.
Also you're overlooking other top-notch corporate research institutions like Microsoft Research, which arguably are more "Blue Sky" in the sense they are not constrained to any current product lines.