← Back to context

Comment by helloplanets

6 days ago

Doesn't make sense to fixate on LLMs and not the actual Transformer/attention foundation. The Transformer/attention architecture is the breakthrough, not LLMs. Especially the RLHF chat paradigm is 100% a byproduct. Which is easy to see when you look at how ChatGPT originally came about.

DeepMind has already has had real impact on science with the same foundational architecture as LLMs, for protein folding. They won a Nobel prize for it.