Comment by xnx
1 year ago
Plenty of AI companies that are cons or extremely overvalued, but the technology is the real deal and delivering huge improvements over previous techniques in all kinds of domains: language translation, weather prediction, code completion, self driving, etc.
I swear no matter how many times people say it people will still conflate all ML with LLMs. No, chatGPT is not driving advances in self-driving or weather prediction
For better or worse, "LLM" or "generative ai" has become roughly synonymous with the current wave of ML.
I know very little about ChatGPT, but Waymo is using an LLM: "Powered by Gemini, a multimodal large language model developed by Google, EMMA employs a unified, end-to-end trained model to generate future trajectories for autonomous vehicles directly from sensor data." (https://waymo.com/blog/2024/10/introducing-emma)
Waymo uses reinforcement learning (what it was before LLMs) (TD3+BC according to one of their blogs)
Emma is something they tried, but further down the article they explain why they don't use it as such yet.
1 reply →
Huh. I mean it makes sense to train end-to-end on all the interrelated tasks involved in driving but putting a whole-ass language model in the middle of that seems like a stunt. I wonder if it does better than like, any random transformer not trained on language first? Still, I hadn't heard that so I guess I was wrong about that one
1 reply →
Vision Language Models are absolutely being trialed for self-driving
https://wayve.ai/thinking/lingo-2-driving-with-language/
Okay so because of the ambiguity of the other reply I'm just gonna say, I don't think we should be surprised that someone is trying to use LLMs to do basically anything. That's basically what prints funding money right now, so long as you're the kind of company or guy the VCs or whoever will believe in. The signal here is "does it do something to appreciably advance the state of the art over previous methods"?
6 replies →
LLMs can do weather prediction? There is no way that is true. Considering ChatGPT sometimes insists 2+2=5, I sincerely doubt it is solving PDEs used to model weather systems.
Transformers can do weather prediction yes. https://arxiv.org/abs/2312.03876
This thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction.
Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.
1 reply →
Think base models. LLMs are extremely good at predicting the future when applied to human languages, as this is literally their only optimization goal. Why couldn't they also be good at predicting the future when applied to other complex forecasting tasks?
Of course what can be mathematically calculated without inference is going to be. LLMs may however be able to interpret the results of these calculations better than humans or current stochastical evaluations.
Sounds like airlines need to start using ChatGPT to autopilot their airplanes.