Comment by famouswaffles

1 year ago

Transformers can do weather prediction yes. https://arxiv.org/abs/2312.03876

This thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction.

Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.

  • A Large Language Model is just a text predicting Transformer (and sometimes image and/or audio predicting if they're multimodal). Transformers are general sequence to sequence predictors. The only difference between this and GPT is the data it's been trained on. They're the same kind of neural network.