← Back to context Comment by gregjw 15 hours ago Interesting he isn't just working with Feifei Li if he's really interested in 'world models'. 5 comments gregjw Reply dauertewigkeit 12 hours ago Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA. Legend2440 5 hours ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 hours ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting. muragekibicho 14 hours ago Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward. intalentive 3 hours ago LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.
dauertewigkeit 12 hours ago Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA. Legend2440 5 hours ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 hours ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
Legend2440 5 hours ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 hours ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
HarHarVeryFunny 3 hours ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
muragekibicho 14 hours ago Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.
intalentive 3 hours ago LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.
Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.
JEPA is not an alternative to transformers, it is built out of transformers.
JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).
It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.
LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.