Comment by gregjw 3 months ago Interesting he isn't just working with Feifei Li if he's really interested in 'world models'. 5 comments gregjw Reply muragekibicho 3 months ago Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward. dauertewigkeit 3 months ago Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA. Legend2440 3 months ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 months ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting. intalentive 3 months ago LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.
muragekibicho 3 months ago Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.
dauertewigkeit 3 months ago Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA. Legend2440 3 months ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 months ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
Legend2440 3 months ago JEPA is not an alternative to transformers, it is built out of transformers. HarHarVeryFunny 3 months ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
HarHarVeryFunny 3 months ago JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
intalentive 3 months ago LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.
Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.
Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.
JEPA is not an alternative to transformers, it is built out of transformers.
JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).
It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.