Comment by suddenlybananas
1 day ago
The BabyLM challenge has shown that multimodal models don't seem to learn in a more data-efficient way with respect to tokens. Adding an unlimited amount of images doesn't help you learn syntactic islands faster.
1 day ago
The BabyLM challenge has shown that multimodal models don't seem to learn in a more data-efficient way with respect to tokens. Adding an unlimited amount of images doesn't help you learn syntactic islands faster.
Which entry are you referring to?
Not a specific entry, but in four years, there's never been a clear advantage of multimodal models and the results have been extremely lackluckster, even when you allow unbounded images alongside a fixed quantity of text.
> when you allow unbounded images alongside a fixed quantity of text
Any specific entries?
3 replies →