Comment by cowboy_henk
8 hours ago
A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomorrow's robots, but only time will tell.
8 hours ago
A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomorrow's robots, but only time will tell.
It's still very early days. There are many benchmarks that LLMs scored 36% on just 18 months ago that they're now at 100% on.
Where did you get this perf metric? I couldn't find it in the release
Second chart (it's to the right of the first chart and clicking it to scroll is easier than otherwise)
Wow screw lightbulb is lower than tie bag or close ziploc. Pretty surprising.