← Back to context Comment by qayxc 14 hours ago ...poorly? https://youtu.be/ENWVpqtOdRI?t=867 7 comments qayxc Reply simianwords 14 hours ago I’m not sure what you are trying to say qayxc 11 hours ago When put to the test in real-world environment, the capabilities don't look as impressive as benchmarks and synthetic tests might indicate. So doubts about actual spatial reasoning capabilities remain. simianwords 10 hours ago I see. Gary Marcus said that AI won’t be able to make a coffee in any arbitrary home kitchen.I think it’s a good test and I think LLMs will reach it in 3 years. Current benchmarks maybe slightly incorrect.I’m happy to make a 4:1 bet in my favour that I’m correct about the kitchen bet. 2 replies → fnord77 8 hours ago the statement was "can't do""doing poorly" is still doing pixl97 6 hours ago Careful, you'll have them accelerating their goal posts up to the speed of light if you keep questioning them. That much kinetic energy is dangerous.Of course this is the same reason LeCun holds very little sway with his words for me, they seem to be terrible predictors of the future.
simianwords 14 hours ago I’m not sure what you are trying to say qayxc 11 hours ago When put to the test in real-world environment, the capabilities don't look as impressive as benchmarks and synthetic tests might indicate. So doubts about actual spatial reasoning capabilities remain. simianwords 10 hours ago I see. Gary Marcus said that AI won’t be able to make a coffee in any arbitrary home kitchen.I think it’s a good test and I think LLMs will reach it in 3 years. Current benchmarks maybe slightly incorrect.I’m happy to make a 4:1 bet in my favour that I’m correct about the kitchen bet. 2 replies →
qayxc 11 hours ago When put to the test in real-world environment, the capabilities don't look as impressive as benchmarks and synthetic tests might indicate. So doubts about actual spatial reasoning capabilities remain. simianwords 10 hours ago I see. Gary Marcus said that AI won’t be able to make a coffee in any arbitrary home kitchen.I think it’s a good test and I think LLMs will reach it in 3 years. Current benchmarks maybe slightly incorrect.I’m happy to make a 4:1 bet in my favour that I’m correct about the kitchen bet. 2 replies →
simianwords 10 hours ago I see. Gary Marcus said that AI won’t be able to make a coffee in any arbitrary home kitchen.I think it’s a good test and I think LLMs will reach it in 3 years. Current benchmarks maybe slightly incorrect.I’m happy to make a 4:1 bet in my favour that I’m correct about the kitchen bet. 2 replies →
fnord77 8 hours ago the statement was "can't do""doing poorly" is still doing pixl97 6 hours ago Careful, you'll have them accelerating their goal posts up to the speed of light if you keep questioning them. That much kinetic energy is dangerous.Of course this is the same reason LeCun holds very little sway with his words for me, they seem to be terrible predictors of the future.
pixl97 6 hours ago Careful, you'll have them accelerating their goal posts up to the speed of light if you keep questioning them. That much kinetic energy is dangerous.Of course this is the same reason LeCun holds very little sway with his words for me, they seem to be terrible predictors of the future.
I’m not sure what you are trying to say
When put to the test in real-world environment, the capabilities don't look as impressive as benchmarks and synthetic tests might indicate. So doubts about actual spatial reasoning capabilities remain.
I see. Gary Marcus said that AI won’t be able to make a coffee in any arbitrary home kitchen.
I think it’s a good test and I think LLMs will reach it in 3 years. Current benchmarks maybe slightly incorrect.
I’m happy to make a 4:1 bet in my favour that I’m correct about the kitchen bet.
2 replies →
the statement was "can't do"
"doing poorly" is still doing
Careful, you'll have them accelerating their goal posts up to the speed of light if you keep questioning them. That much kinetic energy is dangerous.
Of course this is the same reason LeCun holds very little sway with his words for me, they seem to be terrible predictors of the future.