Comment by grantbel
5 hours ago
The challenge with comparing AI to humans is that the bar keeps shifting up.
It’s pretty impressive that Kosmos can reproduce the conclusions that human scientists came to de novo. Especially when it does so much faster than a human.
If the goal is to accelerate scientific discovery, this is what success looks like.
> The challenge with comparing AI to humans is that the bar keeps shifting up.
Exactly. There is no standard, humans will adapt and find how to use AI as a tool, and the bar will never and should never be fixed.
The beauty of Turing's Test (which he strangely seemed to misunderstand) is that it is almost impossible to pass.
How did I say that? This is really cool and advancing but calling it "Autonomous Discovery" is very bold claim and needs strong evidence. I don't see it. They could have claimed it differently but they chose those words and that is what I am commenting on.
You are changing what they claim from "Autonomous Discovery" to "Accelerating Scientific Discovery". I agree with the latter.
The GP says this is helpful but not autonomous discovery, you then reply we're holding AI to increasing expectation (both highly debatable and the fault of AI hypers) and say this is success. They are not mutually exclusive, and actually converge on what many have promoted with little reception: this is a useful tool but no silver bullet.