Comment by lebovic
5 days ago
I assume they do hallucinate, just like with coding or finding vulnerabilities.
You can try to minimize it (e.g. with a reviewer agent, which Claude Science and Biomni have), but nothing is perfect, so I limit autonomous work to verifiable problems and review it.
Honestly, this is how all AI should be used, in most non-trivial scenearios