Comment by mahieddine
8 hours ago
If you read all the questions asked by Terrance you would have understood what he is thought behind that question "Could the AI solution to the prompt be somehow misaligned by exploiting a weakness in the trial process?"
He is not talking about a cure that works and that no one understands, he is talking about an AI making its way out of the trial just to get to phase 3...
He didn't do us any favors by writing that slide in a convoluted and inaccurate way.
If AI found a way to exploit clinical trial design, it would be noticed and the errors corrected. In fact, that would be a major win because it would probably lead to improved clinical trial designs.
> If AI found a way to exploit clinical trial design, it would be noticed and the errors corrected.
Do you think so? So far, AI is gaming lots of things, and I don't see much fixing in the processes.
Medicine is highly regulated and validated, there are multiple levels of checks, with the final one being doctors seeing patients.
I suppose if we closed all the loops and the entire end-to-end process was completely automated, it wouldn't be surprising if we failed to notice.
[dead]
It's an ignorant way to make a point that might or might not be valid. Tao evidently isn't aware that many medications we've relied on for decades still have a poorly-understood mechanism of action.
If we followed the precautionary principle and waited until we understood everything there is to know about every drug on the shelf, a lot of people now living would be dead.