Comment by beering
7 months ago
It’s not hard to find applications where 90% success or even 50% success rate is incredibly useful. For example, hooking up ChatGPT Codex to your repo and asking it to find and fix a bug. If it succeeds in 50% of the attempts, you would hit that button over and over until its success rate drops to a much lower figure. Especially as costs trend towards zero.
I agree there are good examples of 90% being good enough but what you purposed doesn't sound like a good one.
This assumes that AI can't also introduce new bugs into the code causing a negative.
A case of 90% being good enough sound more like story boarding or giving note summaries.