Comment by semi-extrinsic
1 year ago
If I'm paying a human, even a student working part-time or something, I expect "concrete facts extracted from the literature" to be correct at least 99.99% of the time.
There is a huge gap from 85% to 99.99%.
1 year ago
If I'm paying a human, even a student working part-time or something, I expect "concrete facts extracted from the literature" to be correct at least 99.99% of the time.
There is a huge gap from 85% to 99.99%.
You can expect that from a human, but if you don't know their reputation, you'd be lucky with the 85 percent. How do you even know if they understood the question correctly, used trusted sources, correct statistical models etc?
This does not at all resonate with my experience with human researchers, even highly paid ones. You still have to do a lot of work to verify their claims.
Sure but there's no step change.