← Back to context

Comment by davebranton

14 hours ago

This phrase always fascinates me : "AI-generated content must not be treated as authoritative without independent verification appropriate to its context."

I've heard the same thing expressed somewhat more concisely as "Never ask AI a question to which you don't already know the answer".

Which raises the question, and I do think it's an important one. Given that this is true, what function does AI answering a question actually serve? You can't rely on its output, so you have to go and check anyway. You could achieve precisely the same outcome by using search engines and normal research.

This, and for many other reasons, is exactly why I never ask it anything.

>You could achieve precisely the same outcome by using search engines and normal research

When it comes to software engineering (as a software engineer myself), the AI is generally a lot quicker than me researching "the old fashion way"

I can fumble around and say "list free software that does X" without knowing I'm looking for, say, a CRM and then spend a couple minutes looking over the results when the "manual" method I would have spent 10-30 minutes just figuring out I was looking for "CRMs"

I like to think of these as sort of "psuedo NP hard" or questions that are slow to answer but quick to validate