Comment by th0ma5
4 days ago
There's simply no way to verify everything that comes out of these things. Otherwise why use it? You also can't possibly truly know if you know more about a topic since by definition the models know more than you. This is automation bias. Do you not know the problems with even verifying or watching machines? This is a core part of the discussion of self driving vehicles. I guess I assumed you knew stuff about the field of AI!
"You also can't possibly truly know if you know more about a topic since by definition the models know more than you"
Where does that idea that "by definition the models know more than you" come from?
It's a good question because I also hastily wrote that. You'll come to defer to the model on average when it comes to otherwise coin flip judgements you have make when you yourself are unsure. The model may not have any more information but you don't have any indication that it wouldn't and even suspect that it secretly does and this bias makes you trust the model and accept things that are ultimately bad in possibly ways that you'll not discover for a very long time because it is deep within a specific context.