← Back to context

Comment by dingnuts

1 year ago

It's absolutely true. Humans misremember details but I'll ask an LLM what function I use to do something and it'll literally tell me a function exists named DoExactlyWhatIWant and humans never do that unless they're liars. And I don't go to liars for information -- same reason I don't trust LLMs.

Tell me, does an LLM know when it lies?

I don't see a functional difference between misremembering details and lying. Sure one is innocent and one malicious, but functionally a compiler doesn't care if the source of your error is evil or not.

An LLM doesn't know when it lies, but a human also doesn't know when they are (innocently) wrong.

  • The crucial difference is between misremembering occasionally VS consistently.

    You won't give any job to that kind of person.