Comment by brookst

8 days ago

Every single time, if you ask it something it can't do.

How do you ask a calculator to do something it can't do? Dividing by zero gives you an error, which is completely different from an LLM giving you bs with no indication of an issue.

  • Oh, you’re saying the problem with LLMs is that they’re not input constrained enough?

    I thought you meant calculation and output, in which case “hey calculator, what’s the capital of North Dakota” demonstrates incorrect output.