Comment by cratermoon

18 hours ago

LLMs can't do math.

This. People need to manage their expectations.

  • Expectations can only be managed by someone who has sufficient understanding - in this case Google by not providing the result.

  • Why offer a solution then? Seems fairly easy for google to avoid giving the final number?

  • We're giving them calculators though, surely Google could provide a limited set of tools given Search already has a fairly sophisticated calculator.

    I've been having my AI stuff successfully do math since early gp3 days with this method— even before "tool calling."

LLMs can’t do math. But that’s a solved problem. ChatGPT has had a built in Python runtime that can do math for years - at least the paid version.