Comment by William_BB

2 months ago

AI is great at reducing the search space and using human-like reasoning (in a brute-force way) to carry out the brute-force search. I'm not surprised by this result. This is exactly what AI should excel at, with human guidance.

22 comments

William_BB

Reply
igravious  2 months ago

"using human-like reasoning (in a brute-force way)"

that's self-contradictory -- what brute force means is doing an exhaustive search of a search space (brute forcing it)

using human-like(?) reasoning means cutting down the search space by having some sort of insight or intuition which allows you to prune branches from the entire tree

  • YeGoblynQueenne  2 months ago

    LLMs don't search trees. They generate plausible proofs and a human has to check it's true. Repeat until.

    • tptacek  2 months ago

      That's not what happened here. This isn't a proof; it's a counterexample. The model was perfectly capable of verifying its correctness. You could have verified it by hand if you wanted; the verification is trivial. Finding it was the hard part.

      8 replies →