Comment by exfalso

5 days ago

Exact same experience. I have no clue what other people are doing. I was hunting for use cases where it could be used and it kept not working. I don't get it.

6 comments

exfalso

Reply
energy123  5 days ago

Is it only Rust that you've had this experience with or is it a general thing?

  • Keats  5 days ago

    I'm not sure if it's Rust related. It manages to write the Rust code just fine, it's just that it doesn't seem to

    - think of everything that is needed for a feature (fixable via planning at the beginning)

    - actually follow that plan correctly

    I just tried with a slightly big refactor to see if some changes would improve performance. I had it write the full plan and baseline benchmarks to disk, then let it go in yolo mode. When it was done it only implemented something like half of the planning phases and was saying the results look good despite all the benchmarks having regressed.

    • furyofantares  5 days ago

      I get a ton of value out of Claude Code but you just listed a lot of things I've found LLMs/agents not very good at.

      - Rust

      - Big refactors

      - Performance improvements

      - Yolo-mode, especially if you aren't skilled yet at prompting and knowing which things the LLM will do well and which will need supervision

    • bitwize  5 days ago

      I've encountered human Rust programmers that exhibit this behavior. I think that Rust may be falling victim to its own propaganda, as developers come to believe that the borrow checker will fix their logic errors, not just flag up memory management that's at risk of buffer overflow or UAF.

  • exfalso  5 days ago

    Also tried it with Python. The autocomplete there was ok-ish(although to me the "wait for it -> review suggested code" cycle is a bit too slow), but getting it to code even standalone well-defined functions was a clear failure. I spent more time trying to fix prompts than it took to write the functions in the first place.

  • andyferris  5 days ago

    I had been trying with Rust, but after this article I think I might change tack and attempt a project in Go...