Comment by stingraycharles

3 hours ago

Yeah I personally don’t understand the point of AI code review tools all that much, as AI is already generating the code as well. All of these AI code review tools create so much noise, yet don’t catch the really important things.

What really important things are human reviews catching in your org?

I just feel more and more like the effort invested in manual reviews is not worth it

  • 1. Whether the thing should be done in the first place

    2. If it's the correct solution on a high level

    3. Whether it conflicts with or duplicates other parts of the system

    4. Whether the comments are actually useful or restating the LLM chat

    Also many others but these are the most common IME

    • All of these are angles an AI reviewer can test for as well, and will (IME) mostly catch mistakes correctly. I also still manually review code, and usually also catch issues, but the severity of what I find shrinks ever further as agents get better.

      The sprawling code comments are becoming the most draining part of code review though, that's really killing me from the inside.

      2 replies →

Code review tools are designed for less organised dev teams that don’t do PRs and mandatory human reviews already.

It is papering over a lower level of competency without having to invest in actual human oversight or real process improvement.

  • That's a thoroughly uncharitable view. Especially in smaller orgs with a minimum velocity dictated by the company's need to survive, the amount of code required to be written just to keep up with your competitors is massive. Trying to review that all by hand, thoroughly, is draining, thankless, and tedious. You end up with a few fast movers producing most of the code, and some slower movers forced into a reviewer role they never signed up for. It's an unhealthy dynamic.