← Back to context

Comment by YmFzZTY0ZGFkZHk

2 days ago

And so the wildly unprofitable AI company explains how it token maxes it's code and review process.

Authors should really try and view this article from the perspective of someone who has to think about cost to use the models.

I look at it as a giant experiment. Any research tends to be very investment heavy, and people are given a lot more leeway to try things which are wildly unprofitable.

I'm glad they're doing this, because it lets me see an extreme of LLM development.

We spend a few thousand dollars a month in AI code review costs.

Compare that to the cost of human code review which can take up a third of an engineer’s time. You’re looking at $50-100K a year per engineer fully loaded in code review costs.

If AI assists in code review (not even replaces – we still do human review ourselves), you could spend thousands a month per engineer and still come out ahead.

Ironic that this comment talks about cost without weighing the numbers.

  • It’s gotten pretty good too. My employer has a team that wrote their own code review bot with the checks and values we care about and it has gotten quite good over the last six months.

[flagged]