← Back to context

Comment by roncesvalles

2 hours ago

I take the complete opposite approach which is to have zero unit tests now, because LLMs are excellent at both reviewing code to understand what's going on, and also doing manual QA given environment instructions. Lots of unit tests will just bloat the context which ultimately dilutes the quality of the LLM's work and also creates additional work (it has to update the code and the tests each time).

Unit testing imo is pre-LLM. It was mostly to keep the human honest because the human can't possibly read all the code to make sure nothing broke.

> LLMs are excellent at both reviewing code to understand what's going on ...

Have you ever worked on existing code base that has components that makes no sense but must be there?

I'm flabbergasted at this comment.

Are you maintaining a list of all invariants you want QA'd by the LLM after each change? How many tokens does this process take?