Comment by majormajor

That's a recipe for regressions as the amount of surface you have to cover with "just...use the app" gets bigger and bigger.

You can write more automation to test it. But that's also how you end up with ever-growing test run times.

There are much better ways that aren't just "throw out the LLM" either. You just need to be more focused on throughput. Requiring manual validation can pretty rapidly require more hours than just sanity-checking code by hand, even (and I'm not advocating that for every use case, either.)

I can't afford manual QA passes if I'm gonna go as quickly as I want to.