Comment by chamomeal

Yeah I’ve been thinking that LLM unit tests are basically snapshot tests. Just sorta ossify things in place. If they break, you just ¯\_(ツ)_/¯ and have the LLM fix them. It’s like they were never there!

So it’s just like the olden days of everybody ignoring tests, but we give anthropic a ton of cash