Comment by simonw
22 days ago
The team I saw doing this had a fake Slack channel full of fake users, each of which was constantly hammering away trying out different things against a staging environment version of the system.
That was just one of the tricks they were using, and this was a couple of months ago so they've no-doubt come up with a bunch more testing methods since then.
I dread to imagine tbe state lf the code, there are some antipatterns that LLMs come back to again and again.