Comment by VladVladikoff

6 months ago

>We're running LLMs in production for content generation, customer support, and code review assistance.

Sounds like a nightmare. How do you deal with the nondeterministic behaviour of the LLMs when trying to debug why they did something wrong?