Comment by makeitdouble

> I literally just ask a frontier model : "Pull the latest log and root cause the issue.".

While this can work, you also can't rely on it to work every single time, and still need to deal with the failures.

This is the part that gives me pause with all the discourse: you can't give up on the task you describe. You can't tell your team "something failed, but even after 20 prompts the model gives nothing good so let's forget the whole thing and go on with our lives"

So you still actually need the skills for when shit hits the fan. Perhaps it can be done in a more granular fashion with the model, and spending 30~60 min on it will do, but we're pretty far from "just utter 6 words"

If we could call someone else whenever it utterly fails it would also make it a different proposition. Same way people can try to fix their plumbing themselves, and call a pro when it's just too hard.

But who will you call to find the root cause of the issue in production ?