Comment by bob1029

If you don't really care about knowing the specific probability (I think this is actually a huge info hazard), you can achieve this right now with a trivial tool calling arrangement. The benefit still stands. You are reducing the size of the action space from something that might be Turing complete (shell, code) into a multiple choice question.