Comment by spoaceman7777
1 year ago
I, for one, have it in my prompt that GPT should end every message with a message about how sure it is about the answer, and a rating of "Extremely sure", "moderately sure", etc.
It works surprisingly well. It also provides its reasoning about the quality of the sources, etc. (This is using GPT-4o of course, as it's the only mature GPT with web access)
I highly recommend adding this to your default prompt.
> It works surprisingly well
What do you mean by this exactly? That it makes you feel better about what its said, or that its assessment of its answer is actually accurate?
That's its assessment gives me a good picture of which ways to push with my next question, and which things to ask it to use its web search tool to find more information on.
It's a conversation with AI, it's good to know its thought process on how certain it is of its conclusions, as it isn't infallible not is any human.