Comment by verdverm

> not probabilities in the sense you are interpreting

I am not interpreting them that way, that's how they are being sold by the companies behind them. I do not think "confidence" is accurate either. As far as we can tell, and in the open source/model versions, it's derived logit values.

> You should never trust the machine

Rule #2 https://susam.net/inverse-laws-of-robotics.html

> coin flip...

LLM's get this one exactly right in my limited testing "50/50, 100% confident"