Comment by red75prime
4 days ago
You'll get 50% prediction accuracy for a fair coin no matter what result a model gives. Try testing adversarial games. Mixed strategies make actual sense in them.
4 days ago
You'll get 50% prediction accuracy for a fair coin no matter what result a model gives. Try testing adversarial games. Mixed strategies make actual sense in them.
The model gives a probability distribution as an answer; you can check to see if two arbitrarily chosen probability distributions are similar or not.
I mean predicting the result of a fair coin toss is not a classification task those models are trained to do. It can be framed as a decision making task, but for a fair coin any probability distribution of heads/tails will do equally well.
BTW, for a task of predicting a 51/49 biased coin, the correct answer is 100/0.
Not if you use a proper scoring rule.
See: https://en.wikipedia.org/wiki/Scoring_rule
2 replies →