Comment by howlin

Kelly can work if you can properly model your uncertainty over the probability of outcomes and take this into account. You can either do some sort of Bayesian averaging over your posterior belief of the risk, or you can use the pessimistic side of the confidence interval of the actual risk probability.