Comment by vrighter

You're describing "temperature". That is usually done using the softmax function which cannot output zero for any element. In fact zero temperature is special cased, or they do exactly what you just said (add a teeny tiny epsilon to everything) in order to avoid having to treat zero temperature as a special case.