Comment by beckhamc 1 year ago Learnable parameters on activations do exist, look up parametric activation functions. 1 comment beckhamc Reply quantadev 1 year ago If course they do exist. A parameterized activation function is the most obvious thing to try in NN design, and has certainly been invented/studied by 1000s of researchers.
quantadev 1 year ago If course they do exist. A parameterized activation function is the most obvious thing to try in NN design, and has certainly been invented/studied by 1000s of researchers.
If course they do exist. A parameterized activation function is the most obvious thing to try in NN design, and has certainly been invented/studied by 1000s of researchers.