← Back to context

Comment by verdverm

4 days ago

Does SRBench still run deterministic algorithms 30 times? A more useful measure than wall clock time is the number of equation evaluations and iterations it takes to get there. One of the benefits to deterministic algos is they only need to be run once, whereas you have to run the rng based algos 30+ times for statistical significance.

My algorithm came from frustration at the lack of rigor in the field. There were no standard benchmarks, results were not reproducible, don't get me started on Korns lol