Comment by bmacho

ai;dr: a bench result is not randomized, and it returns cached result somewhere.

My opinion: (some) bench results should run on randomized data.