Comment by williamdclt
2 days ago
Also uninformed but I can't see how that would be true, floating point rounding errors are entirely deterministic
2 days ago
Also uninformed but I can't see how that would be true, floating point rounding errors are entirely deterministic
Not if your scheduler causes accumulation in a different order.
Are you talking about a DAG of FP calculations, where parallel steps might finish in different order across different executions? That's getting out of my area of knowledge, but I'd believe it's possible
Well a very simple example would be if you run a parallel reduce using atomics the result will depend on which workers acquire the accumulator first.