Comment by _se

Not really. It's on the people asserting the positive (that LLMs do improve productivity for sufficiently experienced engineers) to prove it. In the absence of proof, the null hypothesis is the default.