Comment by xiphmont

It's not the timing differences, it's the phase differences. The ear is exceptionally sensitive to phase differences between the ears below 1kHz. This information is captured exactly (to well beyond the naive precision of the sampling clock) for any frequency below Nyquist.