Comment by nullc

4 days ago

This is an extremely hard comparison to do well. I'll give a few examples as to why:

Small differences in gain are ABX able much more readily than differences in noise at the 16 vs 24 bit level. So if the signal chain gives even a small difference in gain between the samples that's what you'll track. A reasonable conversion path to 16 bits for mastering will also apply dithering and some kind of brickwall limiting (you have to limit after the dither or as part of the dither as dither can change levels!), and this can result in gain changes. The DAC may behave differently or have outright bugs for some configurations too.

This is particularly true wrt reconstruction filters for sample rate differences. And if you were comparing 44.1k and 192k then the physical DAC itself was likely running at a different rate and its _analog_ filters are probably better optimized for one vs the other (this is less true for 48k vs 192k, as the hardware likely runs at the same rate for both). So one answer to this comparison can be "on this particular hardware this rate is better than that rate"-- but that's a implementation property not a property of format choice.

You might think, "okay I'll use a mathematically perfect down and up conversion process and run the DAC in the exact same configuration for all cases". But even then you run into issues like after reconstruction the _inter sample_ peak levels will be higher than the levels of the samples, so you have to handle that and in a way that doesn't produce a gain difference between the two configurations. (probably by running your perfect process and finding the gain level that results in no limiting, then making the gain of the original match).

And then for the high rate vs non-high rate you have to deal with the fact that most amplifiers are not particularly linear (compared to well constructed software at least!) and that any real speaker is very far from linear. This means that the presence or absence of ultrasonics will change the audio in the 0-20khz band.. Before you think "well that could be a reason that high rate is better" observe that if there was some consistently good effect from the ultrasonics you could just bake it into the low rate sample.

> but in my 50s I know

Yeah if you're in your 50's you're absolutely not hearing differences way up above 20khz (especially if you're male), I bet you can't even hear CRT flybacks from 100 yards anymore. :P Most people have no idea how much their high frequency hearing degrades as they age because it plays approximately no role in your life, but it's real, dramatic, and as far as I know happens to everyone.

I don't mean to discount your experience: I don't really doubt that it was real. But answering the general question of the necessity of low vs high rate probably takes a team of experts, armed with test gear and the designs of the HW/SW in question, to vet the test configuration. Testing a _particular_ configuration without the ability to distinguish its implementation quirks from format-fundamentals is much easier and that's what most attempts to test this question are actually testing.

By testing in a recording studio you were doing far better than most such comparisons. Usually people try comparing different files and they're comparing entirely different mastering processes. Files made for the "high res" market will often have much less compression and limiting then files made for commercial radio play / casual listening... and truly do sound obviously much better. Some of my favorite recordings are rips from vinyl. Vinyl is an awful format from the perspective of audio fidelity, but it's also pretty intolerant of excessive compression and limiting because the record will skip if the needle is bouncing off the rails. And more recently I suppose they also avoid over compression there because of the difference in target listener/environment.

Yes, perhaps the amplitude was subtly different.

This was supposed to be running the DACs to match the source configuration, not resampling into some common format. I think that is an unavoidable part of the whole end-to-end ABX test concept.

Maybe it would be interesting to up-sample back into 24/192 and play both in that mode. But then people would argue about what type of up-sample to use.

I was in my mid 20s for this test. I understand my high-band hearing was better back then.

  • Speaking about up-sampling, Im curious to know your opinion on the benefits of it. Im sending CD resolution audio as well as web streams from soundcloud.com to cambridge audio azur 840C and its not clear if its the up-sampling that makes the difference or their per channel wolfson dac arch. The iPod Video with their dac sounded amazing with just normal AAC files compared to the iPods before or after it.

    • Any high end audio dac is internally running at a much higher sample rate-- that's what it takes to get their delivered performance with the silicon that's available. Its up-sampling process was designed by the designers of the DAC with intimate knoweldge of its analog properties.

      Second guessing it by upsampling in front of it seems dubious to me. It might help in some cases where the DAC designers were thinking of different objectives or just didn't do a great job. It might also help with some other issues, like if the dac is timed off the input clock and the input clock sucks and the upsampler retimes the signal.

      Of course the upsampler designers could also get it wrong, be aliasing the hell out of the results, and happen to like the sound of the corrupted audio. :P

      The effects are all objectively measurable however-- with expensive equipment at least. I think I'd want to set test results with a particular hardware combination before sticking an upsampler in it. OTOH, if there already was one there because it's just some built in feature of some kit I wanted to use otherwise, I wouldn't worry much about it. Particularly if that kit has been reviewed by people with proper test gear and they didn't decide that it was broken.

> Small differences in gain are ABX able much more readily than differences in noise at the 16 vs 24 bit level.

This was common knowledge at least as far back as the mid 80s, when every hifi shop and salesguy knew to ensure the bit of gear with the highest profit margin got played an almost imperceptible bit louder than the gear the customer came in to buy during back to back testing.

  • It's also a reason why double-blind testing is important. If someone doing the setup is expecting one piece of kit to sound better, if it doesn't they'll check the configuration more, and difference in gain can come from many sources. So errors that result in higher gain in favor of the "better" candidate go uncorrected, while ones that favor the worse tends to be fixed.

    Point being: it doesn't even require an unscrupulous sales person to get similar results to an unscrupulous sales person! :P

Ah, 20kHz and CRT flybacks.. when I was a child I could of course hear that (in Europe that would be 15625 Hz), when I studied electronics and TV repair we could all hear that, and because we had the equipment we "tested" what we could hear using a function generator. The limit for conscious hearing for me was somewhere around 17kHz. Or not 18kHz for sure.

But I think I lost the ability to hear the flyback not long after I passed twenty. The world turned silent as far as that's concerned (before, you could hear it anywhere and everywhere, in shops, homes, some workplaces..)

The "20kHz" thing is kind of a myth for most people, at least that's what it looked to me after all the testing we did at school. I think it can influence what you hear, somehow, but in any case it's for very young people.

> Most people have no idea how much their high frequency hearing degrades as they age because it plays approximately no role in your life, but it's real, dramatic, and as far as I know happens to everyone.

I agree completely. I recall some discussions a long time ago on RMMGA (Usenet: rec.music.makers.guitar.acoustic) where some distinguished and experienced, but middle-aged guitarists got practically angry when a young guy described the sound of a certain type of newly-introduced strings "harsh" and "like fingernails on a blackboard" when used on a particular guitar.

The difference was, of course, that what the young guy could hear is something which stopped existing at least when you had passed 30.. I was at an age where I too couldn't hear that kind of sound from strings, but it was still not that long ago and I remembered and had noticed the difference, i.e. that I could not hear what I could hear before. For example the huge difference between fresh strings and week-old strings (and that fact has, over the decades, saved me tons of money which I would otherwise have spent on replacing strings all the time..)