← Back to context

Comment by brundolf

1 year ago

The built-in microphone is actually excellent, I often use it even when I have my AirPods Pro in because the sound quality is so much better

If you've got headphones with a wraparound microphone on its own arm then it could be better, but everyday headphones are limited by the position of the microphone

Yeah, no matter how good the microphone actually is on a headset, it uses an ancient codec so until we get Bluetooth 5.3 everywhere with lc3 codex then we won't actually have good mic input from headphones and headsets. I predict that this is all going to change this year and next year. But the full stack has to support it from headphones to Bluetooth chips to OS.

  • Headsets can and do use other codecs already. This is especially true for Enterprise headsets with dongles - these still use Bluetooth but by controlling both sides they can pick codecs.

    LE Audio is great though - and is already, as "the full stack" has had support for quite a while... Assuming you don't happen to get your equipment from a certain fruit supplier that is notoriously slow at implementing open standards, almost as if they want to not give you a choice outside buying their own proprietary solutions...

  • It's so strange (and frustrating) to me that "Bluetooth audio" means "you pass the Bluetooth hardware PCM samples, and it encodes them itself in hardware; or the Bluetooth driver decodes packets in hardware to PCM samples, and then passes them to userspace."

    It reminds me of the telephone network, where even though the whole thing is just another packet-switched network these days, the abstraction exposed to the handset is an analogue baseband audio signal.

    ---

    Why can't we get another type of "Bluetooth audio", that works like VoIP does between handsets and their PBXes — where the two devices will:

    1. do a little handshake to negotiate a set of hardware-accelerated audio codecs the devices (not the Bluetooth transceivers!) both support, in descending order of quality, constrained by link throughput + noise; and then

    2. open a (lossy, in-order) realtime "dumb pipe" data carrier channel, into which both sides shove frames pre-encoded by their separate audio codec chip?

    Is this just AVDTP? No — AVDTP does do a capabilities negotiation, sure, but it's a capabilities negotiation about the audio codecs the Bluetooth transceiver chip itself has been extended with support for — support where, as above, userland and even the OS kernel both just see a dumb PCM-sample pipe.

    What I'm talking about here is taking audio-codec handling out of the Bluetooth transceiver's hands — instead just telling the transceiver "we're doing lossy realtime data signalling now" and then spraying whatever packets you the device want to spray, encoded through whatever audio-codec DSP you want to use. No need to run through a Bluetooth SIG standardization process for each new codec.

    (Heck, presuming a PC/smartphone on the send side, and a sufficiently-powerful smart speaker/TV/sound bar on the receive side, both sides could actually support new codecs the moment they're released, via software updates, with no hardware-acceleration required, doing the codec part entirely on CPU.)

    ---

    Or, if we're talking pie-in-the-sky ideas, how about a completely different type of "Bluetooth audio", not for bidirectional audio streaming at all? One that works less like VoIP, and more like streaming VOD video (e.g. YouTube) does?

    Imagine a protocol where the audio source says "hey, I have this 40MB audio file, it's natively in container format X and encoding Y, can you buffer and decode that yourself?" — and then, if the receiver says "yeah, sure", the source just blasts that audio file out over a reliable stream data carrier channel; the receiver buffers it; and then the receiver does an internal streaming decode from its own local buffer from that point forward — with no audio channel open, only a control channel.

    Given the "race to sleep" argument, I presume that for the average use-case of "headphones streaming pre-buffered M4As from your phone", this third approach would actually be a lot less battery-draining than pinging the receiver with new frames of audio every few-hundred milliseconds. You'd get a few seconds of intensive streaming, but then the transcievers on both ends could both just go to sleep until the next song is about to play.

    Of course, back when the Bluetooth Audio spec was written, something the size of AirPods couldn't have had room to support a 40MB DRAM buffer + external hardware parse-and-decode of M4A/ALAC/etc. But they certainly could today!

    • While we're at it, it'd be great if we could avoid remuxing e.g. facetime audio, which is AAC, and notification sounds, into a single stream before sending it to bluetooth. Would be nice to avoid the latency and just shove the raw AAC from facetime into the headset, and when a notification ping arrives, send that as a separate audio stream with maybe a different codec

      1 reply →

    • We basically did that in old project. We need to transfer audio from our device to phone, but our device is BLE only, and LE audio was not mature enough.

      So we define a custom BLE service and blast audio file through it

  • I think the bigger issue might be the microphone placement. Humans tend to prefer microphones that are closer to microphones which are further away (this is one reason headsets w/ a boom arm usually sound better than a built-in microphone.) Having the microphone behind you / to the side (as in the case of an AirPod) is not great either. Of course, audio processing can fix a lot of this.

  • Are AirPods limited to the Bluetooth spec though? I think they extend it.

    • i don't know the details but airpods pro sound noticeably terrible and bluetooth-y. It's almost shocking.

    • They extend it in some ways, but I'm not sure if they do in this way. They do sound kind of terrible, but I always assumed it was due to the microphones being way back by your ears. I'm not sure though

Everyday headphones are limited by the fact that people often use Bluetooth, and Bluetooth audio is just terrible tech that hasn't improved by much in the last 10 years, and still can't do more than 16kHZ when doing both input and output at the same time.

I think this isn't a problem if you're using Apple headphones with Apple devices, but anything else falls back to crappy BT quality, usually with some kind of terrible ANC to boot.

FOr me, crappy audio setups and apps trying to do too much audio processing are the primary reason of "Zoom fatigue". I've done a lot of calls over apps that transmit raw, high-quality audio with no processing whatsoever, and the experience is just so much better.

  • Apple-Apple Bluetooth speech codec is a variation of AAC, I believe. AAC-LD if I remember correctly. But still, having microphones in one's ears is suboptimal. There's a lot of processing required even though the codec is no longer completely awful.

    On an unrelated note, I tried doing calls with a stereo mic setup but participants were actually uncomfortable with the ASMR-like effect of the audio.

Plenty of good headsets do beamforming with their microphones as well, just depends on what you're running. Macbook mics are well above average, though, so I agree in most cases they'll be better unless you're picky about your headset mic quality.

  • This is also a great example counterpoint for the folks who constantly complain about Apple hardware being "overpriced". Most laptop mfgs are happy to just solder on whatever tiny $0.50 compatible MEMS mic and put a little toothpick-sized hole in the case and call it good enough, or add two and rely on whatever generic beam forming that isn't adapted to their specific mic choice, placement, case acoustics, etc the Realtek ALC262 or whatever gives them, and call it a day.

    Apple puts a ton of R&D into making things work well. As another example: Macbooks have been, for 15+ years now, the only laptops that I can trust to actually sleep and conserve battery when I close the lid and slip into a backpack for a few-hr flight. Windows and Linux on laptops seem to have about a 70% chance of either not sleeping, not waking up right (esp with hybrid graphics), or trying to do forced Windows updates and killing the battery, then waking back up to 20+ minutes of waiting for updates to resume / finish with no meaningful progress indicator or way to cancel / delay.

    Not everything they do is perfect, and I'm not some huge Apple fanboy, but they do offer a significantly better experience IMO and feel "worth" the premium. It's not as if modern gaming laptops are any cheaper than MBPs, but they certainly feel much jankier, with software and UX to match. As an example, the IEC plug on the power supply of my Asus Zephyrus Duo wiggles enough that it disconnects even with different IEC cables. I've had to wrap some electrical tape around the plug body to get it to be less flaky. Asus Armoury Crate is a terrible buggy and bloated piece of software that runs about a dozen background processes to deliver a "gamer" UI to...control fans, RGB lights, and usually fail to provide updates. They also have utilities like https://www.asus.com/us/content/screenxpert3/ and "ROG ScreenPad Optimizer" that are largely buggy garbage, but sometimes required to get their proprietary hardware to work properly.

    Does Apple gouge users for extra RAM and SSD space? Absolutely, but you're paying for the R&D as much as the actual hardware. I wish they'd just price that into the base models and make upgrades cheaper, but their pricing strategy seems to be lowering the base entry point to something more appealing with "it barely works" levels of spec, while making increasingly ridiculous margins on higher specs -- an additional $4,600 to go from 1TB -> 16TB on the Mac Studio is pretty bold considering consumer QTY=1 pricing on a fast M.2 SSD is around $600 for 8TB, and I'm sure their BOM costs are around the same for 16TB worth of silicon in huge quantities.

    • > Macbooks have been, for 15+ years now, the only laptops that I can trust to actually sleep and conserve battery when I close the lid and slip into a backpack for a few-hr flight.

      Even the cheapest of Chromebooks sleep and resume reliably. I suspect the reason is not purely R&D, but limiting the number of supported devices/chipsets and testing the supported configuration thoroughly. Chromebook OEMs can only manufacturer specific hardware combinations blessed by Google, and in exchange Google updates the drivers during the support period.

    • > the only laptops that I can trust to actually sleep and conserve battery when I close the lid

      +1 on this one... I can close my lid (from on) and set my M1 air aside for a few weeks and still have plenty of battery left. I don't use it much when not traveling, it's mostly my desktop, work laptop or phone.

      Also +1 on the hardware feel... it's got an above average stiffness, keyboard feel (for what little that's worth) and the best touchpad experience hands down. The screen is also on the higher end (I've seen slightly better in some really expensive laptops). All around, it's a pretty great value on the mid-high range. What I don't like is the aging UI/UX, the variance from other platforms (I use Linux and Windows pretty regularly) and some things that I just find harder on the platform in general.

      I don't think I'd every buy a maxed out Apple product all the same, I don't use an iPhone or anything else but my laptop. That sometimes makes the ecosystem integrations slightly annoying. That said, my current laptop is still running well, and my prior laptop from over a decade ago is still running fine for my Daughter's needs... though she may get my m1 if/when I move to a Framework 13 (strix halo).

    • Keep in mind you can't just upgrade a Mac Studio to 16 TB for $4,800. You can go to 8 TB for $2,400, but to move up to 16 TB you also need to upgrade to the Ultra chip for an additional $1,000, which also necessitates moving up to 96 TB RAM. So when all is said and done, you're looking at an additional cost of $6,599.

      As a photographer, this is a bit maddening.

      2 replies →

    • > the only laptops that I can trust to actually sleep

      They don't actually sleep. Apple remarketed the concept of never sleeping as "Power Nap".

      You can choose to have it actively updating the system or not, but it never actually sleep, just go into a ridiculously low power mode. You'll get the same on Surface Pro laptops or Chromeboks for instance.

      Actual sleep only happens when the battery is about to die.

      https://support.apple.com/guide/mac-help/turn-power-nap-on-o...

      4 replies →

    • counter point; as a gamer I don't want to waste even a penny on a built in microphone on my laptop -> maybe nice to have as a last resort; but even then I could just discord on my phone.

      I just want a heatset aux port and I'm GTG. I want my money put into the GPU/CPU/Display/Keyboard.

      Now my macbook pro for work? Yeah; high expectations there for AV quality in terms of joining meetings etc.

I hope you do not take notes or brush dust off the macbook whilst in a video call.

  • Why, are they not able to reject these types of noise? My X1 doesn't even register typing in a video call

    • Software noise cancellation is actually kind of amazing. During the pandemic when I was doing 8 hours of video calls a day, I paid for Krisp and it eliminated any background noise pretty much perfectly. One time a very loud fire truck was slowly driving by. It was so loud I couldn't even hear myself think and just stopped talking. People were confused because that noise was eliminated but I was just talking very weirdly ;)

      In the interim, they raised the price and added a ton of bloat so I don't use it anymore. (The bloat killed it, not the price. And the popup that's like "you're so stupid that you can't even figure out how to enable Krisp Speaker, you idiot". I'm well aware of how to enable it, but I have chosen not to, as I do not want to heavily process the audio that I'm listening to. Only emitting. "Don't ask again" would have probably made them an extra $110 at least.)

      1 reply →

    • I constantly hear a harsh swoosh when people wipe stuff or drag their palms across their macbooks.