Fully Featured Audio DSP Firmware for the Raspberry Pi Pico

3 days ago (github.com)

Tangentially related, I recently had some hand-me-down high-end full tower speakers lose their integrated subwoofer amps. I bypassed them and wired in an external amp but people said the integrated DSP would be missing. That's when I learned about CamillaDSP [1] and CamillaFIR [2]. I got a calibrated UMIK-1 microphone and did a frequency sweep in the room. Then I applied the Camilla-computed FIR filter to my snapcast-sourced music stream on the Raspberry Pi 3 B I have networked into the living room. Now I have room-corrected and loudspeaker corrected fancy DSP and the speakers sound better than ever. Pretty fun, and very cheap. The Pi3 runs it using about 20% of its CPU. Not bad! I did the same process up in my office with some desk speakers and they sound great too (that time using EasyEffects to apply the filter in real-time rather than CamillaDSP).

[1] https://github.com/HEnquist/camilladsp

[2] https://github.com/VilhoValittu/CamillaFIR

  • Ah that’s super cool. Wish I knew about this a week earlier. Just last week I got the iLoud sub to correct speakers for my living room because I wanted a standalone piece of equipment that’s not my PC that can hold the corrected EQ/phase.

  • Why not use a crossover driver?

    The loudspeaker would have used one; a driver is both cheaper and of higher quality.

  • Did you ever use Dirac Live and can compare the results? Hardware that supports Dirac is unfortunately very expensive.

    • FWIW, I've tried Dirac Live and compared it to the correction suggested by REW [0]. In both cases, the measurements were taken with a UMIK-1, and the correction was done on a computer. Contrary to GP, I didn't have to fix borked components, just a random, untreated living room.

      Dirac seemed to have a fairly heavy-handed correction. In my case, I only had fairly narrow frequency ranges that needed correcting, but Dirac seemed to move much wider ranges at a time. It's also nearly impossible to tweak; you basically can only increase/decrease "the lows" or "the highs". But maybe I'm missing something.

      In contrast, the suggestions produced by REW were loaded in EasyEffects on Linux, and I could tweak everything to my heart's content. But I actually just left it alone, since it was good enough.

      ---

      [0] https://www.roomeqwizard.com/

      5 replies →

    • Ive done quite extensive testing with Dirac(with a MiniDSP Flex), rePhase, normal PEQs, BruteFIR, CamillaDSP etc. etc.

      Dirac is the most user friendly of the bunch, but honestly once you limit the correction to below Schroeder frequency I cannot tell them apart. So for my systems I just stick to a few PEQs targeting the main peaks under 300hz.

Looks like output only and only one stereo pair from USB is processed to outputs, but a really cool project.

Also, for those watching for it: https://www.audiosciencereview.com/forum/index.php?threads/i...

> I can't take all of the credit. My little robot intern (Opus 4.5) has been very helpful with the busy work, leaving me free to handle the trickier planning and implementation. ;)

This looks very cool.

Since a Raspberry Pi Pico doesn’t have built-in audio output ports, I think the main thing blocking ordinary people from using it is figuring out the hardware? A link to a tutorial for how to add audio output would be useful.

  • Thank you! I will soon be producing a comprehensive introductory video on YouTube, which should make things more accessible.

    There will also be an official plug-and-play custom board that includes all of the relevant IO, connectors and codecs.

    • In the meantime, what would you recommend (if there's anything off-the-shelf that would work in a plug-and-play manner?)

      I had a project in mind that was waiting for something like this! :)

      3 replies →

    • Uh, some people like videos but I'd really rather have a web page with all the steps laid out and still photos. (And maybe links to the video, too?)

      A custom board sounds great, too.

      2 replies →

Neat! I've been using a Teensy 4 for some of these things recently. The Teensy Audio Library is pretty good, but even though open source is pretty well tied to the Teensy hardware.

This is awesome.

What are the odds a Raspberry Pi could keep up with BTrack?

https://github.com/adamstark/BTrack

  • Pi or pi pico? At first glance it looks like that software is designed for double precision floats. That would certainly be some compute. The M0+ doesn't have hardware floating point let alone double precision. The M33 on the newer chip I think has hardware single precision float so a simple find-replace should let it go.

    If it's not doing anything else and the sample rates aren't outrageous it might be doable but I'd have to dig into the code more to see how much work they're doing per sample.

    • It's for the pico. RP2040 works fine, but RP2350 has a hardware FPU and much more processing capability, so supports more channels and filters

I wonder if you could do the same thing in reverse and have a cheap way to get multiple inputs. I would love a cheap way to add 8–16 inputs to my PC; all the audio interfaces I found cost quite a bit.

  • A Behringer UMC1820 does that combination of things (cheap, lots of analog IO, PC interface) very well. It provides 8 inputs OOTB.

    For more inputs, a Behringer ADA8200 can be connected with a garden-variety TOSLINK cable, bringing the total of 16.

    Or: Two UMC1820s, clocked together using that same TOSLINK cable. That provides 16 inputs that are all identical and also operating in lock-step.

    In terms of cost: A smart way to play with this stuff is to buy used gear, and treat eBay as a long-term rental program. Just buy it, use it, and when you want to try something different: Sell it. It works because the depreciation on stuff like this is basically a straight line once the initial hit of turning "new" into "used" gear is over with.

    The long-term rental cost then is mostly a combination of time, shipping expense, and seller fees. Keep it as long as you want. :)

    edit: alright. so the UMC1820 is apparently having production issues right now, which constrains supply, so prices are higher than normal. On a normal day, they sell for $229 new. I've bought them for ~$100 used. Things will go back to normal soon enough.

  • I2S input is on the roadmap, and hardware modules from AliExpress are being tested by Troy, so yes you will get plenty of analog inputs!

  • The Topping Pro audio interfaces have ludicrously good inputs. The E8x8 has eight analog ins and eight outs plus more connectivity for $450. It is very cheap for what you get. The inputs are crazy good. $450 is also a good chunk of cash, so…

    https://topping.pro/E8x8-Pre/

    For the $450 you get a lot of stuff. Preamps for mic and guitar pickups. Powerful headphone amp. It's clearly worth it if you make use of some of it, and potentially even just for the inputs alone. $450/8 = $56 per ludicrously clean input is good.

    I bought an E1x2 kind of as a joke. Just to see how bad it was. It's actually really, really good.

    And also:

    It's actually possible to gang together multiple disparate audio interfaces. Let the audio stack keep them in sync with ASRC. Aggregate Device on macOS can do this. People say you can't but you can. Linux is good for this too. If you find a cheaper per channel input, this can actually be done; Piecemeal it.

    • Thanks for the suggestion. I was hoping for something cheaper since I don't need really high quality. For now, I'm using a bunch of cheap USB soundcards that are good enough, but having multiple USB devices makes routing hell.

  • > a cheap way to add 8–16 inputs to my PC

    The cheapest option is probably some Behringer mixer with enough inputs and multitrack interface over USB, like XR18.

  • The ADCs on RP2040/2350 only have 12 bit resolution.

    • The analog input will use separate ADC modules, just as the analog output uses separate DACs. DSPi itself is purely digital (OK, excepting the PWM based sub out). These modules are just a few dollars on AliExpress for ~96dB SINAD

    • Yes, but this project doesn't do anything analog to begin with. It could just have several S/PDIF and I2S inputs, and convert that to USB. You probably don't want any processing then, and just pass the digital inputs straight to USB. The limit of how many channels you could simultaneously process would then be the USB bandwidth.

      1 reply →

    • Even worse, the ENOB is closer to 9 bits in testing. It’s got horrible DNL/INL. Totally worthless for any audio unless you’re trying to do chiptunes or something.

      1 reply →

Pretty cool, though the assembly could be tightened in a few hot loops, eg:

    mov r3, r10
    adds r5, r5, r3
    mov r9, r5

can be made into

    mov r9, r10
    add r9, r5

since r5 and r3 are both dead, and so are the flags

Any chance of supporting 192kHz?

  • Just wondering, why? This is for carrying 96kHz frequencies in the signal?

    • A sampling rate of 192kHz is overkill. And 192KHz exists as a sample rate in audio world because it is overkill.

      With a Nyquist frequency of ~96KHz, all of the arguments about whether a person can hear up to eg 22.05KHz, 24KHz, or if there's something meaningful all the way up at 48KHz, become completely and totally ameliorated.

      Those arguments were always such tiresome ordeals.

      The cost of dissolving those arguments is just some some bandwidth and CPU cycles -- which is to say, it costs approximately nothing.

      Please let the man cook. :)

      2 replies →

Can I use this to connect my electric guitar straight to my pc, or use this DSP for guitar effects?

  • No, like I commented earlier it's a (digital) audio output from USB only and the DSP part is mostly filters that wouldn't be musically very useful.

    But there seems to be new features being planned all the time, so who knows what it might do in the future.

  • Looking through the GitHub and the AudioScienceReview link - this appears to be specifically about firmware features. You'd need to ensure that hardware inputs on device have input impedance of at least 250Kohms, probably closer to 1Megohm to prevent loading and signal loss if plugging guitar right in. I'd also assume (didn't see confirmation) that I/O is at line level, which is significantly higher than instrument (passive guitar) level, but this device can clearly add/adjust gain along the way. If you use active pickups with a built-in preamp like EMGs, it would probably work just fine.

Is there a guaranteed latency?

Nice.

I wonder if 264/520 kB RAM is also enough for a high quality parametric stereo reverb/echo effect? Should fit about 3/6 seconds of uncompressed 16-bit 44.1/48 kHz audio.

Also: Raspberry Pi Ltd - please keep increasing the RAM size in future iterations to unlock even more use cases.

  • > high quality parametric stereo reverb/echo effect

    I’m sometimes annoyed that the home audio/audiophile world is so separate from the live/professional world.

    For playing recordings with fancy effects, you can throw massive overkill CPUs at it with small batches, brutefir style, or you can do high-latency FFT filters, and you can get essentially perfect FIR reverb effects with a latency vs complexity tradeoff.

    But the algorithm in the middle exists and is not that exotic. You divide your impulse response into a very short piece at the beginning, then a longer piece after that, then a longer piece after that, in exponentially increasing pieces. And then you add up the results, with straight addition and multiplication for the short one, and (carefully scheduled to avoid stalls) FFT convolution for the long ones, and you get basically arbitrary long FIR filters with logarithmic amortized complexity per sample and as low as zero sample latency if you are so inclined.

    I think this is called “non-uniform partitioning” or something to the effect. I’m not aware of any serious, public implementation for audio use.

  • The RP2350 (Pico 2) supports external PSRAM so you can add several MB more there if you need it.

    • I have always wondered kind of bandwidth you could make by multiple channels of PSRAM driven by PIO/DMA. Individually they're not so speedy(although the APS6408L-OCH-BA seems pretty crazy) , but how many can you run simultaneously. In terms of the RP2350 it would be fascinating to see how many times a second could you replace the entire contents of SRAM.

      5 replies →

    • Default specs matter a lot for worldwide availability and affordability, as well as for the willingness of people to spend a lot of time creating free software for it.

      3 replies →

I recently bought a Behringer U-phono UFO202 as a cheap DAC for my mini pc. Can this Pi thing replace it?

  • I use a UCA202 for the same purpose. Does yours output static sometimes when it sits for too long? Based on my testing this seems to be a Linux thing instead of a Behringer thing.