Comment by vjshah
6 months ago
> I’ve created 5-channel mixes of all the backing tracks so we can fade out specific instruments if somebody wants to play them live
How was this done? This seems like an even more difficult task to do well than what’s described in the article
Probably either creating stems from karaoke multitracks (e.g. [0]) or using Spleeter [1] 5-stem mode
[0] https://www.karaoke-version.com/
[1] https://github.com/deezer/spleeter
Also, if you have access to the audio tracks from Rock Band (for example you see plenty of examples of Beatles isolated this-and-that on YouTube thanks to Rock Band).
is there an ai model that can do this at the moment?
I've tried a few sites that show up in a search for ai stem separation. Some work pretty well for rock music.
If I recall correctly, https://vocalremover.org/ worked pretty well. Though, it's pretty limited in the free tier and only allows payment via patreon. I never tried the paid version because I don't have a patreon account and don't want one.
There's an openvino plugin for audacity that can do music separation but it only supports 4 tracks at the moment (drums, bass, vocals, other).
https://github.com/intel/openvino-plugins-ai-audacity/blob/m...
I'm using https://github.com/adefossez/demucs to split drums, bass, voice and "everything else".
Works pretty well for my personal/hobbyist use (quality also depends on genre and instruments used - synth stuff tends to bleed into voice a bit).
Steinberg spectral Layers is one of the commercial ones. It sounds really good.
Ultimate vocal remover is a common one
Try moises
Logic and Serato do 4 with a few clicks. The results in both are pretty good, definitely good enough for what this person is trying to do although with one less track I guess.
https://www.karaoke-version.co.uk will happily give you a song with any combination of instruments you like, as long as it's in their catalogue, and as long as you give them money