Comment by Wistar
11 hours ago
The Shazam app on my wife’s iPhone can identify TV shows and movies very quickly, sometimes nearly instantly. Not sure how it does that.
11 hours ago
The Shazam app on my wife’s iPhone can identify TV shows and movies very quickly, sometimes nearly instantly. Not sure how it does that.
It is pretty neat and several resources online explaining it but it chunks the recoding and does a hash of the fft of each frame i think which reduces the data a lot. The server has a pre hashed database https://hackernoon.com/how-shazam-works-in-a-nutshell
I forgot the part about finding the dominant frequency in each chunk
I know a guy who made a Shazam-like phone app that can listen to a few seconds of noisy audio and make a fingerprint that can be used to quickly ID those specific few seconds out of a pre-fingerprinted archive of an enormous amount of audio (zillions of hours of TV). Making the fingerprint requires a tiny amount of very smart code (in C with no dependencies). But, the fingerprint is not useful for understanding audio that's not in the archive.
TV shows are completed and in the can well before air date. It is entirely plausible that the interested party in having the content identifiable by Shazam like services submit whatever needs to be submitted for new content
I have also wondered about the possibility of media emitting some kind of hidden identifier. Can normal speakers emit noise outside of human hearing that could contain a unique id? Would not even need to be a lot of data that could be broadcast.
Yes, it's possible. Some sports broadcasts do this. The ones I'm familiar with use a high pitched tone on the edge of human hearing but still audible to most people.
Streaming services watermark the video as opposed to the audio as I understand it.
But that's for tracing pirated content back to the originating user account. It's not particularly useful (also entirely unnecessary and overly complicated) if your goal is to ID a piece of content as opposed to an account.
1 reply →
That's not necessary. If a service has access to the raw audio of a show, it can fingerprint each second of that audio in a way that can be matched in a tiny amount of computation even for a recording in a noisy environment.
That can't recognize what you say. But, it can ID where you are in a specific show out of zillions of hours of shows.
1 reply →
Honestly, it doesn’t even need to be outside the range of human hearing.
A quick search for “audio steganography” should answer your question (and be a fun rabbit hole if you find that sort of topic interesting)
Signals analysis is pretty refined and not THAT compute intense.