Alexa Scientists Claim Audio Watermarking Technique Nearing 100% Accuracy (venturebeat.com)
georgecarlyle76 brought our attention to Amazon's claim of an algorithm that "solves the 'second-screen problem' in real-time."
"Ever hear (no pun intended) of audio watermarking?" asks VentureBeat. It's the process of adding distinctive sound patterns identifiable to PCs, and it's a major way web video hosts, set-top boxes, and media players spot copyrighted tracks. But watermarking schemes aren't particularly reliable in noisy environments, like when the audio in question is broadcasted over a loudspeaker. The resulting noise and interference -- referred to in academic literature as the "second-screen" problem -- severely distorts watermarks, and introduces delays that detectors often struggle to reconcile. Researchers at Amazon, though, believe they've pioneered a novel workaround, which they describe in a paper newly published on the preprint server Arxiv ("Audio Watermarking over the Air with Modulated Self-Correlation") and an accompanying blog post. The team claims their method -- which they'll detail at the International Conference on Acoustics, Speech, and Signal Processing in May -- can detect watermarks added to about two seconds of audio with "almost perfect accuracy," even when the distance between the speaker and detector is greater than 20 feet...
So how's it work? As Tai explains, the model employs a "spread-spectrum" technique in which watermark energy is spread across time and frequency, rendering it inaudible to human ears while robustifying it against postprocessing (like compression). And it generates watermarks from noise blocks of a fixed duration, each of which introduces its own distinct pattern to selected frequency components in the host audio signal. Conventional detectors would compare the resulting sequence of noise blocks -- the decoding key -- with a reference copy. But Tai and colleagues take a different approach: Their algorithm embeds the noise pattern in the audio signal multiple times and compares it to itself. Because said signal passes through the same acoustic environment, Tai explains, instances of the pattern are distorted in similar ways, enabling them to be compared directly. "The detector takes advantage of the distortion due to the acoustic channel, rather than combatting it," he added.
"Audio content that Alexa plays -- music, audiobooks, podcasts, radio broadcasts, movies -- could be watermarked on the fly," explains Amazon's blog post. It argues that this could be useful "so that Alexa-enabled devices can better gauge room reverberation and filter out echoes."
"Ever hear (no pun intended) of audio watermarking?" asks VentureBeat. It's the process of adding distinctive sound patterns identifiable to PCs, and it's a major way web video hosts, set-top boxes, and media players spot copyrighted tracks. But watermarking schemes aren't particularly reliable in noisy environments, like when the audio in question is broadcasted over a loudspeaker. The resulting noise and interference -- referred to in academic literature as the "second-screen" problem -- severely distorts watermarks, and introduces delays that detectors often struggle to reconcile. Researchers at Amazon, though, believe they've pioneered a novel workaround, which they describe in a paper newly published on the preprint server Arxiv ("Audio Watermarking over the Air with Modulated Self-Correlation") and an accompanying blog post. The team claims their method -- which they'll detail at the International Conference on Acoustics, Speech, and Signal Processing in May -- can detect watermarks added to about two seconds of audio with "almost perfect accuracy," even when the distance between the speaker and detector is greater than 20 feet...
So how's it work? As Tai explains, the model employs a "spread-spectrum" technique in which watermark energy is spread across time and frequency, rendering it inaudible to human ears while robustifying it against postprocessing (like compression). And it generates watermarks from noise blocks of a fixed duration, each of which introduces its own distinct pattern to selected frequency components in the host audio signal. Conventional detectors would compare the resulting sequence of noise blocks -- the decoding key -- with a reference copy. But Tai and colleagues take a different approach: Their algorithm embeds the noise pattern in the audio signal multiple times and compares it to itself. Because said signal passes through the same acoustic environment, Tai explains, instances of the pattern are distorted in similar ways, enabling them to be compared directly. "The detector takes advantage of the distortion due to the acoustic channel, rather than combatting it," he added.
"Audio content that Alexa plays -- music, audiobooks, podcasts, radio broadcasts, movies -- could be watermarked on the fly," explains Amazon's blog post. It argues that this could be useful "so that Alexa-enabled devices can better gauge room reverberation and filter out echoes."
Their algorithm embeds the noise pattern in the audio signal multiple times and compares it to itself.
they are going to make the watermark "more detectable in noisy environments" without making it more detectable to the listener. There is already much discussion of how current watermarks are commonly audible in otherwise high fidelity music files.
https://www.mattmontag.com/mus...
Of course, nobody is ever going to use Alexa for anything remotely related to hifi, but this is certainly not something we would want to see spread anywhere else.
It is a perfectly cromulent word.
Does it embiggen even the smallest man?
audio watermarking in the video industry (cinavia) is still not cracked. It can be slightly defeated by smearing the audio by pitch shifting. But you loose quite a large amount of signal doing so. Now with audio this can be semi acceptable.
It has yet to be properly defeated by finding the signal and correcting just that signal.
https://en.wikipedia.org/wiki/...
Why would anyone buy a device that might refuse to play any damn sound file you point it at? As if I needed another reason not to buy one of these things.
Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
You misgendered her. Misgendering a normal person isn't a crime, but because she is a trannie, you have committed high treason against the internet. I hereby sentence you to Barbara Hudson for life, without the possibility of escape.
Reading the article title ... Audio Watermarking Algorithm Is First to Solve "Second-Screen Problem" in Real Time
Here's a clue stick. Instead of treating symptoms how about addressing the cause, namely:
a) availability (lack of legal availability), and
b) price (due to expensive licensing)
because Piracy "solves" those two problems. Treating the symptom, audio watermarking, is not going to stop people from sharing music. Content sharing is called free advertising -- or am I in "violation" because the rest of my family can listen to my music even though only I paid for it? If you don't want people to share it, then don't release it. Real simple.
Maybe it is time to bring back Sneaker Net ?
Obtain two distinct copies of the audio, diff them. Anything not common to both copies is either watermarking, noise, or compression artifacts -- and you want none of that.
The creatures outside looked from Alt-Right to Antifa; but already it was impossible to say which was which.
I'm confused about cinavia. What does it actually do? Why can I rip blu-rays without worrying about it?
I read the headline and thought it was about making Alexa work nicely in an environment where it plays loud music.
Apple's HomePod does that very nicely. Instead of adding a watermark, it compares the signal entering its microphones with the signal leaving the speakers, so if you have loud music playing through your HomePod, it can eliminate that music almost completely before it starts speech recognition.
Next, if some person in the room says "Hey, Siri", it analyses the voice of the person saying the words, and eliminates what anyone else in the room is saying. Apple published a paper about this, and has some demos somewhere. One is very loud music in a room with many people talking. Phase 1 eliminates music, leaving many people talking and a bit of white noise. Phase 2 eliminates the voices of anyone except the person saying "Hey, Siri" and what's left is one perfectly recognisable voice, plus a bit more white noise. So "Hey Siri" works with loud music as long as it is played by the HomePod, and lots of people talking. What Amazon is planning here, on the other hand, doesn't seem to be something that any of the customers buying Alexa is asking for.
Your claim, precisely as stated, appears to be true but, per your link, that doesn't mean that the watermarking hasn't been broken in other ways. In fact, citation 16 regarding DVD-Ranger CinEx appears to do precisely that: detect the signal and then remove it.
The Amazon technique sounds like exactly the same crap that you get from a lot of machine-learning researchers doing security work: they don't think about an adaptive adversary. There's an entire field of adversarial machine learning that works by training a machine-learning system on the inputs and outputs of another: if you can train a neural network to insert and recognise these watermarks, can you train another one to recognise and remove them? If you haven't even tried that, it's likely that an attacker will be able to.
I am TheRaven on Soylent News
I think Amazon's motive is to come up with a way for a home theater amp, TV, media device, etc. to watermark its audio output in a way that tells a listening Alexa-implementing device, "don't be triggered by THIS SPECIFIC audio" (so every time someone on TV says, "Alexa" the device WON'T be triggered).
The catch is, the device needs a way to distinguish between "media audio" (that should NOT trigger it) and people in the room (who should ALWAYS be able to trigger it, even while watching a TV show or movie with the 'ignore me' watermark).
It has to be something that a device on the consumer end can add, because remastering a century's worth of media to add it at the content-producer's end just plain isn't going to happen.
Amazon is painfully aware of the "TV triggered Alexa" problem. It's not just annoying, it's a real potential vulnerability (mitigated mostly by the fact that buying radio & TV ads is both expensive & non-anonymous, so an ad that INTENTIONALLY tried to exploit it would get the advertiser sued). They don't want to just overlay a "dumb" "ignore everything for {n}ms" ultasonic tone burst, because THAT could be abused as well (say, by advertisers who wanted to prevent an Alexa-controlled device from accepting commands from ANYONE during the ad). So... it needs to be:
* specific to media being played in the presence of an Alexa-implementing device
* able to be injected at the consumer end, and something that could cheaply be added to something like a blu-ray player (ideally, lightweight enough to implement as a firmware update to existing players).
* NOT affect verbal commands from humans in the room.
Incidentally, I believe Amazon initially considered trying to use Cinavia for this purpose (since it's already present in many movies), but quickly realized it would cause more problems than it solved. Cinavia was designed to robustly (and indiscriminately) scream, "stop recording!", not "ahem... please don't attempt speech-recognition on THIS SPECIFIC audio". If Echo ignored 'Alexa' for {n} seconds after recognizing a Cinavia watermark, mere playback of Cinavia-watermarked content within listening range would effectively disable the use of 'Alexa' entirely for those {n} seconds. Ergo, Amazon had to come up with something better.
To wit, this is NOT about imposing DRM. It's about preventing media content from triggering the device by having someone on-screen say 'Alexa', by giving the device a way to distinguish BETWEEN media content and local users.
I want Alexa verifying that I've paid for what I'm listening to. I also want Alexa verifying that I'm renting all my music and video from Amazon.
This is yet another reason why I don't have Alexa, Siri, or Google's thing in my house or car.
I suspect that this will be mandatory soon, much like the BBC license in the UK.
Well, that's nice and all for the "TV", but it won't do anything to stop other humans (like me) from doing things with strangers' Alexa gadgets. I have a neighbor that routinely leaves his "smart speaker" on too loudly. I just shut it off through the door. If he continues, I'll just start order large tubs of lube and rubbers for him.
Also, when I go into somebody's house, I'll ask them to turn off any of their recording devices. Just to make sure, I will also try to order some escorts via a smart speaker. It works 100% of the time.
I don't respond to AC's.
If the watermarks are different in different streams, for example (for identification of origin?), how about combining multiple streams?
Ezekiel 23:20
I don't see this as a problem that needs solving. If there's a copyrighted soundtrack playing in a noisy environment, then quite obviously the music (1) is secondary, tertiary, or non-essential to whatever else is going on in the video and thus not a copyright violation, and (2) is not a reproduction someone wanting an illegal copy of the copyrighted work would be interested in. So there's zero reason for a copyright holder to even want to detect it. It would result in stupid things like people getting a copyright strike on their YouTube video because some car passing by in the background has the radio on playing a song.
The only use I can think of this is to figure out what music and TV shows you like by eavesdropping in on what your Alexa / Google Home device's always-on microphone picks up as you play the radio or TV in your home.
can better gauge room reverberation and filter out echoes
For some reason, I read that statement and immediately felt that the speaker was more likely to be thinking about how much more accurately they can measure the room for many other reasons. I guess I'm getting more cynical.
Rooms have audio signatures. Those signatures are altered by how many people are in the room and where they are at. How much more information will they now be able to gain about the room and its contents?
Add a few thousand watermarks of the same type, and see if they can still detect it.
If you're going to listen to or watch anything that may be of "questionable" providence, better put ear muffs on your Alexa first or she might tattle.
I would say spread low cost 'watermark' emitters widely, so the watermark sound is present everywhere. A low cost emitter could be a common accessory, so that every concert, bar, and public gathering place would have a few humming along. Maybe even an emitter app people could run on their mobile device.
Please sue your grade school for malpractice.
---- The above post was generated by the Turing Institute. Maybe.
If a player is certified BD-compliant, it will look for, and respect, Cinavia.
The rest of the world doesn't. So, if you rip a BD disk and play it in, say, Kodi or VLC, Cinavia doesn't matter. Play it on an Oppo player, though, and you may get a surprise.
Even on all other 364 days of the year
I do not believe in karma. "Funny"=-6. Do good and forbid evil. Yours, Oft-Offtopic Flamebaiting Troll.
It's a Bush-ism. Seems people miss semi-normal Presidents a lot these days.
Table-ized A.I.
We could have devoted our research efforts to curing disease. Or reducing pollution. Or improving energy efficiency. Or even building better killer robots.
But no. We spent millions in research money on... Preventing unauthorized enjoyment of music.
Capitalism FTW! Fuck you, plebs, that's why!
That only works if one of the copies is the original unwatermarked one. But usually, you'll only have access to watermarked copies.
I think the point was precisely that you'd compare two different watermarked versions.
Ezekiel 23:20