Slashdot Mirror


Audio Fingerprinting Via Cell Phones

aruil writes: "MSNBC has a story reporting on yet another audio fingerprinting application. Next year, Royal Philips Electronics will begin selling licenses to allow users to identify songs using their cell phones. Similar technology has already been open-sourced in FreeAmp, which uses the Relatable engine."

89 comments

  1. Possible applications? by xX_sticky_Xx · · Score: 1

    Aside from what's covered in the article, what possible applications can anyone see for this?

    --

    ---

    I didn't want to leave this space blank.
    1. Re:Possible applications? by MiTEG · · Score: 1

      No doubt the RIAA could think of some way to use this to their advantage. Maybe require all new radios to have some sort of hardware added that would prevent playback of songs without this fingerprint? Also, it could be used for phone authentication, have a hardware fingerprinting system to ensure the person on the other end of the line is really from where they say they are.

      --
      The future isn't what it used to be.
  2. embrace &extend! [to the tune of share &en by TheM0cktor · · Score: 0, Troll

    "Microsoft Corp. and other companies are developing similar technology" -> 'Look ma, the neighbours done got dimselves some 133t new tech! Us'd better embrace and extend afore they makes it big!"

  3. Kind of hopeless... by MiTEG · · Score: 4, Interesting

    It seems kind of hopeless for all these companies and the audio fingerprinting. About a year and a half ago some company came out with a similar idea, except is was a separate device and you would have to wait until you got home and connect it to your computer. And it only worked with 2 radio stations. Obviously this idea was found to be a dud rather quickly. So now you can get the same information with a cell phone, this wouldn't by any chance be easier than actually calling the radio station and asking them what's playing? The only really effective method I've seen to do this are those giant billboards by the freeway with the screen that tells you what song is playing.

    And what about the distortion this will cause in the audio? It's not like FM radio is great quality, but embedding some sort of watermark/fingerprint that only requires 3 seconds of playback has got to have some sort of negative impact on the sound.

    Anyway, what the hell is up with all these trolls tonight? Time to start browsing at +2 now I guess.

    --
    The future isn't what it used to be.
    1. Re:Kind of hopeless... by harlows_monkeys · · Score: 2
      It seems kind of hopeless for all these companies and the audio fingerprinting. About a year and a half ago some company came out with a similar idea, except is was a separate device and you would have to wait until you got home and connect it to your computer. And it only worked with 2 radio stations

      It was Sony. It was basically a clock with a USB interface. When you heard a song you wanted to identify, you pressed a button, and it stored a timestamp. When you got home, you plugged it into the USB port, and the software read the timestamps, and then reported what was playing on the participating radio stations in your area at those times.

      They had quite a few more than two radio stations.

  4. you don't get it: by TheM0cktor · · Score: 2, Informative

    no watermark/fingerprint/anything in the music - just an algorithm that samples it, creates a small chunk of data describing it and looks that up against a database for matches. So no loss of quality involved, and if the algorithms as good as they say it'll cope with quite badly broken up music (AM radio? Noisy club?) as input.

    1. Re:you don't get it: by Darth+Paul · · Score: 1

      The article is quite vague - I can't figure out whether it uses watermarking or actually identifies the song by audible content.

      If it's the latter, then that'd be very interesting - they've essentially implemented 'grep' for audio!

      It's "interesting" but I can't think of many uses of it apart from copyright enforcement.

      I'd like to feed this system three seconds of "baby baby baby baby" from a generic pop song, and see how confused it gets.

    2. Re:you don't get it: by MiTEG · · Score: 1

      Sorry, my mistake. The idea of watermarking jumped into my mind after reading about fingerprinting, I guess I just ignored the stuff about the algorithm mentioned later in the article.

      --
      The future isn't what it used to be.
    3. Re:you don't get it: by TheM0cktor · · Score: 1

      ;)

      nice idea... will probably return SONG BY BRITNEYSTEPSA-TEENSBRYANADAMSZONEMALFUNNNNNNNCTION ZZZZZT

      definitely points toward non-watermarking:
      All that?s required is to hold a mobile phone to a radio?s speaker for three seconds ? long enough to record a digital fingerprint ? when a song is playing.

    4. Re:you don't get it: by cpt+kangarooski · · Score: 1

      It's really useful.

      For example, it can be used to determine whether or not songs are similar, and therefore be used to find songs similar to what you listen to a lot and would likely enjoy. Or to create good mixes on the fly.

      It can be used for 'radio tivo' applications, editing ads out of broadcast radio. (because it knows what bit of the pre-recorded radio was ad, and what wasn't.) And of course, it's handy for automatic station changing.

      Naturally, it's useful to be able to ID a song that's playing where you wouldn't otherwise know what it is. And a great tool for ID'ing mp3s and looking them up on a CDDB type database to fill the ID3 tags. (if for example, you hadn't done so when you ripped it)

      I was working on some mp3 projects for a while -- we were definately hoping to make use of this kind of stuff.

      --
      -- This and all my posts are in the public domain. I am a lawyer. I am not your lawyer, and this is not legal advice.
  5. Pointless.. by Anonymous Coward · · Score: 0

    We will always find a way around this stuff.. Hmm I wonder if even just reversing the audio would get past this? Or what about zipping it or encrypting it.... come on.... this is retarded. The government will never win.

    1. Re:Pointless.. by seann · · Score: 0

      From what I gandered from reading this article is, it identifys songs based on a few seconds.
      "Hey brad, whats the name of this song?"
      *Listens for a few seconds*
      "It's on the tip of my toung shaun, I can't name it"
      'Mine too.'
      "Damn."

      'Now this delema could of been prevented If only Brad and Shaun had one of those cool new cell phones. We'd know this is only brittney spears singing er new song "I have Tits, buy my album."'

      --
      I'm a big retard who forgot to log out of Slashdot on Mike's computer! LOOK AT ME.
  6. oh great by jstockdale · · Score: 1

    yet another wonderful technological innovation that will revolutionize the world

    please. is it really that hard to ask ya friend (you know ... the one with 10,000 mp3's) what song that is?

    yet another technological instrument that if implemented properly along with many other features could contrubute to a useful device, but instead will probably be marketed as a gimmick (just like that blue led "flashlight" you have at the bottom of your desk drawer, don't deny it) and eventually be dismissed as useless.

    btw this wasn't meant as a flame. go ahead and -1 it but basically waht i'm trying to say is that these devices have uses which could make them successful, who wouldn't want to know in the middle of a tv show or movie or music vid what song they're listening to. i just get annoyed at the poor implementations and over hype of such ideas

    and just disregard this if it makes no sense ... i'm tired and feel like crap

    -john

    --
    **AA: a bunch of mindless jerks who'll be the first against the wall when the revolution comes
  7. Nothing to do with Charlie's Angels then by mattbee · · Score: 2

    This could be a dastardly test-bed for keeping track of pepople using their voiceprints, since that technology, linked up to a global GPS satellite network, might just be "the end of privacy" as people are tracked down as soon as they speak on any telephone on the planet. Quick, call in Drew Barrymore, Lucy Liu and Cameron Diaz to foil them :)

    --
    Matthew @ Bytemark Hosting
    1. Re:Nothing to do with Charlie's Angels then by diodegod · · Score: 1

      I think we're safe for now. THEY'd need samples of everyone's voice. Hang on, my voicemail message provides my voice! But then THEY'd have to remove any accents I might put on to foil THEIR evil plans. And I'm hoping they can't do that yet.

      But until they do, we're safe from THEM spying and tracking us through the phone.
      Oh dear, I hope those Angels do something to avert this looming crisis.

      ~Duane

      --
      The beatings will continue until morale improves.
  8. "another" link (Bitzi) by mlinksva · · Score: 4, Informative

    Bitzi (the "another" link in the article's "yet another" statement) isn't primarily an audio fingerprinting application. It's a file metadata catalog, audio fingerprints being just one sort of metadata collected. File metadata is keyed by a "bitprint" composed of two cryptographic hashes. The code for generating bitprints and contributing metadata to the catalog is in the public domain and the catalog itself is available for free reuse and redistribution under a dmoz-like license. Disclaimer: I work for Bitzi.

  9. Any 3 seconds!? by mlinksva · · Score: 3, Interesting

    I'm impressed if the service really does accurately identify songs after only 3 seconds, and any 3 seconds of a song. Presumably you'd need to fingerprint second or two chunks of every song to have this capability. This is quite different from what I understand Relatable does, which is to fingerprint the first 30 seconds of a song, meaning a song can only be identified after 30 seconds, and only the first 30 seconds.

  10. cell phone biometric scanner by Anonymous Coward · · Score: 0

    cell phones will be equipped w/ an iris and fingerprint scanner, to be able to use the phone and to prevent terrorism everyone will have to have their iris or fingerprint on file at the cell phone provider and will have to put their eye or finger on the cellphone to place a call

  11. An even better solution by hovik · · Score: 4, Interesting

    Fast Search & Transfer has developed a "whistle sreach". Just whistle a few notes from the song you want, and their searchengine finds the songs mathcing.

    I have tried it and can confirm it works really well.

    Story from newscientist.com here. (cache)
    Also a article from GEMENI here.

    1. Re:An even better solution by Stonehead · · Score: 2

      Wow, searching on whistling would even be more unbelievable! One would fear lots of duplicates, problems with unpure/shifted whistling - it really sounds like vaporware and the site is down as well :) But it would really help to find out whether Michael Jackson really ripped that number one hit.. ;)

      Offtopic: * 2001-11-30 12:33:57 Mobile Phone System Identifies Music (science,news) (rejected) -- This was originally a New Scientist article indeed. All my submitted stories so far have been rejected, only to be accepted weeks later in a worse write-up by someone else. I will submit no more stories - it seems a huge waste of effort to me. No thanks.

    2. Re:An even better solution by nexthec · · Score: 1

      yeah, same here, I submitted somethign about a week ago on bioinformatics on the US/Canada border to identify people, but it never got selected, a quick reject tho....I wonder if it has to do with Karma?

    3. Re:An even better solution by Stonehead · · Score: 1

      No, karma hasn't got to do with it - my karma is 37 now. Read the faq. The "omelette" part sounds the least convincing to me - if it's interesting nerd news, why not post it *now*? Do the math: it wouldn't generate more stories, but posting news sooner would shorten the submission queue. Plus it's less a disgrace to us users.</sulk>

    4. Re:An even better solution by Anonymous Coward · · Score: 0

      How does one use the whistle search? I can't seem to find it.

  12. This has already been done by Anonymous Coward · · Score: 0

    This isn't something new. In Norway (and probably other places?), a cellphone operator already has a system which can identify songs via a cellphone.
    After you've received the title, you can simply send an SMS to buy it right away.

    1. Re:This has already been done by Anonymous Coward · · Score: 0

      Yes, it already exists in France.
      Look at the site http://www.mobiclick.com
      You can use your phone to know what is the song played on any of all the radio.
      After a little time, you received a SMS and you can buy the album.

  13. Not really useful.. by Master+Of+Ninja · · Score: 1

    ... as for one thing it needs a radio to work. So you need to be physically beside a radio playing a song that you don't know, which isn't very useful, as the announcer would probably announce the name of the song before or after they played it.

    What would be more useful is where you could hum a song into the phone, and it could tell you what it was. I personally need something like this as i've got this song in my head (with no lyrics so you can't use Google to find it) that is driving me nuts as I try looking for it. The ability to hum it in and give it further parameters to search for would be good.

    1. Re:Not really useful.. by Matthaeus · · Score: 1

      I don't know about the radio stations where you live, but out here, the DJ will announce the name of a song the first time he plays it and that's it. Took me two months to track down the name of Tracy Chapman's "Telling Stories" by the lyrics.

  14. Question by athmanb · · Score: 2

    Is there any plans to combine the Bitzi database with FreeDB?

  15. God, I need more coffee.. by A_Non_Moose · · Score: 2, Insightful

    The first mental image I got from the head line was a picture of someone rolling a cell phone across a black ink pad... :)

    And, correct me if I am wrong but this kinda says "digital watermark":
    "The fingerprint might contain small mistakes. The technology is so robust that it can handle that," said Jaap Haitsma, a Philips research scientist.

    Haven't we gone thru this already?

    Seriously. The only thing missing was an SMDI challenge and the RIAA. Even though Microsoft is involved in this, I'm quite sure the RIAA will (pardon the pun) chime in Very Soon Now(TM).

    Ok, quit possibly I am missing the point, but read this:
    As well, a legitimate online music services running on the Napster model could use the technology to stop copyright-protected material from being shared.

    Legitimate, Napster and stop sharing all in the same sentence?

    Eh? The whole point of Napster was to share (leave out the legit or not) songs.

    {Pitr voice}
    Someone please to be explainink this to me.
    {/end voice}

    Moose.

    .

    --
    Have you read the moderator guidelines? Well, have you, PUNK? (and I want a Karma: Gnarly option)
    1. Re:God, I need more coffee.. by Anonymous Coward · · Score: 0

      The technology doesn't involve watermarks or any other kind of information that needs to be present in the audio. Basically you identify certain features in the audio, like particularly high amplitudes in a sound wave, and translate those to a bitsequence (that's the fingerprint). You then do a database lookup with the fingerprint as key to find metadata like title and artist.

      And yes, it works with only three seconds of audio, and any three seconds at that. That's enough to generate the bitsequence which can be looked up.

      The hard part is keeping the db lookup time to a minimum, as you need a separate db entry for at least every three seconds of a song (every possible fingerprint needs to be there). And of course you need these entries for every song someone ever composed...

  16. The real test is: by jord99 · · Score: 2, Funny

    Can this actually tell two different Britney Spears songs apart? Even most humans can't do that...

    1. Re:The real test is: by (void*) · · Score: 3, Funny

      There are different Britney Spears songs?

  17. Re:Spread some Christmas cheer by Anonymous Coward · · Score: 0

    This actually is not a *total* troll, it has some artistic merit :-)

  18. I wonder if it can distinguish between... by abulafia · · Score: 1

    Say, a weird Al song and the original.

    --
    I forget what 8 was for.
    1. Re:I wonder if it can distinguish between... by Anonymous Coward · · Score: 0

      I'd be more interested in one that could tell the difference between some random parody and a real Weird Al song, automatically call up the moron who misattributed it, and send 10,000 volts down their phone line.

  19. Re:Drink with me... by Anonymous Coward · · Score: 0

    A LesMis troll? Since when?

  20. Re:Question about Bitzi by gojomo · · Score: 1

    Bitzi & FreeDB attack different problems: Bitzi does discrete digital files (not just audio), while FreeDB does physical CDs.

    So while there are some similarities, and if you could get perfect bit-for-bit CD rips then Bitzi would duplicate a lot of what FreeDB does, there's no pressing need for a combined offering. If there was, it wouldn't be too hard for either project to use whatever data it needed from the other, within the free licenses.

    (FYI: I am the CTO of Bitzi.)

  21. Probably difficult to do by My+Third+Account · · Score: 1
    I would think that the quality of music over a cell phone would be absolutely horrible.

    Remember that the way digital cell phones work is that they analyze the sound input, and send it not as audio data, but as coefficients to a human-voice synthesis DSP to save bandwidth. Digital cell phones are really only good for transmitting and recieving human voices, and are really really bad at music.

    So it is rather suprising to me that such as technology is feasible.

    1. Re:Probably difficult to do by nyquist_theorem · · Score: 2

      Remember that the way digital cell phones work is that they analyze the sound input, and send it not as audio data, but as coefficients to a human-voice synthesis DSP to save bandwidth.

      Err, what?

      You're talking about GSM encoding?

      "The quality of the algorithm is good enough for reliable speaker recognition; even music often survives transcoding in recognizable form (given the bandwidth limitations of 8 kHz sampling rate)."

      What's this about human voice synthesis DSP? Sounds a bit black-helicopters-faked-the-moon-landing to me. (or else I'm totally out of it - it happens! my cellphone here's still analog)

      --
      -- "Ignorance more frequently begets confidence than does knowledge." (Charles Darwin)
    2. Re:Probably difficult to do by My+Third+Account · · Score: 1

      No, I'm talking about CELP.

      Check it out. Or do a google search.

  22. I've seen this.... by kinko · · Score: 2, Informative

    At the recent ISMIR conference in Indiana, I saw a demonstration of a very similar thing from the Franhoffer (sp) people - it was pretty cool. Just to clarify some of the questions posed by above comments:

    1) No tampering is done to the audio - ie there is no watermark, it is "just" signal processing.

    2) The system I saw could take any 3 or 4 seconds, so that means that a fingerprint was calculated over the whole song. This means they must have some clever algorithms to make sure that the hash is calculated using the same time slices (or something...)

    3) The song has to be in the database. So that means that the fingerprint has already been calculated, and probably had metadata assigned to it either by hand or using mp3 id3 tags (this is a guess). The fingerprint size is about 16KB per song, which seems pretty reasonable.

    4) The technique only works on a per-recording basis, so even the same performer doing a slightly different version or another recording won't match if that recording was not already fingerprinted.

    5) The version I saw was standard PC software, using audio input through the microphone.

    My suspicion is that this technology is more likely to be of value to copyright holders looking to automatically identify violations (eg public airings, radio stations not paying royalties) than it will be useful to joe sixpack (or even people like us...)

  23. Cheating by Chuck+Chunder · · Score: 2

    in the "Name that tune" section of bar quizzes.

    --
    Boffoonery - downloadable Comedy Benefit for Bletchley Park
  24. Show me the money by oflanigan · · Score: 2, Interesting

    Including metadata in a digital stream is trivial, and radio should go digital soon enough. (There is not enough room for all the would-be radio stations to broadcast in the scant airwave real estate the way it is parceled now, but digital broadcasting would make more room for reluctant web-based radio stations.) Soon, the only non-digital (and therefore non meta-tagged) music will be stored in the brain. As others have stated, technology that can only identify playback isn't really that useful, but a program that could identify a song by a few hummed or whistled notes would be Really Cool.

    As a musician, I value authenticity and would love to have an app that would prevent my brain from tricking me into thinking I had composed a remembered melody. Also, many people would love to know what that song stuck in their head is. However, is this enough consumer interest to sustain such a product? Furthermore, is there a chance that copyright lawyers will get out of control with this kind of power?

  25. Alternative uses for this technology? by Tyrall · · Score: 3, Insightful
    The RIAA must be rubbing its proverbial hands with glee. Gone are the legal defenses that music/file-sharing systems have used.
    Gone are the methods of avoiding detection used to date.

    Even if this detection has no way to discern between the original and a cover of the song, I can see the RIAA and major labels nailing a bunch of people, and using this system as proof.

  26. Re:Question about Bitzi by athmanb · · Score: 2

    Yes, but even though Bitzi is a general file catalogueing project, taking information from other, more specific sources can help (when their license allows it, of course)

    For music files, this would of course be FreeDB. For movies, a good choice would be IMDB etc.

    For instance, if I look up one of my Nightwish songs, Bitzi gives me the following information:
    http://bitzi.com/lookup/TTGZBRZLZ2HLXDHSQYBTEJD33M Y4OA2X.46IPPFIFT353PXN2BWBZEMYBF3ASZXTCWJN43RY
    the data from FreeDB is more accurate, giving the album the song belongs to, the playtime etc.
    http://www.freedb.org/freedb_search_fmt.php?cat=ro ck&id=c011130f

  27. Re:Question about Bitzi by mlinksva · · Score: 1
    You mean the FreeDB record is more comprehensive (though the Bitzi record for that file does include playtime). Bitzi records can accomodate much more information than FreeDB, but will generally have less for a newly reported file. There are two obstacles to integrating FreeDB data with Bitzi:
    • You need a discid (or the track offsets used to calculate discid), and generally someone with a file won't have access to the discid, so there really isn't any way to look up FreeDB information given just a file, which is what Bitzi has to work with.
    • FreeDB is GPL, Bitzi is dmoz-like (OpenBits).
    Those caveats aside, in the longer term I do hope to see collaboration and cross-pollination among all free catalog projects.