Cell Phones That Learn the Sounds of Your Life

An anonymous reader writes "Researchers at Dartmouth College have developed new software that uses the microphone on the iPhone to track and interpret a user's everyday activities using sound. The software, called SoundSense, picks up sounds and tries to classify them into certain categories. SoundSense can recognize completely unfamiliar sounds and runs entirely on the phone. It automatically classifies sounds as 'voice,' 'music,' or 'ambient noise.' If a sound is repeated often enough or for long enough, SoundSense gives it a high 'sound rank' and asks the user to confirm that it is a significant sound and offers the option to label the sound. In testing, the SoundSense software was able to correctly determine when the user was in a particular coffee shop, walking outside, brushing her teeth, cycling, and driving in the car. It also picked up the noise of an ATM and a fan in a particular room. The results [PDF] of the experiments were recently presented at the MobiSys 2009 conference."

Comments

Re:Oh great....

[CastrTroy]

Actually not a bad idea. A lot of time I would like to wear my iPod while doing house work, but I don't because I can't hear the baby cry. If I had an iPod that could recognize when the baby was crying, and play it over the headphones in place of my music, so that I knew the baby was crying, then I would really appreciate this feature. Same goes for somebody calling out my name. Even if there was a 1 second delay, it would be awesome.

In response to "Why?"

[bobetov]

I see a lot of tags/comments asking what this is useful for. There are a few uber-nerd things like recording your life and whatnot that I'm not going to get into, but the big one is determining location.

There are a TON of sweet things you can do with accurate location information, but the one that I'm most yearning for is to control my bluetooth, wifi, ringer volume, etc based on where I am during the day.

I'm an Android user, and there's a very nice applet called Locale that attempts to do this, but it proves to be pretty useless. The reason is that you're either using GPS (drains battery, doesn't work indoors) or wifi (drains lots of battery, and is the primary thing you want to control) to figure out where you are. If using the microphone and cpu is cheaper in energy, then this will be a big win.

Beyond the energy use argument, one of the main things you want to control is bluetooth - again, it drains batteries when on, and is not generally useful. But it's EXTRAORDINARILY useful in the car if you have a hands-free setup. Again, figuring out when you're in a car is hard via GPS or wifi, but this technique would seem to knock that one out of the park.

So, in summary, having your phone know where you are in your daily routine allows it to be more intelligent about what services and functionality it enables, and thus makes your cell phone that much smarter and more valuable.