Slashdot Mirror


Real-Time, Detailed Face Tracking On a Nokia N900

ptresadern writes "Researchers at the University of Manchester this week revealed a detailed face tracker that runs in real-time on the Nokia N900 mobile phone. Unlike existing mobile face trackers (video) that give an approximate position and scale of the face, Manchester's embedded Active Appearance Model accurately tracks a number of landmarks on and around the face such as the eyes, nose, mouth and jawline. The extra level of detail that this provides potentially indicates who the user is, where they are looking and how they are feeling. The face tracker was developed as part of a face- and voice-verification system for controlling access to mobile internet applications such as e-mail, social networking and on-line banking."

30 of 139 comments (clear)

  1. Finally, something to do with this phone by Anonymous Coward · · Score: 4, Interesting

    I love my N900, it's a shame Nokia doesn't. Still waiting for MeeGo, and to get the best out of my device I've OC'ed it slightly, not to mention transition and touch screen sensitivity tweaks which all make the phone much more usable. What I want to know is why can't they get it right the first time? Since they didn't, how hard would it be to adopt similar tweaks directly into the OS so it doesn't feel so sluggish? It had/has so much potential, but I'm afraid for now, we'll never see it. As soon as Apple releases an iPhone with a slide out QWERTY keyboard, I'm in.

    1. Re:Finally, something to do with this phone by KiloByte · · Score: 3, Interesting

      As soon as Apple releases an iPhone with a slide out QWERTY keyboard, I'm in.

      Why would you bother? That's a completely different class of gear.

      iPhone is a phone with a bunch of toys, N900 is a full sub-notebook with phone capabilities tacked on.
      The former can run just a few random "apps", the latter allows you to install a regular OS with all of its functionality.

      The keyboard is one of significant advantages of N900, but definitely not the main one.
      For one, the research done in this article would be flat out impossible on iPhone due to its closed nature.

      --
      The creatures outside looked from Alt-Right to Antifa; but already it was impossible to say which was which.
    2. Re:Finally, something to do with this phone by colinrichardday · · Score: 4, Insightful

      If I'm not going to treat my phone as a subnetbook, then why do I need an iPhone in the first place? I can make calls onmy cell phone without having to pay Apple for a walled garden.

    3. Re:Finally, something to do with this phone by chammy · · Score: 5, Interesting

      ... low amount of apps, etc.

      You can install Debian packages on an N900. It's essentially a tiny ARM tablet running Linux.

    4. Re:Finally, something to do with this phone by dnaumov · · Score: 3, Insightful

      As soon as Apple releases an iPhone with a slide out QWERTY keyboard, I'm in.

      Why would you bother? That's a completely different class of gear.

      iPhone is a phone with a bunch of toys, N900 is a full sub-notebook with phone capabilities tacked on.
      The former can run just a few random "apps", the latter allows you to install a regular OS with all of its functionality.

      Are you seriously this delusional?

      1) "A few random apps" = over 250,000. How many apps were there in Maemo repos again?
      2) Who the fuck is going to bother installing a "regular OS" on an N900? Next thing you will be probably suggesting people "work" in commandline on a phone or try to use Abiword on it.

      And this is coming from a person who has owned and used N900 since December.

    5. Re:Finally, something to do with this phone by Lally+Singh · · Score: 5, Interesting

      Ahem.

      I had an iPhone before my N900, and frankly I adore the N900. It's fast, responsive, and it's easy to understand what's going on. If the music's skipping (which happened on both devices), I pull up top, then renice my music player. If I want a nice note-taking program, I just run emacs & org-mode on it. Then I'll 'git push' those notes for my other machines. I use citrix to run an app at work (note: despite what the website says, it doesn't actually require motif). The map program (not the stock one, but one you can download a package for) is utterly fantastic. I even have a subway map for my city.

      Really, advanced users of the iPhone really just want a mobile computer, with a phone tacked on. The UI on the N900 is pretty good, and it does what I want with few problems, and many, many wonderful plusses over the iPhone platform.

      Also, it has a keyboard, replaceable battery, and flash :-) I can stream full-screen flash videos in a cab.

      --
      Care about electronic freedom? Consider donating to the EFF!
    6. Re:Finally, something to do with this phone by DarwinSurvivor · · Score: 5, Informative

      250,000 huh?

      Most of the iPhone apps fall under the following categories:
      -small flash-like games
      -videos wrapped in an app api
      -sound boards

      If you are going to count apps like that, then lets add the following to the n900's list
      -*actual* flash games (addictinggames.com, etc all work)
      -built in unix tools (top, etc)

      I'm fairly certain if you compared these now-equivalent lists, you would probably find the n900 has MANY more apps, and that most of them are probably MUCH better written to boot.

      Oh, did I mention you can literally write your own apps in almost ANY language you want without paying $100 for a developers key. You can even distribute your own software repository publicly without paying a fee or asking users to void their warranties.

      Yeah, 250 000 apps sounds kind of pathetic to me...

    7. Re:Finally, something to do with this phone by vinsci · · Score: 3, Interesting

      Probably Mappero. or if you want to edit OpenStreetMap, OSM2GO. These are golden. The Nokia Maps application has one big plus, though: you can store complete maps for the whole world on the N900 device (free downloads from Nokia, in case you managed to miss the commercials) so you don't need Internet access while finding your way. I still prefer Mappero though and simply zoom in to the required detail level and go over the route I intend to take in advance, so that Mappero downloads and caches the maps and I can do without Internet access again. Only if I get truly lost, i.e. when I am outside the cached maps in Mappero, do I switch over to the Nokia Maps application. Now if we could have the wonderful Mappero combined with the pre-downloaded Nokia Maps map database, it would be perfect.

      --

      Trusted Computing FAQ | Free Dawit Isaak!
    8. Re:Finally, something to do with this phone by Urkki · · Score: 2, Informative

      >>> Why would you bother? That's a completely different class of gear.

      Different in what way? Both use pretty much the same Cortex A8 processor and share many similar specifications - in that regard both units are just 'sub-notebook' type computers with different operating systems.

      To put the difference in a nutshell, iPhone is an "embedded device", ie. software and hardware are meant to be inseparable. It is a device with fixed features (of course running approved "apps" and limited (no Flash) browsing of web services are very powerful features). N900 is a PC in the sense that it/Nokia/Maemo does not try to limit what you can do with it. Real limits (as opposed to limits enforced by software only) of the hardware are the only limitation.

      N900 has one software feature: it can run software. iPhone has only the software features explicitly approved by Apple.

      Of course if Apple had it's way, they'd bring Macs to the same class as iPhone, running only approved software. But Macs are thought of as computers, so they can't do that. But wait for a displayless iPad Mini with wireless touchpad-keyboard and an HDMI-out, I'm sure that's on it's way... ;-) Actually, just give me "legal" Python or Ruby with reasonable UI library bindings and a developer community, and give me Flash with usable (Linux-like) performance, and I'd buy one as soon as I'd be able get my hands on one.

    9. Re:Finally, something to do with this phone by GameboyRMH · · Score: 2, Interesting

      Anyone who thinks there is a "low amount of apps" for the N900 must be counting the apps in the Ovi Store.

      The Ovi Store is where all the crappy commercial apps are, and there are few. I have 2 apps installed from there. The good apps are in the community repos, and there are MANY.

      Plus there are the Debian packages on top of that.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    10. Re:Finally, something to do with this phone by ScrewMaster · · Score: 2, Interesting

      but it seems like the last two or three years have seen a big decline in passion for nerdy computing, with discussion here now little different from other sites like Reddit

      Yes. I'd say that the popularity of discussions about completely non-nerd-friendly, hacker-useless products like the iPhone and iPad indicates a shift in viewership. I've never owned an N900, but after reading the above comments I must say it sounds like a device that I would get something out of. I say that as a software developer, but as you point out, this is a site that's supposed to be "News for Nerds."

      --
      The higher the technology, the sharper that two-edged sword.
  2. Personal Minority Report by ScrewMaster · · Score: 4, Funny

    The extra level of detail that this provides potentially indicates who the user is, where they are looking and how they are feeling.

    Phone: I noticed that you've been watching that blonde over there, and you appear to be sad. Would you like a list of local escort services?

    --
    The higher the technology, the sharper that two-edged sword.
    1. Re:Personal Minority Report by nikomo · · Score: 2

      Yes please.

    2. Re:Personal Minority Report by giorgist · · Score: 2, Funny



      <quote><p>The extra level of detail that this provides potentially indicates who the user is, where they are looking and how they are feeling.</p></quote>

      <p>Phone: I noticed that you've been watching that blonde over there, and you appear to be sad. Would you like a list of local escort services?</p></quote>

      There's an app for that

  3. was the n900 a good buy? by Anonymous Coward · · Score: 3, Interesting

    Articles like this make me glad that I bought the n900 because it is the premier development environment for phone based science, unfortunately, the downside is that there aren't very mainstream apps for the n900 (google maps being the most glaring absence).

  4. OpenCV by Haven · · Score: 2, Informative

    Those game demos looked a lot like the standard implementation of OpenCV. It's too bad there isn't any security on this technology as merely showing a picture of the person to the camera defeats it.

    1. Re:OpenCV by queazocotal · · Score: 2, Informative

      Not quite.
      For example - face recognition plus "now smile" "now frown" - required the attacker to be using some sort of video system.

      Face recognition plus a short list of words that the user has assigned an emotion - for example - the phone
      displays in sequence the words
      Fish (erman drowned) = frown
      Localsportsteam (won) = smile ...

      Or gaze tracking on a virtual keyboard.

  5. Blacks? by line-bundle · · Score: 4, Interesting

    How well do they work with black people? These have been issues in other face recognition systems.

    1. Re:Blacks? by colinrichardday · · Score: 2, Informative

      He's talking about the fact that some facial-recognition software works better on lighter-skinned people.

      http://today.msnbc.msn.com/id/34514093/ns/technology_and_science-tech_and_gadgets/

       

    2. Re:Blacks? by ooshna · · Score: 3, Funny

      It works great with blacks as long as they cover their face in white out.

  6. Gut reaction.. by Anrego · · Score: 3, Insightful

    controlling access to mobile internet applications such as e-mail, social networking and on-line banking.

    First one kinda iffy.. second one makes sense.. third one, no way in hell!

    It's the old convenience vs. security argument. Personally for things like my money, I'm willing to go the extra mile and enter a password (or some kind of one time code if only my bank offered it).

    1. Re:Gut reaction.. by Nemyst · · Score: 2, Funny

      Who doesn't want to make weird faces to their phone to enter a password for their bank?

  7. Viola-Jones? by airfoobar · · Score: 2, Interesting

    Can't find any detailed info, but from looking at their demo, I'll guess they are probably using the Viola-Jones method, possibly with a "tree" cascade to detect face angles. The last time I checked, libopencv provided most of the tools to build such as a system, as well as pre-trained detectors for individual face features. Not much invention going on here, but possibly some innovation -- I'd be interested to see more info, if anyone knows where to find it.

    1. Re:Viola-Jones? by straponego · · Score: 2, Funny

      Bah. I won't trust it until they use Voight-Kampff.

    2. Re:Viola-Jones? by Steve+Mitchell · · Score: 2, Interesting

      Active Appearance Models work by creating a deformable model of appearance built by combining a point distribution model with a texture model using principal component analysis (PCA). Basically what that means you take a bunch of faces, located landmark points like the corners of eyes, apex of the chin, etc., create an average face and use PCA to statistically model the variations. Next you morph the faces together from their original landmark points to average face, and do a PCA on the pixel values. This creates a pixel-wise model of 'texture' which also models variations. With these two parts you have a thing that (with a good sampling of face) models most faces and emotions with about say 80 to 120 numbers and statistical ranges for those numbers.

      So how do you use this to track faces? Well you use gradient decent to optimize the appearance of the face to image by adjusting those 80-120 values, x, y, scale, rotation until the pixel difference is close to zero. The trick is the gradients are approximated by precomputed derivative images, but this only works if the model is initialized on top of the original face. You can see in the video, he used Viola-Jones (the green squares) to locate the face and then dropped the AAM on top of it. He's only showing the landmark points and not the texture model.

      I did my dissertation on this almost a decade ago for tracking MRs of hearts, even back then it was pretty fast. What's interesting is not only can the model identify, but you can also reconstruct synthetic images of faces, and the model parameters could be used for identifying a person, identifying an emotion, creating a synthetic face swapping another person's identity but keeping the same parameters for expression, etc. My own implementation reliably detected anomalies in beating hearts.

      I really wanted to build a business around it back then, but it was in conflict with my advisor and university at the time.

      --
      -- Making computers see, hear, and think... http://www.componica.com/
  8. Re:N900 without phone? by xnpu · · Score: 2, Informative

    The N810 is bulkier and a bit behind in software version. There's no obligation to use the N900 with a carrier. I don't. I use it with WiFi exclusively.

  9. Re:N900 without phone? by sela · · Score: 3, Informative

    If I want something like an N900, but I don't plan to use it on a cell phone carrier, is the N810 any good?

    IMHO, you should still be much better off with an N900. The N810 is already quite old and have a lot of annoying limitations. It got only 128MB of RAM, which is a major limitation. You can easily get out of memory with the N810 if you browse a heavy web site, and multi-tasking is limited as well. In addition, it got a relatively slow CPU, no OS support for GPU accelaration, 2GB internal storage and a limited size of system space for installing apps.
    The N900 got 256MB RAM and 1GB virtual memory (with swap space), faster CPU, 32GB internal storage and up to 2GB for applications.

    The N810 have a larger screen, which can be an advantage in some cases, but it is also bigger and heavier.

    Better go with an N900. You can find used/refurb units for quite cheap prices on ebay.

  10. What Repository? by blackpig · · Score: 3, Insightful

    Where can I find this?

    exras-testing or extras-devel ?

    Surely it's not in the Ovi Store?
    ;-)

  11. The N900 ISN'T (just) a phone by Colin+Smith · · Score: 5, Insightful

    Course, Nokia is a phone company and that's how they market it.

    The N900 is a Linux box, which fits in your pocket, and which can talk to GSM, UMTS, WiFi, Bluetooth, FM transmitter and receiver, infrared transmitter, GPS.. Has an accelerometer, touchscreen, 5MP camera, audio (obviously), and TV out.

    Lets put it this way. The N900 is a general purpose mobile computing module with battery backup that can do everything, talk to everything, uses open standards and is easy to use.

    You can write bog standard shell/python/java/c/ASM/whatever software for it and distribute them as Debian packages.

    Anything you can think of to do with a computer, you can do with the blessing of Nokia and you can do it mobile with full knowledge of location and movement. That is the difference between open and closed.

    No offense or anything, but it's a no brainer.

    --
    Deleted
  12. Mod parent up! by Kupfernigk · · Score: 4, Insightful
    No mod points, good post.

    If you filled in the extensive questionnaire Nokia sent N900 owners, you were asked to rate the N900 on a scale from "computer with phone functions" to "phone with computer functions". Nokia understands the issue well. I don't think the N900 is anything at all to do with the iPhone/Android world. It is simply a completely different class of machine, and Nokia's low key approach suggests they regard it as a research vehicle. In exchange for supporting their research, you get a piece of equipment targeted at software developers. Yes, it's slower than an iPhone or recent Android devices. It's heavier. It's clunkier. But it's lighter, smaller and more convenient than anything else which I can use to do the same job.

    --
    From scarped cliff or quarried stone she cries "A thousand types are gone, I care for nothing, no not one."