Slashdot Mirror


Lost the Remote? Use Your Face

coondoggie writes "A researcher has discovered a way to use facial expressions to speed and slow video playback. By using a combination of facial expression recognition software and automated tutoring technology Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading the project that ultimately is part of a larger venture to use automated facial expression recognition to make robots more effective teachers. The researchers recently conducted a pilot test with 8 people that demonstrated information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time."

88 comments

  1. what? by Anonymous Coward · · Score: 0, Funny

    wait... now what did you say? I didn't get it. Could you explain it another way please?

  2. Use your face by kharri1073 · · Score: 4, Funny

    ... or just look between the couch cushions.

    1. Re:Use your face by eln · · Score: 5, Funny

      I don't know about you, but when looking for the remote I find my face, specifically the eye part of the face, to be an invaluable tool.

  3. Bah! by 0100010001010011 · · Score: 4, Funny

    I have Bell's Palsy you insensitive clod!

    1. Re:Bah! by chemisus · · Score: 3, Funny

      in soviet russia, tv watches you!

  4. Invalid Input by Anonymous Coward · · Score: 5, Funny

    So, whenever you were constipated, your movie would start rewinding?

    1. Re:Invalid Input by Anonymous Coward · · Score: 0, Informative

      Unfortunately (or fortunately, as the case may be), the expression on people's faces when they view 2 Girls 1 Cup produces feedback so strong that it destroys the screen.

    2. Re:Invalid Input by Wicko · · Score: 0

      Shouldn't you be sitting on one of these if you have a constipated look on your face?

    3. Re:Invalid Input by Biff+Stu · · Score: 1

      I don't get it. If you're constipated, how could you possibly use it?

      Oh, wait...that's facial recognition, not fecal recognition.
      Never mind.

    4. Re:Invalid Input by risk+one · · Score: 1

      Imagine watching Catwoman on this thing. The more you cringe, the longer it will last.

  5. Obvious use by Anonymous Coward · · Score: 5, Funny

    The obvious use for this technology is, of course, pornography. When it detects a look of boredom it knows to fast-forward through the plot bits. When it detects a relaxed-but-slightly-guilty look, it knows to stop the video and clear your browsing history.

    1. Re:Obvious use by Mushdot · · Score: 2, Funny

      It will also help to find the smattering of good bits in the Star Wars prequels:

      Use the face, Luke.

    2. Re:Obvious use by HitekHobo · · Score: 2, Interesting

      This kind of feedback could have astounding implications when you consider a 'porn tree' that viewers branch down based on their unconscious response to the stimulus before them.

      It might be just a small part of robotic teaching, but it could be industry changing for cyber-porn if someone actually developed the 'porn tree' and could get actors to play out a scene a couple of dozen ways with varying camera angles etc.

    3. Re:Obvious use by GroeFaZ · · Score: 2, Insightful

      Another use: when robots take over teaching (no matter the subject), whenever the robot teaching goes into a possibly pornographic direction, make an interested face, otherwise look bored. In due time, the robot should lecture about pr0n exclusively.

      --
      The grass is always greener on the other side of the light cone.
    4. Re:Obvious use by OglinTatas · · Score: 1

      and when it detects the "nut face" it goes into sleep mode?

    5. Re:Obvious use by gdog05 · · Score: 1

      More than likely you'd sneeze causing the volume to max out just as someone arrives at the door. Now THAT's technology at work!

    6. Re:Obvious use by popmaker · · Score: 1

      Heh, that just sound like the dialogue for one of the worst product placements in history... "That's right master yoda - the with the Facemaster 3000 I can easily spot what that evil Darth Vader and his gang of mischievous villains are up to - and I don't even have to use the remote!"

    7. Re:Obvious use by Anonymous Coward · · Score: 0

      They could hook this up to a symbian too...

    8. Re:Obvious use by Anonymous Coward · · Score: 0

      And when it detects a surprised-cause-mom-just-walked-in-look it stops the porn and opens up your latest school paper, right?

  6. What about by pedropolis · · Score: 2, Funny

    What about when it sees my O face. You know, Oh Oh Oh...

    1. Re:What about by Anonymous Coward · · Score: 0

      So, the face you make when the new Ubuntu comes out?

  7. I can't wait by merreborn · · Score: 5, Interesting

    Great. Then you'll know when the kids who grew up with this technology get bored -- they'll subconsciously start to make the "fast forward" facial expression.

    And when they mishear something, they'll make the "rewind" face.

    I can't wait. It'll be hilarious.

    1. Re:I can't wait by Vectronic · · Score: 4, Funny

      Agreed, just think about the brats, sitting in the corner, cycling through all the facial expressions trying to figure out why life isnt working.

    2. Re:I can't wait by Tubal-Cain · · Score: 1

      Actually that could be a very useful bit of body language. I guess it depends on how exaggerated the facial cues are.

    3. Re:I can't wait by jellomizer · · Score: 2, Insightful

      Well this could have unforeen consequenses. Say you have to watch a boring show or presentation. It is booring really boring but you have to go threw it as there is important information randomly spread out. If we start making expressions so automatically then we the kid will miss all the information.
      Or if there are 2 people watching the show and one guy is really dense and just doesn't get it the other guy will have to watch the show stop and start when he doesn't want it to.

      And Kids They will play the damn segment over and over and over and over and over again. This will just lead to child abuse.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    4. Re:I can't wait by Anonymous Coward · · Score: 1, Funny

      Just hope I don't see the "fast forward" face when I'm having sex.

  8. Wonder if this can be applied to the web by Anonymous Coward · · Score: 0

    There are some faces I make when I see goatse and other 'shock' sites. Would be nice to link those to 'alt-f4'.
    There are also some faces I make at work when the boss shows up that could also help to have an action linked to make it look like I'm working.

    For some reason the boss didn't like the rfid tags idea for boss tracking.

    1. Re:Wonder if this can be applied to the web by Tubal-Cain · · Score: 2, Insightful

      For some reason the boss didn't like the rfid tags idea for boss tracking. Maybe you should use bluetooth as an early-detection system if the range in your workplace is satisfactory.
  9. Excellent teachers... by Thelasko · · Score: 5, Insightful

    can do this. I've noticed bad college professors just keep plowing through the subject. The best ones will look at the students faces and say, "Lets back up a little," when they see blank stares from their pupils.

    I don't think the ability to determine how difficult a concept is to grasp is the breakthrough here. I think it's the fact that a machine can do it.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    1. Re:Excellent teachers... by geekoid · · Score: 1

      That alone can be the difference between a mediocre teacher and a great teacher.

       

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    2. Re:Excellent teachers... by street+struttin' · · Score: 2, Insightful

      I would assume that a blank stare would be the most common face made when viewing TV. Especially if it's something that starts with "America's..." or "Celebrity...".

    3. Re:Excellent teachers... by Thelasko · · Score: 1

      would assume that a blank stare would be the most common face made when viewing TV. Especially if it's something that starts with "America's..." or "Celebrity...". I took apart my TV and used the parts to build an electron microscope years ago. The entertainment value in watching grass grow on the cellular level far exceeds that of reality TV.
      --
      One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
  10. fingertips by COMON$ · · Score: 3, Insightful
    Ok I don't like the idea of changing with my facial expressions. We humans use soo many expressions when talking and even just watching video that any device recording them bound to get confused. What I am interested in is the gesture based technology. Proof of concepts like where they converted the wiimote to a sensor are neat. But I would pay good money for a universal remote where I could gesture with my hands to interact with my consoles. I feel like these are right around the corner. No looking for your remote, just gesture to change the channel or turn up the volume with a precursor motion. Every once in a while you see a company try to hit this market with different products like the playstation webcam thing but no one has hit it on the head yet.

    Has anyone heard of a company making good headway in this department?

    --
    CS: It is all sink or swim...oh and did I mention there are sharks in that water?
    1. Re:fingertips by daveatneowindotnet · · Score: 1

      Open source software for gesture recognition http://www.movesinstitute.org/~kolsch/HandVu/HandVu.html

    2. Re:fingertips by COMON$ · · Score: 1

      I don't know, project looks stale, no updates in over 2.5 years.

      --
      CS: It is all sink or swim...oh and did I mention there are sharks in that water?
    3. Re:fingertips by Anonymous Coward · · Score: 0

      GestureTek is working on this (www.gesturetek.com), although I can't find any reference to it on their website. I saw their CTO do a presentation at the ATIS Think conference in Las Vegas a couple of weeks ago, and it was quite awesome. Simple hand gestures from the couch to choose channels and favorites, with the favorites selected using face identification software that can tell the difference between family members. They also showed the possibility of answering VOIP calls through your TV, and pausing the streaming TV feed with a wave of the hand when you answer a call. He mentioned that they would be demonstrating it integrated into commercial units at the fall and winter consumer electronics shows.

    4. Re:fingertips by COMON$ · · Score: 1

      hmmm if that is the case, then it is only a matter of time until a unit comes out to translate to existing receivers Wouldnt be difficult to do the translation to infrared. Would be nice so that we can use it on the sets we already have rather than investing in a ton of new tech to use it.

      --
      CS: It is all sink or swim...oh and did I mention there are sharks in that water?
  11. Slippery slope by edwebdev · · Score: 2, Funny

    Next, they'll be teaching computers to read lips. Anyone who has seen 2001: A Space Odyssey knows that this is a bad idea.

    1. Re:Slippery slope by Kingrames · · Score: 1

      That can only be attributable to human error.

      --
      If you can read this, I forgot to post anonymously.
  12. If it can recognize my "Stupid TiVo!" face - by RevWaldo · · Score: 2, Funny

    If it can recognize my "Stupid TiVo!" face when TiVo starts playing back one minute after (or before) I press the play button when rewinding (or fast-forwarding), well, we've got a winner here. Or at least recognize what I mean when I'm screaming "Not there! THERE! Ya piece of junk!"

    1. Re:If it can recognize my "Stupid TiVo!" face - by mattack2 · · Score: 1

      That's a generally highly respected feature of Tivos. I believe it's patented too.

      If you don't want it to jump back, use 30 sec skip instead.
      type select play select 3 0 select
      on the remote... Now the -> key skips 30 secs in normal play mode.

  13. TFA by msaver · · Score: 2, Informative

    A researcher has discovered a way to use facial expressions to speed and slow video playback.

    By using a combination of facial expression recognition software and automated tutoring technology Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading the project that ultimately is part of a larger venture to use automated facial expression recognition to make robots more effective teachers.

    The researchers recently conducted a pilot test with 8 people that demonstrated information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time.

    "If I am a student dealing with a robot teacher and I am completely puzzled and yet the robot keeps presenting new material, that's not going to be very useful to me. If, instead, the robot stops and says, 'Oh, maybe you're confused,' and I say, 'Yes, thank you for stopping,' that's really good," said Whitehill in a release.

    Recent advances in the fields of pattern recognition, computer vision, and machine learning have made automatic facial expression recognition in real-time a viable resource for intelligent tutoring systems (ITS), researchers added. As facial expression recognition technology improves in accuracy, the range of its application will grow. One particular application we are currently developing is a \smart video player" which modulates the video speed in real-time based on the user's facial expression so that the rate of lesson presentation is optimal for the current user, researchers said.

    In the pilot study, researcher said the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology.

    One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, researchers could train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes.

    The goal of UC San Diego's Machine Perception Laboratory is to gain insights into how the brain works by developing systems that perceive and interact with humans in real time using natural communication channels. Researchers are also developing algorithms for robots that develop and learn to interact with people on their own. Applications include personal robots, perceptive tutoring systems, and system for clinical assessment, monitoring, and intervention.

    Interested in hypermiling?

  14. Apply face liberally by Captain+Spam · · Score: 4, Funny

    Oh, oh, facial recognition. That makes a lot more sense. When I read the headline, I first thought it was going to suggest that if you lose the remote, get up and bash the buttons on the DVD player with your forehead or something.

    A similar system applied to computer keyboards would certainly make IT and data entry more interesting professions...

    --
    Demanding constant attention will only lead to attention.
    1. Re:Apply face liberally by niceone · · Score: 1

      Oh, oh, facial recognition.

      Yeah, because faecal recognition would be kind of messy.

  15. Obligatory Hitchhikers... by camperdave · · Score: 4, Insightful

    For years radios had been operated by means of pressing buttons and turning dials; then as the technology became more sophisticated the controls were made touch-sensitive -- you merely had to brush the panels with your fingers; now all you had to do was wave your hand in the general direction of the components and hope. It saved a lot of muscular expenditure of course, but meant that you had to sit infuriatingly still if you wanted to keep listening to the same programme.
    --
    When our name is on the back of your car, we're behind you all the way!
  16. Makes for an interesting CSI episode by kiehlster · · Score: 1

    Lets see... according to the speed of playback, I'd say the attacker jumped around the corner and startled John Doe before killing him and fleeing. It's clear that John Doe was a sports fan and configured his system to slow the video down when the current game play is unexpectedly upsetting.

    1. Re:Makes for an interesting CSI episode by daveatneowindotnet · · Score: 1

      I can already hear the inappropriate one liner. "Looks like he lost his face for TV" *cue The Who*

  17. The best interface by UnknowingFool · · Score: 4, Funny

    Until we develop a neural link, all other interfaces will be poor substitutes. Of course there are drawbacks like the possibility that it will become The Matrix. Even if it worked, it might work too well:

    [Average male watching TV]
    [Average Male thought]: Hey! Football is on.
    [Neural Link switches to football]
    [Average Male thought]: Damn, a commercial. What else is on?
    [Neural Link begins switching channels at a breathtaking rate. Epilleptics in room start convulsing]
    [Average Male thought]: Is the game back on?
    [Neural Link switches back to football]
    [Average Male thought]: Damn, another commercial. Hey that girl is hot!
    [Neural Link switches to Playboy channel and dims lights]
    [Male's Significant Other stares at him in disgust]

    --
    Well, there's spam egg sausage and spam, that's not got much spam in it.
    1. Re:The best interface by Digital+End · · Score: 1

      I wonder exactly how 'trackable' your ... I guess "Thought Voice" really is. When you talk out loud in your own head... or for that matter if everyone CAN do that.

      Differences in mental make up are going to make direct interface devices a pain in the arse, but if we can all at least 'talk' in our heads, it would be a good step... even if everyone had their own translator (which I'm sure they would)

      --
      Beware of he who would deny you access to information, for in his heart, he dreams himself your master.
    2. Re:The best interface by AgentSmith · · Score: 1

      Hey! I like that idea.

      But you forgot the punchline

      [Male's Significant Other stares at him in disgust]
      [Neural Link switches switches to Dr. Phil]
      [Male's Ex-Significant Other walks in and yells]
      [Neural Link switches to Jerry Springer. Convulsing Epileptics start chanting Jerry! Jerry!]

      I gotta tell the boss!

      msgsend to 1.1.1.1

      Architect. Suggest appropriate changes to Matrix. Note previous text. End Msg;

      chkmsg from 1.1.1.1

      Process AgentSmith. Suggested changes failed in nodes 1456:456-1456:468. Matrix change denied.
      BTW. Get back to work and stop posting on Slashdot. End Msg;

      !!! How did he know?!!!

  18. Interesting by iXiXi · · Score: 2, Funny

    So when you are nodding off late at night, what happens? Does the volume go up and down? That could create an infinite loop. I bet if my neighbor's wife looked at the TV it would change the channel to the Sci-fi network.

  19. And in an ironic twist... by Grendel_Prime · · Score: 1

    ... when you do this in front of other people because of a lost remote, now you lose face as well.

  20. Finally, can auto skip Shyamalan films by Anonymous Coward · · Score: 0

    Finally, a system that will automatically fast forward past m night shyamalan and uwe boll films purely by observing my natural reactions.

  21. Hmmm by ubrgeek · · Score: 4, Funny

    > The next Slashdot story will be ready soon, but subscribers can beat the rush and see it early!

    *look of boredom*
    Nope, didn't help ...

    --
    Bark less. Wag more.
  22. Help desk by Rik+Sweeney · · Score: 3, Funny

    Cool! We could apply this to computers and do away with the mouse...

    Typical day at the support desk:

    Support: "Hello, how can I help you?"
    User: "Hi, I can't see how to open an application"
    Support: "OK, you need to look at the application you want to open"
    User: "OK"
    Support: "Now, double blink with your left eye"
    User: "Hey! That did it!"
    Support: "Great, is there anything else I can help you with?"
    User: "Yeah, sometimes I'll be doing stuff and the popup menu will appear, it's quite annoying"
    Support: "Hmmm, perhaps you suffer from a nervous twitch"
    User: "Actually, I do have a problem in my right eye, that's probably it!"
    Support: "Thanks for calling, bye now."

    1. Re:Help desk by Digital+End · · Score: 1

      Caller: I'm trying to open my browser, but nothings happening

      Tech: Are you thinking about your browser or tacos?

      Caller: Tacos

      Tech: Ah, common problem. Think about your browser.

      Caller: Ahhhh! That did it! Thank you!

      --
      Beware of he who would deny you access to information, for in his heart, he dreams himself your master.
  23. Re:I can't wait---not a Haiku by Provocateur · · Score: 3, Interesting

    go threw it?

    my mind explodes and i cringe

    the clip fast forwards

    --
    WARNING: Smartphones have side effects--most of them undocumented.
  24. Just a thought... by Anonymous Coward · · Score: 3, Funny

    Flipping through the channels is gonna get ugly.

  25. hands, people! by Nudo · · Score: 1

    I usually walk up to the TV and use my hands.

    --
    This is a signature. Bow to me.
  26. Only 8 subjects? by cavis · · Score: 1

    The 9th person in the test sneezed and the television exploded.

  27. i get it by hurfy · · Score: 1

    When i am bored it will speed up the tape so the professor sounds like the chipmunks ... this might actually have worked with my chemistry professor :)

    He always reminded me of the adults in a Peanuts video anyways.....

  28. Re:I can't wait---not a Haiku by Anonymous Coward · · Score: 0

    go threw it?

    my mind explodes and i cringe

    Huked on Foniks pwns u!
  29. So if by jalet · · Score: 1

    if I put my finger in my nose, does it understand that I want to watch some porn ?

    --
    Votez ecolo : Chiez dans l'urne !
  30. To quote Douglas Adams by Joce640k · · Score: 1

    "...this meant you had to sit infuriatingly still if you wanted to avoid constantly changing the channel"

    --
    No sig today...
  31. What a waste! by EmbeddedJanitor · · Score: 2, Interesting
    Facial recognition needs quite a bit of complex processing and very competent researchers. It is a pity that they're putting it into such a impractical application.

    Hand gesture recognition makes a lot more sense.

    --
    Engineering is the art of compromise.
    1. Re:What a waste! by kcbrown · · Score: 1

      Hand gesture recognition makes a lot more sense.

      At least it's obvious what hand gesture to associate with the "skip this ad" function...

      --
      Use 'slashdot stuff' in the subject line in any email you send me if you want to get past the spam filter.
  32. Re:Use your 'O' face by Anonymous Coward · · Score: 0

    Ive presented complex materials where the Alpha person(ppl) in the room (male or female) will just make a face like you are insulting their mother - looking like they hate you and every word you say. But they are actually very intelligent individuals and pick up the material faster then others - they are just pissed off pricks or cunts and wear that expression all day long. Its the "born pissed off" look. Or the permanent "looks like something smells bad" people.

    Then again, there are people who just look stupid all day long too. And what about detecting an "O face" (Officespace ref). Will the robot caress your afterwards or just get up and go to work/home.

  33. Oh great... by penguin_dance · · Score: 1

    So not only will we be watching more TV, but we'll develop an uncontrollable twitch....

    --
    If you've never been modded as "flamebait" or "troll," you've never tried to argue a minority viewpoint here!
  34. Anonymous by Anonymous Coward · · Score: 0

    Wouldn't it be much easier to use your fingers to push the TV set buttons than your face?

  35. I wanted to RTFA by Amisinthe · · Score: 1

    But copious use of the word "facial" caused the site to be blocked.

  36. Sounds good but what if...? by tristian_was_here · · Score: 1

    What if your annoying identical twin comes round and decided to rewind or fast-forward the movie your watching?

  37. I need a life by ibmjones · · Score: 1

    I read the last sentence as "Use The Force."

  38. This will be problematic by Anonymous Coward · · Score: 0

    I'm pretty sure that the facial expression from watching porn will be the one which rapidly raises the volume up.

  39. Old news by EdIII · · Score: 1

    I've lost the remote plenty of times. I told my room mate that if did not change the channel that I was going to use his face to do it.

    It worked remarkably well.

  40. Re: After Microsoft has had a go.. by andersa · · Score: 1

    You look like you are trying to fast forward. Would you like help?

  41. Stupid by Snaller · · Score: 1

    I don't want a vcr that i am supposed to make faces at! I want to be able to give it the finger and have it know what i mean - that would be nifty.

    --
    If Google really cared they would fix Android Chrome to reflow text, instead of discriminating
  42. I hate that film by Anonymous Coward · · Score: 0

    Seriously, I stopped watching after 20mins of monkeys fucking around with stones. That was too much.

  43. Has cancer been cured? by Hackerlish · · Score: 0, Troll

    > "A researcher has discovered a way to use facial expressions to speed and slow video playback. It must have, since academics have time to explore the new depths of laziness.

  44. Didn't work by RealGrouchy · · Score: 1

    I tried using a similar input device on my computer, but whenever I showed it my face, the computer would crash.

    - RG>

    --
    Hey pal, this isn't a pleasantforest, so don't waste my time with pleasantries!
  45. Re:** Critical PSA ** by Anonymous Coward · · Score: 0

    What is it, anyway? I ain't googling it.

  46. You have clearly never been in support by patio11 · · Score: 1

    Support: "Now, double blink with your left eye"
    User: "Your left, or my left?"

    (I'm also allowing for the possibility that the user knows the word "eye", which is dubious at best. Because, you see, whereas many people would say "those two round vision organs on your head are your eyes", this particular user has called those his "orbs" for the last 40 years whippersnapper, and the rest of the world should conform to his nomenclature.)

  47. Recognition camera? by Anonymous Coward · · Score: 0

    remember when Comcast or some cable company wanted to put cameras in their cable boxes (supposedly to see how many people watch cause 1 tv could mean more than 1 viewer blahblah)

    what a great new thing to use to implement that! now you can be spied on 24/7 while making stupid faces!