Slashdot Mirror


Lost the Remote? Use Your Face

coondoggie writes "A researcher has discovered a way to use facial expressions to speed and slow video playback. By using a combination of facial expression recognition software and automated tutoring technology Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading the project that ultimately is part of a larger venture to use automated facial expression recognition to make robots more effective teachers. The researchers recently conducted a pilot test with 8 people that demonstrated information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time."

29 of 88 comments (clear)

  1. Use your face by kharri1073 · · Score: 4, Funny

    ... or just look between the couch cushions.

    1. Re:Use your face by eln · · Score: 5, Funny

      I don't know about you, but when looking for the remote I find my face, specifically the eye part of the face, to be an invaluable tool.

  2. Bah! by 0100010001010011 · · Score: 4, Funny

    I have Bell's Palsy you insensitive clod!

    1. Re:Bah! by chemisus · · Score: 3, Funny

      in soviet russia, tv watches you!

  3. Invalid Input by Anonymous Coward · · Score: 5, Funny

    So, whenever you were constipated, your movie would start rewinding?

  4. Obvious use by Anonymous Coward · · Score: 5, Funny

    The obvious use for this technology is, of course, pornography. When it detects a look of boredom it knows to fast-forward through the plot bits. When it detects a relaxed-but-slightly-guilty look, it knows to stop the video and clear your browsing history.

    1. Re:Obvious use by Mushdot · · Score: 2, Funny

      It will also help to find the smattering of good bits in the Star Wars prequels:

      Use the face, Luke.

    2. Re:Obvious use by HitekHobo · · Score: 2, Interesting

      This kind of feedback could have astounding implications when you consider a 'porn tree' that viewers branch down based on their unconscious response to the stimulus before them.

      It might be just a small part of robotic teaching, but it could be industry changing for cyber-porn if someone actually developed the 'porn tree' and could get actors to play out a scene a couple of dozen ways with varying camera angles etc.

    3. Re:Obvious use by GroeFaZ · · Score: 2, Insightful

      Another use: when robots take over teaching (no matter the subject), whenever the robot teaching goes into a possibly pornographic direction, make an interested face, otherwise look bored. In due time, the robot should lecture about pr0n exclusively.

      --
      The grass is always greener on the other side of the light cone.
  5. What about by pedropolis · · Score: 2, Funny

    What about when it sees my O face. You know, Oh Oh Oh...

  6. I can't wait by merreborn · · Score: 5, Interesting

    Great. Then you'll know when the kids who grew up with this technology get bored -- they'll subconsciously start to make the "fast forward" facial expression.

    And when they mishear something, they'll make the "rewind" face.

    I can't wait. It'll be hilarious.

    1. Re:I can't wait by Vectronic · · Score: 4, Funny

      Agreed, just think about the brats, sitting in the corner, cycling through all the facial expressions trying to figure out why life isnt working.

    2. Re:I can't wait by jellomizer · · Score: 2, Insightful

      Well this could have unforeen consequenses. Say you have to watch a boring show or presentation. It is booring really boring but you have to go threw it as there is important information randomly spread out. If we start making expressions so automatically then we the kid will miss all the information.
      Or if there are 2 people watching the show and one guy is really dense and just doesn't get it the other guy will have to watch the show stop and start when he doesn't want it to.

      And Kids They will play the damn segment over and over and over and over and over again. This will just lead to child abuse.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  7. Excellent teachers... by Thelasko · · Score: 5, Insightful

    can do this. I've noticed bad college professors just keep plowing through the subject. The best ones will look at the students faces and say, "Lets back up a little," when they see blank stares from their pupils.

    I don't think the ability to determine how difficult a concept is to grasp is the breakthrough here. I think it's the fact that a machine can do it.

    --
    One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    1. Re:Excellent teachers... by street+struttin' · · Score: 2, Insightful

      I would assume that a blank stare would be the most common face made when viewing TV. Especially if it's something that starts with "America's..." or "Celebrity...".

  8. fingertips by COMON$ · · Score: 3, Insightful
    Ok I don't like the idea of changing with my facial expressions. We humans use soo many expressions when talking and even just watching video that any device recording them bound to get confused. What I am interested in is the gesture based technology. Proof of concepts like where they converted the wiimote to a sensor are neat. But I would pay good money for a universal remote where I could gesture with my hands to interact with my consoles. I feel like these are right around the corner. No looking for your remote, just gesture to change the channel or turn up the volume with a precursor motion. Every once in a while you see a company try to hit this market with different products like the playstation webcam thing but no one has hit it on the head yet.

    Has anyone heard of a company making good headway in this department?

    --
    CS: It is all sink or swim...oh and did I mention there are sharks in that water?
  9. Slippery slope by edwebdev · · Score: 2, Funny

    Next, they'll be teaching computers to read lips. Anyone who has seen 2001: A Space Odyssey knows that this is a bad idea.

  10. If it can recognize my "Stupid TiVo!" face - by RevWaldo · · Score: 2, Funny

    If it can recognize my "Stupid TiVo!" face when TiVo starts playing back one minute after (or before) I press the play button when rewinding (or fast-forwarding), well, we've got a winner here. Or at least recognize what I mean when I'm screaming "Not there! THERE! Ya piece of junk!"

  11. TFA by msaver · · Score: 2, Informative

    A researcher has discovered a way to use facial expressions to speed and slow video playback.

    By using a combination of facial expression recognition software and automated tutoring technology Jacob Whitehill, a computer science Ph.D. student from UC San Diego's Jacobs School of Engineering, is leading the project that ultimately is part of a larger venture to use automated facial expression recognition to make robots more effective teachers.

    The researchers recently conducted a pilot test with 8 people that demonstrated information within the facial expressions people make while watching recorded video lectures can be used to predict a person's preferred viewing speed of the video and how difficult a person perceives the lecture at each moment in time.

    "If I am a student dealing with a robot teacher and I am completely puzzled and yet the robot keeps presenting new material, that's not going to be very useful to me. If, instead, the robot stops and says, 'Oh, maybe you're confused,' and I say, 'Yes, thank you for stopping,' that's really good," said Whitehill in a release.

    Recent advances in the fields of pattern recognition, computer vision, and machine learning have made automatic facial expression recognition in real-time a viable resource for intelligent tutoring systems (ITS), researchers added. As facial expression recognition technology improves in accuracy, the range of its application will grow. One particular application we are currently developing is a \smart video player" which modulates the video speed in real-time based on the user's facial expression so that the rate of lesson presentation is optimal for the current user, researchers said.

    In the pilot study, researcher said the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology.

    One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, researchers could train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes.

    The goal of UC San Diego's Machine Perception Laboratory is to gain insights into how the brain works by developing systems that perceive and interact with humans in real time using natural communication channels. Researchers are also developing algorithms for robots that develop and learn to interact with people on their own. Applications include personal robots, perceptive tutoring systems, and system for clinical assessment, monitoring, and intervention.

    Interested in hypermiling?

  12. Apply face liberally by Captain+Spam · · Score: 4, Funny

    Oh, oh, facial recognition. That makes a lot more sense. When I read the headline, I first thought it was going to suggest that if you lose the remote, get up and bash the buttons on the DVD player with your forehead or something.

    A similar system applied to computer keyboards would certainly make IT and data entry more interesting professions...

    --
    Demanding constant attention will only lead to attention.
  13. Obligatory Hitchhikers... by camperdave · · Score: 4, Insightful

    For years radios had been operated by means of pressing buttons and turning dials; then as the technology became more sophisticated the controls were made touch-sensitive -- you merely had to brush the panels with your fingers; now all you had to do was wave your hand in the general direction of the components and hope. It saved a lot of muscular expenditure of course, but meant that you had to sit infuriatingly still if you wanted to keep listening to the same programme.
    --
    When our name is on the back of your car, we're behind you all the way!
  14. Re:Wonder if this can be applied to the web by Tubal-Cain · · Score: 2, Insightful

    For some reason the boss didn't like the rfid tags idea for boss tracking. Maybe you should use bluetooth as an early-detection system if the range in your workplace is satisfactory.
  15. The best interface by UnknowingFool · · Score: 4, Funny

    Until we develop a neural link, all other interfaces will be poor substitutes. Of course there are drawbacks like the possibility that it will become The Matrix. Even if it worked, it might work too well:

    [Average male watching TV]
    [Average Male thought]: Hey! Football is on.
    [Neural Link switches to football]
    [Average Male thought]: Damn, a commercial. What else is on?
    [Neural Link begins switching channels at a breathtaking rate. Epilleptics in room start convulsing]
    [Average Male thought]: Is the game back on?
    [Neural Link switches back to football]
    [Average Male thought]: Damn, another commercial. Hey that girl is hot!
    [Neural Link switches to Playboy channel and dims lights]
    [Male's Significant Other stares at him in disgust]

    --
    Well, there's spam egg sausage and spam, that's not got much spam in it.
  16. Interesting by iXiXi · · Score: 2, Funny

    So when you are nodding off late at night, what happens? Does the volume go up and down? That could create an infinite loop. I bet if my neighbor's wife looked at the TV it would change the channel to the Sci-fi network.

  17. Hmmm by ubrgeek · · Score: 4, Funny

    > The next Slashdot story will be ready soon, but subscribers can beat the rush and see it early!

    *look of boredom*
    Nope, didn't help ...

    --
    Bark less. Wag more.
  18. Help desk by Rik+Sweeney · · Score: 3, Funny

    Cool! We could apply this to computers and do away with the mouse...

    Typical day at the support desk:

    Support: "Hello, how can I help you?"
    User: "Hi, I can't see how to open an application"
    Support: "OK, you need to look at the application you want to open"
    User: "OK"
    Support: "Now, double blink with your left eye"
    User: "Hey! That did it!"
    Support: "Great, is there anything else I can help you with?"
    User: "Yeah, sometimes I'll be doing stuff and the popup menu will appear, it's quite annoying"
    Support: "Hmmm, perhaps you suffer from a nervous twitch"
    User: "Actually, I do have a problem in my right eye, that's probably it!"
    Support: "Thanks for calling, bye now."

  19. Re:I can't wait---not a Haiku by Provocateur · · Score: 3, Interesting

    go threw it?

    my mind explodes and i cringe

    the clip fast forwards

    --
    WARNING: Smartphones have side effects--most of them undocumented.
  20. Just a thought... by Anonymous Coward · · Score: 3, Funny

    Flipping through the channels is gonna get ugly.

  21. What a waste! by EmbeddedJanitor · · Score: 2, Interesting
    Facial recognition needs quite a bit of complex processing and very competent researchers. It is a pity that they're putting it into such a impractical application.

    Hand gesture recognition makes a lot more sense.

    --
    Engineering is the art of compromise.