Slashdot Mirror

← Back to Stories (view on slashdot.org)

Ideas For the Next Generation In Human-Computer Interfaces

Posted by timothy on from the literally-exploding dept.

Singularity Hub writes "For decades our options for interacting with the digital world have been limited to keyboards, mice, and joysticks. Now with a new generation of exciting new interfaces in the pipeline our interaction with the digital world will be forever changed. Singularity Hub looks at some amazing demonstrations, mostly videos, that showcase new ways of interacting with the digital world." Along similar lines, reader shakuni points out a facial expression-driven user interface reported on News.com for operating, say, an iPhone, explaining "This device is tiny and fits into the ear and measures movements inside the ear due to changes in facial expression and then uses that as input triggers. So [tongue out] starts or stops your iPod Touch; [Wink] rewinds to the last song; and [smile] replays the same song."

32 of 170 comments (clear)

  1. Ah-Choo! by Something+Witty+Here · · Score: 4, Funny

    And when you sneeze, it reboots!

    1. Re:Ah-Choo! by tverbeek · · Score: 3, Insightful

      This facial expression control system sounds like a great way to make speech recocognition seem unambiguous and reliable by comparison.

      --
      http://alternatives.rzero.com/
    2. Re:Ah-Choo! by ChangelingJane · · Score: 5, Insightful

      For ordinary everyday users, this is very impractical and even silly. But for quadriplegics, it could be something else entirely.

    3. Re:Ah-Choo! by fractoid · · Score: 2, Funny

      Yeah, every time that cute girl from Accounting walks by and you give her a smile, you skip back to the start of the song you're listening to? That'll get old quickly.

      --
      Rampant carbon sequestration destroyed the Dinosaurs' tropical paradise. I'm here to help repair the damage.
    4. Re:Ah-Choo! by H3g3m0n · · Score: 2, Funny

      Too bad shes only smiling to turn the volume up :(

      --
      cat /dev/urandom > .sig
  2. voice control by Keruo · · Score: 5, Insightful

    When windows 95 arrived, I played around with its voice recognition.
    I wasnt quite impressed with it, since the only command I got working properly was "fuck" which caused the machine to reboot.

    Although voice control has interesting potential, its not optimal for most situations. (think open cubicle office)

    --
    There are no atheists when recovering from tape backup.
    1. Re:voice control by Superdarion · · Score: 3, Insightful

      Well yeah, but think about it: your brain can differentiante between your boss calling you a useless waste of oxygen from inside his office and the giggles from your coworkers on the outside.

      The aim for technology is, of course, that a microphone can do the same.

      And it makes sense that Windows would understand "Fuck", being the word that it hears the most.

    2. Re:voice control by jeffehobbs · · Score: 2, Funny

      Back when Mac OS 9 had kind-of-sort-of voice control, you could launch programs by putting them in a specific folder. I made an alias for "Unreal" -- which took up 190 MB of RAM and took about 3 minutes to load on my PM 7500. Whenever someone would come over my dorm room to use my computer, I made a point of mentioning very loudly how something was "UNREAL!" -- and then they got to sit there while 'Unreal' loaded, very, very slowly.

    3. Re:voice control by Hatta · · Score: 4, Funny

      I wasnt quite impressed with it, since the only command I got working properly was "fuck" which caused the machine to reboot.

      Are you sure you have the causation straight on that one? When I used Windows 95, it was the other way around.

      --
      Give me Classic Slashdot or give me death!
    4. Re:voice control by MBGMorden · · Score: 3, Insightful

      I don't think that's the only hurdle to overcome. In a lot of cases, I just don't think voice control is very useful beyond a novelty. I played with it a number of years ago. After a bit of training, it was recognizing my commands pretty well. Thing is, it was tedious as hell to do things with voice control. I spent 10x longer doing things simply for the novelty to doing it using voice commands.

      Seriously: for people who have ever done tech support this should be obvious: even with a human - whose reasoning skills are superior to the best voice recognition system out there, if I am standing there telling them what to do in order to perform an action on the computer, it takes all of 1 minutes before I'm asking them "You know, how about let me sit there for a second and I'll take care of it." (a nicer version of the "MOVE!" part from Jimmy Fallon's Nick Burns - The Company Computer Guy skit from SNL). Most of us can simply do things much faster with our hands than we can explain them.

      Now, if we could truly step into the realm of Star Trek and have virtual AI running the computer - then it might have some application (ie, "Computer - pull up a list of hotels in Miami on Labor Day weekend"). Otherwise, simply as a replacement input device, no matter how good it gets at recognizing commands I just don't see the use.

      --
      "People who think they know everything are very annoying to those of us who do."-Mark Twain
    5. Re:voice control by ShieldW0lf · · Score: 4, Interesting

      I don't think that's the only hurdle to overcome. In a lot of cases, I just don't think voice control is very useful beyond a novelty. I played with it a number of years ago. After a bit of training, it was recognizing my commands pretty well. Thing is, it was tedious as hell to do things with voice control. I spent 10x longer doing things simply for the novelty to doing it using voice commands.

      I feel the same way about it. But my brother swears by it... he can have his hands full of scientific equipment and still issue commands to his computer which is interfacing with the tools he's using.

      I could see this sort of tech being really useful for those who wish to access reference materials while their hands are full too... be it doctors who have their hands covered in blood switching to a different monitor or mechanics who have their hands covered in grease switching to a different schematic.

      Personally, some days I'd give my left nut for a good heads up display and a glove with an integrated chording keyboard and touch pad. If I could do my work lying on my back instead of sitting in this chair, I probably wouldn't have to go to the chiropractor.

      --
      -1 Uncomfortable Truth
    6. Re:voice control by Arancaytar · · Score: 2, Funny

      which caused the machine to reboot.

      But with Windows 95, what didn't? ;)

      I think I could have duplicated that effect without even a microphone. (Though whether the "fuck" would be the cause or effect of the reboot is another matter.)

    7. Re:voice control by high_rolla · · Score: 2, Insightful

      Voice control has some potential but I think it is one of those technologies that should be a complement to existing input mechanisms (ie keyboard and mouse).

      eg. When doing my normal work I want to use keyboard and mouse as it is more efficient and flexible. Then the phone rings, I pick it up and shortly into the conversation I realise that this is going to be a longer conversation. At which point I just say "computer, save document" rather than having to go back to the keyboard and mouse to do so.

      --
      Ryans Tutorials - A collection of technology tutorials.
    8. Re:voice control by evilad · · Score: 3, Interesting

      Try a stand-up workstation. I improvised one out of some metro shelving and it did wonders for my back.

      For extra points and core-strength exercises, stand on a balance cushion while using it.

  3. Missing options by Bovius · · Score: 5, Funny

    Seems like there are some other practical interface options for the iPod.

    * Snoring: stop playing music
    * Gagging: remove song from playlist
    * Startled jump, clenched jaw and frantic grasping at earbuds: reduce volume

  4. Facial-expression driven interface? by Tokerat · · Score: 4, Insightful

    I can see useful applications for this, but I hope there is a switch I have to depress while I make the gesture, plus a "hold" switch so I can lock gestures on or off at all times. For example, if I catch my wife cheating and I look stunned, I don't want that to accidentally to push the "panic" button on my car alarm so my nosy neighbor starts poking around during the ensuing drama. That would certainly be a small and silly example of this technology making life more difficult instead of better.

    ...not that I'd ever be able to get a wife (let alone a girlfriend), but at least I made a good car analogy ;-)

    --
    CAn'T CompreHend SARcaSm?
    1. Re:Facial-expression driven interface? by Anonymous Coward · · Score: 2, Insightful

      A facial expression driven interface is an absurd idea for the vast majority of users. People's hands are wired to move and manipulate objects. That is why our hands are so effective as "human output devices". Our facial expressions are tied to our emotions. Even if we can get around the weirdness of detaching smiles from happiness and winks from flirtation and so on, there's still the problem that doing that kind of stuff physically feels awkward if it has no emotional content behind it.

  5. Facial Expressions? by PPH · · Score: 5, Insightful

    I still think that people using BlueTooth headsets look like they're off their meds, walking down the street, talking to themselves. This'll open up whole new Vistas of crazy-looking people. Is he having a seizure or just skipping through his iPod's playlist?

    --
    Have gnu, will travel.
    1. Re:Facial Expressions? by poopdeville · · Score: 2, Informative

      The people walking down the street talking via bluetooth seem odd to you because they prefer the conversation with a distant person to dealing with you. If your need for attention weren't so acute this wouldn't bother you at all.

      That is quite an assumption.

      Perhaps it is because you can't tell if they are talking or a person or to themselves unless you see the headset. You know, crazy people talk to themselves. And other people tend to stay away from them, since they are relatively unpredictable.

      --
      After all, I am strangely colored.
    2. Re:Facial Expressions? by kylemonger · · Score: 3, Interesting

      The people walking down the street talking via bluetooth seem odd to you because they prefer the conversation with a distant person to dealing with you. If your need for attention weren't so acute this wouldn't bother you at all.

      No, they look odd because they look like they are talking to themselves or an invisible friend. This "poke your tongue out" iPod interface would be even worse. Ever seen tardive dyskinesia? That's what people are going to look like trying to select the right playlist on their iPods.

    3. Re:Facial Expressions? by cp.tar · · Score: 2, Informative

      Recently I noticed just how much the Bluetooth headset has changed the way we perceive people.
      I rode a tram, and heard a girl near me giggle. She was looking outside, speaking softly, giggling from time to time. Naturally, I'd assumed she was talking to someone via Bluetooth.
      Boy, was I wrong. I don't know what was making her giggle, and who she was talking to, but there was no mobile phone or any of its possible accessories in sight.

      The mere fact her being crazy was not the first thing that crossed my mind shows how far we've gone so far; I'm not sure I'd like going any further in that direction.

      --
      Ignore this signature. By order.
  6. In the future by Joce640k · · Score: 4, Funny

    We'll all have to sit infuriatingly still if we want to listen to some music.

    --
    No sig today...
  7. For me it is really simple... by rAiNsT0rm · · Score: 3, Interesting

    Everyone is close but just missing the boat in my opinion. Touch is the way to go but NOT directly on the display screen. A second screen (similar to the dual screened OLPC concept, or a Nintendo DS) that can be customized by each app or else function as a standard pointer/multi-touch input. It has to be essentially a full-on touchscreen display with full color and solid refresh rate.

    This would spur all kinds of new interactions, games, and input.

    --
    http://teasphere.wordpress.com - A little spot of tea
    1. Re:For me it is really simple... by rAiNsT0rm · · Score: 2, Interesting

      Haptic feedback is actually what you are contending, and it is coming and very possible. I have seen one implementation that easily has as much travel as the current Macbook/Apple keyboards.

      Basically you can still have a regular keyboard but you would also have a Wacom like tablet that is a programmable screen for input as well, and on laptops there would be no keyboard or touchpad, just a second large screen field with proper haptic feedback.

      It will be a major paradigm shift, and there will be many (possibly yourself) who will resist it but the flexibility and new interfaces it would open up would be revolutionary. We shall see.

      --
      http://teasphere.wordpress.com - A little spot of tea
  8. Blue sky by YourExperiment · · Score: 3, Insightful

    While it's great that all this research into potential future interfaces is being done, a lot of them are terribly impractical. I just wish we could get the simple things right with our present day interfaces.

    How about a jog wheel / thumb wheel that actually allowed different speeds of movement (i.e. true analog) instead of being just a disguised rocker switch? How about a mouse wheel that didn't force me to move slowly through documents a line at a time, but instead had the same capability for fast and slow movement as the mouse sensor itself?

    These are things that would actually be useful now, and are simple to implement with current technology. Perhaps companies could get these right today, in addition to investing in all this blue sky research.

  9. Re:iPod Touch? by jabithew · · Score: 3, Funny

    It would also make listening to KISS and singing along as Gene pretty much impossible.

    Yes, but there are disadvantages to the technology too.

    --
    All intents and purposes. Not intensive purposes.
  10. "Decades"? Both of them? by Anonymous Coward · · Score: 4, Informative

    And no mention of graphics tablets, which have been available from retailers as long as the mouse. I admit these weren't too popular until the Wacom units were combined with Photoshop in the 90s, but people did buy and try the Koala pads. MIDI has been a significant input device group too. Touchpads are also left out. Stylus interfaces like Newton and Palm... geeze, the list goes on.

    Singularity Hub doesn't sound like much of an authority. Thanks for the heads-up Timothy, but a self-submitted shallow adver-blog like that is what makes for accusations of slashvertisement. Better to have specific interface news posts run on, well, Slashdot.

    (No mention of the Powerglove? I mean where's the love?)

  11. Steam Punk Interface by stoicio · · Score: 4, Funny

    I prefer tried and true ergonomic interfaces. For this reason I suggest
    levers and foot pedals. All lever interfaces should have a grip lock
    to keep them from moving by themselves.

    There should also be two large dials to allow for precision X/Y
    axis movement of the cursor.

    Random numbers should be generated with a large wheel that has a rubber
    stop and pins. Simply spin the big wheel for a random number.

    There should be cranks on the side and top of the monitor to allow
    the view to be scrolled.

    1. Re:Steam Punk Interface by maxume · · Score: 2, Interesting

      Knobs and things:

      http://www.youtube.com/watch?v=yMeSw00n3Ac

      --
      Nerd rage is the funniest rage.
  12. Comment removed by account_deleted · · Score: 2, Insightful

    Comment removed based on user account deletion

  13. Why Go Backwards? by gilgongo · · Score: 3, Interesting

    Disclaimer: I am a UI designer, and it's been the way I've earned my living for the past eight years.

    All the "revolutionary" UIs that we've seen like Siftables and perceptive pixels appear to make a major assumption that I don't accept: that dispensing with the virtualisation of data and our interaction with it is automatically good.

    Bringing data and its manipulation "into our world" (as the Siftables guy puts it) seems to me to be a completely retrograde step. One of the reasons why we have computers in the first place is because our world and our physiology is in fact VERY BAD at manipulating large numbers of objects, or pouring paint from one place to another to create the right colour. Keyboards and mice, command lines and pipes, even folders and sub-folders (maybe), are several orders of magnitude better and more flexible at controlling the entropy that we need to control in order to get stuff done. We spent the last 10,000 years working that out - why the hell are we trying to re-discover our inefficiencies?

    I suspect the reason for this is because designing improvements to current UI is in fact very, very hard indeed. Of course, there is another reason: self-promotion by academics hoping to be given jobs heading up large corporate R&D departments for ten times their MIT salaries. But I'll let that pass.

    Basically, anyone who things humans have a future in significant problem-solving through the manipulation of real-world objects either doesn't understand the past, or is so used to the efficiencies that current human-computer UI models bring that they have ceased to understand them. The key to this understanding is an extreme abstraction of the real world, not its re-creation.

    --
    "And the meaning of words; when they cease to function; when will it start worrying you?"
  14. Sub-vocalized Input by SectoidRandom · · Score: 3, Informative

    If the voice recognition works without the voice...

    Some people have been working on this for a while: http://en.wikipedia.org/wiki/Subvocal_recognition

    A company (Ambient) also seems to be productising the technology and they even have some video demos online, although even from those you can see there is some way to go still. See: http://theaudeo.com/tech.html