Slashdot Mirror


"Interface-Free" Touch Screen at TED

Down8 writes, "Jeff Han, an NYU researcher, has recently shown off his 'interface free' touch screen technology at the TEDTalks in Monterey. Some sweet innovation that I hope makes it to the mainstream soon." The photo manipulation interface is reminiscent of "Minority Report."

24 of 194 comments (clear)

  1. Interface-free? by WilliamSChips · · Score: 5, Insightful

    How do you not have an interface?

    --
    Please, for the good of Humanity, vote Obama.
    1. Re:Interface-free? by kfg · · Score: 2, Funny

      How do you not have an interface?

      If it's useless; although you can still load it up with chrome and tailfins if you'd like.

      KFG

    2. Re:Interface-free? by solitas · · Score: 2, Funny

      He doesn't have an interface because he says he doesn't have an interface. That makes all the difference in his world.

      --
      "It's time to take life by the cans." ~ Bender ("Bendin' in the Wind", ep. 3-13)
    3. Re:Interface-free? by fsterman · · Score: 2, Interesting

      Exactly, you can't have an interface free interface, we are interfacing with the world. Want some really mind blowing interface design work check out Jeff Raskin's The Humane Interface Go back to the fundamentals of how humans interact with the world, find where we retain the most information, are the fastest to react, what gives us higher error rates, etc and redisign computer interfaces. Imagine an OS without applications or files. That's what he outlines. This is just another input device.

      Even if you are not designing an OS, any programmer, designer, or engineer (computer related or not), can gain a lot from this book.

      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
    4. Re:Interface-free? by Atlantis-Rising · · Score: 4, Insightful

      I took a gander at that book, and right away as I skimmed the amazon page, I noticed problems. He may be a wonderful cognitive psychologist, but he's no technocrat.

      The whole "Why shouldn't my computer take three nanoseconds to turn on, read my mind, and then never ever have errors!!!?!?one1" thing is a very amateur approach to the problem, if you ask me. Sure, it would be nice, but I'm absolutely sure it's technically impossible.

      To be more specific:
      "There has never been any technical reason for a computer to take more than a few seconds to begin operation when it is turned on."
      I can name half a dozen; power consumption for suspend to RAM, system process cleanup for suspend to disk, disk space storage for suspend to disk, driver software that doesn't gracefully handle failing down to a hibernate state, plug-and-play hardware detection on bootup... not to mention the whole raft of problems that occur when users never shut down and clog their system up by never ending processes.

      The problem with the view he espouses is that it practically requires a suspend-state, when users aren't good with suspend states. It wasn't until Windows XP and the relatively modern (last three or four years) (okay don't flame me I'm sure SOMEWHERE there was a build that had really optimal suspend, but I couldn't find it) linux systems that suspend really started working, and even so, your device drivers really depend on when you can suspend the system and how it restores.

      For example, when I tested Vista on my laptop, the base sound driver would for some reason kill the audio after restore from suspend. It just wouldn't make any noise until it rebooted. When I upgraded the driver, it went away.

      It is, in fact, only recently that we have had flashmem and the concept of keeping your 'bootfiles' on a seperate flash partition to read from for a quick boot has been a realistic and close to mainstream idea for the desktop.

      The same thing comes up here.
      "Why should you have to double-click anything? What does Ctrl+D mean one thing in one program and a completely different thing in another? And what's the point of the Yes/No confirmation if the user is in the habit of clicking Yes without thinking about it?"
      All of those things make sense in the context they are being used in, and they're relatively intuitive. After all, it's not the programmers fault the user is an idiot, especially with something as simple as a yes/no dialog box, as long as the dialog box is written in language comprehensible for the designed userbase.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    5. Re:Interface-free? by ebassi · · Score: 2, Informative

      GNOME did invert some years ago the order of the buttons on right-to-left languages, following the example of the Apple UI, and uses verbs instead of the infamous YNC combo; so, no: "linux" does not do like windows.

      and just to be overly zealous: windows vista added message boxes with verbs+descriptions, so neither does newer releases of windows do like the old times (finally).

      --
      You can save space. Or you can save time. Don't ever count on saving both at once. -- First Law of Algorithmic Analisys
  2. This is a very interesting set up by skogs · · Score: 2, Interesting

    This is an exciting setup...and I agree with his assertion that the OLPC (one laptop per child) is sort of like introducing millions of children to our inane weaknesses instead of our strengths. Really, I know that something like this wouldn't completely remove the need for a keyboard and such for many years, but it is a striking evolutionary step forward.

    Just think how easy all those dramatic situations would have been in the 24th century if the Starship enterprise had some of these!

    --
    Who is this that even the wind and the waves obey Him? Surely this computer must submit also!
    1. Re:This is a very interesting set up by jpardey · · Score: 4, Insightful

      Oh no! Children may use conventional tools, rather than futuristic things that are not in production yet, and probably won't be for 10+ years! When will we ever learn?

      --
      I have freaks! I did something right...
  3. Hand me a doughnut while I work on this would ya? by Anonymous Coward · · Score: 3, Insightful

    Hand me a doughnut while I work on this would ya? Everyone take a moment and look BETWEEN the keys on your keyboard. Now put that all on your monitor.

  4. Old story, and no such thing as 'no interface' by streak · · Score: 3, Insightful

    Ok, everyone realizes this was recorded in February right?
    Last I checked its the end of October.
    Jeff Han has been covered I don't know how many times on how many sites (probably on Slashdot too - haven't checked the archives yet).

    There's no such thing as no interface btw.
    Yes, you can remove a lot of the mode-switching with different gestures, but there is always going to be some sort of interface to allow you to access other functions.
    In my mind, once you get above about 4 or 5 gestures, things start to become confusing for people again - what was that gesture again? Thus defeating the purpose of no interface.

    1. Re:Old story, and no such thing as 'no interface' by Tremor+(APi) · · Score: 2, Informative
      --
      [Z?]
    2. Re:Old story, and no such thing as 'no interface' by catwh0re · · Score: 2, Informative
      I've seen various incarnations of this video all through the year. In particular it's often referenced when speaking about Apple computer's gestural patent applications which detail very similar techniques as shown in this video.

      In particular we can see the zooming (into maps, etc) gestures in the patent imagery. http://hrmpf.com/wordpress/48/new-apple-patents/ Although these ideas are not too-new, the related apple patents date as far back as Jan 2005 (through to Oct 06)

  5. Oh for fucks sake by glwtta · · Score: 3, Insightful

    Sure, it's neat - giant touchscreen with multiple points of contact and gestures that zoom and pan.

    And this is what's going to "change the way we interact with computers"? Odd as it may sound, most application interfaces don't revolve around zooming and panning; there are considerably harder problems left to solve.

    Funny he should mention RSI too, because that keyboard that will free you from the bonds of conformity, and that's displayed on a hard surface, will kill your wrists in a matter of months.

    The thing is great for the Earth-type applications, but that's about it. It's cool technology - why must every innovation promise to change all future computer interactions?

    (btw, if that picture viewer's "Pile of Crap" metaphor is where UI design is headed, I'm never upgrading again. I have my desk to act as a pile of crap, it won't make me feel more comfortable with my computer if it emulates that)

    --
    sic transit gloria mundi
  6. Re:Hand me a doughnut... by Terminal+Saint · · Score: 2, Insightful

    Everybody clean between your keys. Now clean your monitor.

    --
    It's sad when choosing an installation directory on your own qualifies you as an "advanced user."
  7. Minority report??? by www.sorehands.com · · Score: 3, Insightful

    This is not from the Minority Report that was released in 2002. This was shown in shuttle interface in Earth the Final Conflict which aired in 1997.

    This type of interface was also in The first $20 millions is the hardest. But that came out in the same year as The Minority report.

  8. The Pentagon already bought this,,, by prof_peabody · · Score: 2, Interesting

    I recently attended a demo of a similar device at my company. The pentagon already has purchased units and the company is trying to branch out to private sector applications. They were using for collaboration with geographical software (gis data).

  9. Re:Few comments: by oGMo · · Score: 2, Interesting
    I'm not sure about this. In the photo library application demo, he brought up a keyboard with his hands, typed out a label for a photo, and put it away, in fewer than 10 seconds.

    Right, but again, this was a demo application that was designed to look neat and take advantage of the multitouch screen... not be useful. How much time a day do you spend rearranging your photos on a lightboard? While it looked cool, it didn't do much. You couldn't sort, there was no categorization, no album interface, no way to post them, no real photo manipulation, or basically anything that would be useful for anything beyond browsing pr0n. (Any bets on whether this was their very first app?)

    It seems pretty widely adaptable and convenient, especially if we can make the transition from physical keyboard and mouse to "virtual" keyboard and our hands, respsectively.

    What I'm saying is that while this is neat for quick applications that don't require much text, it would be painful for multi-hour coding or authoring. And this is what most people do. For this kind of use, there is one absolute requirement: you don't need to look at it. And if you're not looking at it, you don't need an LCD powering it. (Any sort of predictive or dynamic keyboard violates this rule and makes typing require too much thought.)

    The mouse was supposed to be away of extending our native manual precision and dexterity into our computer programs - now that this screen is here, the mouse is pretty mcuh obsolete, and we can bridge the hand-computer gap in a seemingly more natural, more direct way.

    Yes, touchscreen interfaces are very neat. But they're not the answer to the world's problems. They won't magically make you be able to produce art where the mouse or tablet or whatever was getting in the way before. It may streamline things a bit, but it doesn't remove the need for skill.

    Not only that, but the virtual keyboard frees us from the physical constraints and space requirements imposed by having an actual physical keyboard.

    Again, only in very limited situations. Plus, onscreen keyboard means losing screen space, which is arguably far more valuable than desk space.

    --

    Don't think of it as a flame---it's more like an argument that does 3d6 fire damage

  10. Re:RTFA by corychristison · · Score: 2, Interesting
    No matter how interesting, I'll NEVER bear an ad before a small online video.
    I think I can help you. Well, in most situations, anyway... hehe.

    On topic: I feel this technology really could grow... I would like to see it more like the Nintendo DS. With Dual screens. One being your main form of input. Perhaps by having an overlay application of a scalable keyboard similar to the one featured in the video. And you can use the primary display for, well, display. I dunno. It's late and I'm tired... if you understand what I mean, mod me up! ;-)
  11. Neat demo. Needs Mandelbrot. by Alsee · · Score: 2, Interesting

    As he was manipulating the map application it really jumped out at me how cool it would be to run a Mandelbrot set app that way. It would have made a fun and awesome addition to the presentation. If I were working in his lab that would almost certainly be the first thing I would add to the system.

    -

    --
    - - You can't take something off the Internet! That's like trying to take pee out of a swimming pool.
  12. The GUI by mqduck · · Score: 2, Insightful

    Very neat and completely useless. I don't know about you guys, but I find it much easier to find my data in my nice hierarchical filesystem than by digging through a garbage can fan full of papers, which is what this GUI simulates.

    --
    Property is theft.
  13. Re:Windows only thanks to Flash requirement by daeg · · Score: 3, Insightful

    What were they supposed to do, write a transcript so you could read it with Lynx? Or maybe offer the entire video is an animated GIF?

    Not everything can be fully accessible to everyone.

    I'd wager that having it as Flash video makes it more accessible to more people than say, embedding it with other proprietary video software like Windows Media Player or Real Player, or even offering the file for direct download using some codec that you assume everyone has (not everyone can offer 10 different encoded videos so you can watch it on fringe systems). Flash video is, fortunately or unfortunately, the lowest common denominator across the widest variety of systems at this point.

  14. Interfaces are natural by tygt · · Score: 4, Interesting
    I realize that the point of this (TFA) is about trying to make things more intuitive and natural. But, as others have pointed out in other words, interfaces are a natural aspect of life.

    I have an interface in front of me right now. I have pen, paper; I've got a camera... if I want to record a visual of something, I have to pick up my camera. Never mind that the camera has one of these "non-intuitive interfaces" that we (rather, the article) are trying to remove, I still have to do something to get it done. Anything that I do interfaces with reality.

    One of the goals of the iconic desktop originally was to duplicate the real desktop in some fashion to make things simpler for humans to interact with their work on a computer, so that there wouldn't be too much of a translation layer to build between real and virtual work. Similarly, some try to implement handwriting recognition to remove the interface of the keyboard from the writing process.... until they realize that geeks like us can't write for crap and can type ten times faster as well.

    Regardless, of course, there's got to be some way to tell the computer that you actually want to resize the strange hand-like object on that screen the guy had (I think it was a hand, my sound was off and I lost interest rapidly) rather than add to the drawing. There's got to be some way to change modes, as he did between drawing the outline, getting it filled in, and then moving it around - that's all interface. Sure, it looked sweet that there wasn't any menu pull-down happening, no mouse, but really, you've got a pretty damn simple application that can be manipulated in this fashion.

    Do anything complex, and you'll have to have a more complex interface suddenly.

    "Computer... Computer... (McCoy hands Scotty the mouse) Aye. Hello computer." -- Scotty

    Even talking to a computer would be an interface..... a pretty complex one, though definitely one that could be considered intuitive, if you could use your chosen language for commanding it rather than some cryptic "ok, list the files, sort by date then name.... uh.... ok that one no that shit fucking computer where's my mouse"

  15. Keyboard by WhatsAProGingrass · · Score: 2, Interesting

    His keyboard Idea sounds pretty cool. I would like to see some more practical applications than what he showed. Games would be cool with this interface. I think the idea is great, moving objects on your screen as if they were actually on your desk. But gestures will still need to be learned. Also, we would all get neck problems from staring down all the time at the screen rather than looking straight ahead. All in all, this technology seems very interesting.

    --
    Mark