Slashdot Mirror


"Interface-Free" Touch Screen at TED

Down8 writes, "Jeff Han, an NYU researcher, has recently shown off his 'interface free' touch screen technology at the TEDTalks in Monterey. Some sweet innovation that I hope makes it to the mainstream soon." The photo manipulation interface is reminiscent of "Minority Report."

194 comments

  1. Interface-free? by WilliamSChips · · Score: 5, Insightful

    How do you not have an interface?

    --
    Please, for the good of Humanity, vote Obama.
    1. Re:Interface-free? by jayratch · · Score: 1

      I guess it means you don't need to specifically design a touch interface- he's got software to automagically adapt to touch based?

    2. Re:Interface-free? by hords · · Score: 1

      Sure looked like there was an interface on the top of the Google Earth-like software. It is a very cool technology though.

    3. Re:Interface-free? by kfg · · Score: 2, Funny

      How do you not have an interface?

      If it's useless; although you can still load it up with chrome and tailfins if you'd like.

      KFG

    4. Re:Interface-free? by solitas · · Score: 2, Funny

      He doesn't have an interface because he says he doesn't have an interface. That makes all the difference in his world.

      --
      "It's time to take life by the cans." ~ Bender ("Bendin' in the Wind", ep. 3-13)
    5. Re:Interface-free? by fsterman · · Score: 2, Interesting

      Exactly, you can't have an interface free interface, we are interfacing with the world. Want some really mind blowing interface design work check out Jeff Raskin's The Humane Interface Go back to the fundamentals of how humans interact with the world, find where we retain the most information, are the fastest to react, what gives us higher error rates, etc and redisign computer interfaces. Imagine an OS without applications or files. That's what he outlines. This is just another input device.

      Even if you are not designing an OS, any programmer, designer, or engineer (computer related or not), can gain a lot from this book.

      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
    6. Re:Interface-free? by MobileTatsu-NJG · · Score: 1

      "How do you not have an interface?"

      Though I get your point, the implication is that it's gesture based instead of requiring on-screen input. It's a misappropriate use of the term, but the idea is effectively communicated.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    7. Re:Interface-free? by Atlantis-Rising · · Score: 4, Insightful

      I took a gander at that book, and right away as I skimmed the amazon page, I noticed problems. He may be a wonderful cognitive psychologist, but he's no technocrat.

      The whole "Why shouldn't my computer take three nanoseconds to turn on, read my mind, and then never ever have errors!!!?!?one1" thing is a very amateur approach to the problem, if you ask me. Sure, it would be nice, but I'm absolutely sure it's technically impossible.

      To be more specific:
      "There has never been any technical reason for a computer to take more than a few seconds to begin operation when it is turned on."
      I can name half a dozen; power consumption for suspend to RAM, system process cleanup for suspend to disk, disk space storage for suspend to disk, driver software that doesn't gracefully handle failing down to a hibernate state, plug-and-play hardware detection on bootup... not to mention the whole raft of problems that occur when users never shut down and clog their system up by never ending processes.

      The problem with the view he espouses is that it practically requires a suspend-state, when users aren't good with suspend states. It wasn't until Windows XP and the relatively modern (last three or four years) (okay don't flame me I'm sure SOMEWHERE there was a build that had really optimal suspend, but I couldn't find it) linux systems that suspend really started working, and even so, your device drivers really depend on when you can suspend the system and how it restores.

      For example, when I tested Vista on my laptop, the base sound driver would for some reason kill the audio after restore from suspend. It just wouldn't make any noise until it rebooted. When I upgraded the driver, it went away.

      It is, in fact, only recently that we have had flashmem and the concept of keeping your 'bootfiles' on a seperate flash partition to read from for a quick boot has been a realistic and close to mainstream idea for the desktop.

      The same thing comes up here.
      "Why should you have to double-click anything? What does Ctrl+D mean one thing in one program and a completely different thing in another? And what's the point of the Yes/No confirmation if the user is in the habit of clicking Yes without thinking about it?"
      All of those things make sense in the context they are being used in, and they're relatively intuitive. After all, it's not the programmers fault the user is an idiot, especially with something as simple as a yes/no dialog box, as long as the dialog box is written in language comprehensible for the designed userbase.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    8. Re:Interface-free? by Anonymous Coward · · Score: 0

      > How do you not have an interface?

      Oh, it has an interface. It's just "free as in beer" ;-)

    9. Re:Interface-free? by Schraegstrichpunkt · · Score: 1

      I think books like that are good for programmers, even if they're idealistic. These kinds of books tell us (programmers) what to aim for.

    10. Re:Interface-free? by MrNougat · · Score: 1
      "And what's the point of the Yes/No confirmation if the user is in the habit of clicking Yes without thinking about it?"


      It's CYA. If there was no yes/no dialog after something like "Do you really want to format your hard drive?" you can bet that the number of end users accidentally formatting their hard drive would skyrocket, and that there would be some attempt at a class action lawsuit against the developer of the (not free-as-in-beer) OS for malpractice or some such thing. If you have seen this dialog box eight million times before, you're likely to blast right through it, and that's fine, provided you are performing an operation that you are intimately familiar with. Otherwise, you're just being careless. That yes/no dialog puts the responsibility on you, the end user, and removes it (to some degree) from the developer of the system.
      --
      Web 2.0 == Giant Blogspam Circle Jerk
    11. Re:Interface-free? by Anonymous Coward · · Score: 0

      I've always been opposed to Yes|No as reponses. People do click "yes" without reading the text - personally I would prefer "Format Hard Drive" and "Cancel" to be the choices here.

    12. Re:Interface-free? by Stormwatch · · Score: 1
      I see your point... Windows and Linux do it like this:

      Save?
      [Yes] [No] [Cancel]

      But Macintosh already does it the way you suggest:

      Save?
      [Don't save] [Cancel] [Save]
    13. Re:Interface-free? by Anonymous Coward · · Score: 0

      Please, don't use Microsoft as any example of why something can or cannot be done.

      As far back as 1990, I had a Sperry Unysys Unix box that I could have someone pull the power-plug while I was editing in vi. When power was returned to the system, it would acknowledge there had been a power failure and then restore my state. I would lose at most 3 characters from the editor session.

    14. Re:Interface-free? by x2A · · Score: 1

      Did he keep pressing some button under the screen to switch from one demo piece to another? I guess with "no interface" you have no alt+tab...

      --
      The revolution will not be televised... but it will have a page on Wikipedia
    15. Re:Interface-free? by Fordiman · · Score: 1

      It should say 'transparent interface'.

      'cos, seriously... that was REALLY cool.

      --
      110100 1101000 1101000 1100110 0 1101111 1101000 1100011 1
    16. Re:Interface-free? by ebassi · · Score: 2, Informative

      GNOME did invert some years ago the order of the buttons on right-to-left languages, following the example of the Apple UI, and uses verbs instead of the infamous YNC combo; so, no: "linux" does not do like windows.

      and just to be overly zealous: windows vista added message boxes with verbs+descriptions, so neither does newer releases of windows do like the old times (finally).

      --
      You can save space. Or you can save time. Don't ever count on saving both at once. -- First Law of Algorithmic Analisys
    17. Re:Interface-free? by Atlantis-Rising · · Score: 1

      You're being pedantic. I said quite clearly that I'm sure, SOMEWHERE, there was a system that had good suspend for ages. But it wasn't mainstream then and it isn't even mainstream NOW, which is what the guy in the book is talking about.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    18. Re:Interface-free? by kabocox · · Score: 1

      The whole "Why shouldn't my computer take three nanoseconds to turn on, read my mind, and then never ever have errors!!!?!?one1" thing is a very amateur approach to the problem, if you ask me. Sure, it would be nice, but I'm absolutely sure it's technically impossible.

      I think that we could do or try for 1 - 10 second boot times, but it would involve "cheating." It would have to be a suspend state with something like a flash boot drive just so computer instant ons to it's previous state. You need to give the guy some slack. He isn't an IT person. He is a person that is telling the hardware folks how most people believe that IT devices should behave. The guy doesn't mean the same thing as we do when he refers to a fast boot time. IT folks think of all the little hardware and software things that an OS does and then the start up apps and services that are started before the system is usable. That's not what this guy means. He just means he wants to press power and get to the state the computer was in when he hit power before. I bet you he also wants an "instant off" rather than the hold power for 15 seconds for a power off. He doesn't know that what he really needs is an nicer faster loading suspend state, but that's what he needed.

      What's really, really bad, is for most users a full complete OS shutdown and boot up process needs to be part of the "safe mode" boot or how some users think of it as the techy boot.

      I'm not sure what you or he refer to as "read my mind." That's never worked with people trying it on other people, or IT folks assuming what their users will want to do. Remember Clippy? They thought that was a good idea and on the road for the computer to read your mind. Give us 200-300 years and we'll learn to fake it much better than we do now.

      It's the "never ever have errors" that really gets me. Its just in the IT mindset that "errors" are unavoidable and force your userbase to live with them rather than fix them. It seems every vendor that I've submitted bug reports to would rather ignore the problem than actually resolve them. This is actually the one area that I feel that IT could improve the most or atleast see the most immediate improvements on. The trouble is near perfect code isn't economical to write and test, currently. We need better compilers and also QA software. We need software to make it economical to properly test software before releasing it. Of course it varies on what you mean by "test" the software. I'm typically thinking of compile time errors and run time errors due to "weird" or unexpected input. This guy may be thinking of no business case logic errors. That's much, much more difficult to debug. We need to revise our attitude that thinks are impossible to they are merely difficult, but expensive.

    19. Re:Interface-free? by Doctor+Memory · · Score: 1
      I think that we could do or try for 1 - 10 second boot times, but it would involve "cheating." It would have to be a suspend state with something like a flash boot drive just so computer instant ons to it's previous state.

      I've wondered about this, specifically how to isolate "stale" state (things like network buffers that refer to sessions that are no longer active), and if it's possible to lazy-initialize/restart hardware. You could certainly bring the system back up using a memory snapshot, but you'll also have to restart the disk, and do you really want to do that with no consistency checks? In the end, it all seems to fall apart due to multiple interdependencies among all the pieces of the system. I'm sure it wouldn't be especially difficult to design a system to do this efficiently, but I doubt it'd be easy to retrofit onto any current system.
      --
      Just junk food for thought...
    20. Re:Interface-free? by fsterman · · Score: 0, Flamebait
      The whole "Why shouldn't my computer take three nanoseconds to turn on, read my mind, and then never ever have errors!!!?!?one1" thing is a very amateur approach to the problem, if you ask me. Sure, it would be nice, but I'm absolutely sure it's technically impossible.

      Thanks for the insight, Troll.

      Windows, cutting edge of OS design! Raskin did it in the 80's. You could check out orthogonal persistence OS's. Maybe none right _now_ can do it in a few nanoseconds, but most are using hacks on existing computer hardware. Look at what LinuxBIOS has been able to do. It's not just possible, it's been done.

      "Why should you have to double-click anything? What does Ctrl+D mean one thing in one program and a completely different thing in another? And what's the point of the Yes/No confirmation if the user is in the habit of clicking Yes without thinking about it?" All of those things make sense in the context they are being used in, and they're relatively intuitive. After all, it's not the programmers fault the user is an idiot, especially with something as simple as a yes/no dialog box, as long as the dialog box is written in language comprehensible for the designed userbase.

      I wouldn't bite this obvious troll bait if only some people didn't believe you. "Intuitive" is "Learned Behavior" NOT what humans are good at, or can do. They habituate, just like you habituate to gasing the car on a green light, or at least many of us do. But how many times have you caught yourself pressing the pedal for the wrong green light? Probably less than everyone reading this has clicked yes or no on a dialog box without reading it. If you had read the book you would have found answers to avoiding such dialog boxes, and how to make it so the user is forced to actually make a choice, they can't just habituate to hitting "yes."

      --
      Is there anything better than clicking through Microsoft ads on Slashdot?
    21. Re:Interface-free? by vertinox · · Score: 1

      The whole "Why shouldn't my computer take three nanoseconds to turn on, read my mind, and then never ever have errors!!!?!?one1" thing is a very amateur approach to the problem, if you ask me. Sure, it would be nice, but I'm absolutely sure it's technically impossible.

      Sometimes, you need people who know nothing of limitations of technology to design them. Of course you end up often re-inventing the wheel and wasting a lot of VC cash if done poorly... BUT!!!

      If done correctly and with the correct amount of "No! It can't be done... Well... Maybe we could do it like this instead." from the Engineers you might end up with a first of its kind innovative product.

      Otherwise... We'd still be using the same old stuff from the 1980s today.

      --
      "I am the king of the Romans, and am superior to rules of grammar!"
      -Sigismund, Holy Roman Emperor (1368-1437)
    22. Re:Interface-free? by Atlantis-Rising · · Score: 1

      With regard to the errors, I was not thinking of coding bugs. Coding bugs, while probably inevitable, should be minimized to every extent possible, I agree.

      But most 'bugs' are not coding bugs. They're user-error bugs. Spyware, for example, is not a coding bug, (most of the time)- it's a user bug. Remember that old programing adage, GIGO? Garbage In, Garbage Out?

      The reason why computers have such a bad reputation is because there's so much user-garbage going in that we can't help but have garbage coming out.

      There are IT problems, especially involving the bugfix mentality, as you mentioned. But the bigger problem that I bet accounts for more than 75% of 'errors' is the user.

      You can't make anything idiotproof- the universe can always come up with a better idiot.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    23. Re:Interface-free? by Atlantis-Rising · · Score: 1
      Thanks for the insight, Troll. Windows, cutting edge of OS design! Raskin did it in the 80's. You could check out orthogonal persistence OS's. Maybe none right _now_ can do it in a few nanoseconds, but most are using hacks on existing computer hardware. Look at what LinuxBIOS has been able to do. It's not just possible, it's been done.
      Wow, you focused on the one point I expanded on as recently becoming possible FOR THE MAINSTREAM and decried how possible it actually was. I even expanded on this- you're being pedantic. Yes, it has been possible for a while, but not reasonable for the average end-user.

      I wouldn't bite this obvious troll bait if only some people didn't believe you. "Intuitive" is "Learned Behavior" NOT what humans are good at, or can do. They habituate, just like you habituate to gasing the car on a green light, or at least many of us do. But how many times have you caught yourself pressing the pedal for the wrong green light? Probably less than everyone reading this has clicked yes or no on a dialog box without reading it. If you had read the book you would have found answers to avoiding such dialog boxes, and how to make it so the user is forced to actually make a choice, they can't just habituate to hitting "yes."
      Good point, and I specifically said "in the context they are being used in Just like pressing the gas pedal at a green light is intuitive in the context it's being used in.
      With regard to the yes/no dialog box, the user is always forced to make a choice. They'll ignore it anyway, if they're going to ignore it. What you put in the dialog box is irrelevant.
      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    24. Re:Interface-free? by ahg · · Score: 1

      "There has never been any technical reason for a computer to take more than a few seconds to begin operation when it is turned on."

      If I recall correctly, my Apple II turned on in about a second and had a command prompt where I could write such useful programs as:

      10 PRINT "HELLO WORLD"
      20 GOTO 10
      RUN

      :-)

      You couldn't save anything to disk or do more useful functions, but the computer started and had a usable shell. Today, you turn on a PC without a usable disk and you get some beeps... I think some people want something simpler that just works without all the fancy stuff our computers are capable of today. A true appliance.

      --

      --Aaron Greenberg

    25. Re:Interface-free? by maxume · · Score: 1

      That Skynet went rogue in Terminator is a myth; in reality, it was talking to the President and popped up a dialog:

                      Kill All Humans?

                              Yes. No.

      And the President just clicked yes out of habit.

      --
      Nerd rage is the funniest rage.
    26. Re:Interface-free? by GauteL · · Score: 1

      "There has never been any technical reason for a computer to take more than a few seconds to begin operation when it is turned on."
      I can name half a dozen; power consumption for suspend to RAM, system process cleanup for suspend to disk, disk space storage for suspend to disk, driver software that doesn't gracefully handle failing down to a hibernate state, plug-and-play hardware detection on bootup... not to mention the whole raft of problems that occur when users never shut down and clog their system up by never ending processes."

      What I think Raskin means is that there aren't any VALID technical reasons. Bugs in the driver software is hardly valid technical reasons. They just get away with it because suspend isn't used as much as it should. Also, the hardware has been designed for the current boot system, but that doesn't mean it couldn't be redone.

      The major OSes and hardware manufacturers really ought to have solved this by now, but people seems to have accepted the whole boot procedure.

      "All of those things make sense in the context they are being used in, and they're relatively intuitive. After all, it's not the programmers fault the user is an idiot, especially with something as simple as a yes/no dialog box, as long as the dialog box is written in language comprehensible for the designed userbase."

      The users are not idiots, they just are acustomed to the system asking stupid questions so often they get used to just mindlessly clicking 'yes'. Many times people think they understand a dialog and click yes before they have fully read it. Removing yes/no in support of "delete file / save file" helps, but the problem lies deeper.

    27. Re:Interface-free? by Anonymous Coward · · Score: 0

      The idea of a good consumer OS has intrigued me for some time. I took a graduate level OS class a few years ago just for fun. I believe the reality of popular modern OSs stems from a decision many years ago by OS researchers (from shoddy memory I'm going to blame Per Brinch Hansen) that OSs could be allowed to crash. Prior to that decision the idea of an unrecoverable error was unfathomable. I believe that the reason that a good consumer OS does not exist is price. Would you be willing to spend $800 - $1000 for an OS that never crashed and was easy to use? There are OSs that do not crash, just took at medical equipment or space equipment like satellites. Making an OS easy to use is somewhat subject to opinion but probably only requires several studies with untrained users. I think the GUI concept developed at Xerox PARC was in cooperation with Stanford behavioral psychologists. Again I think speed is merely a matter of price. With expensive hardware, fast solid state long term storage coupled with multi-core processors could conceivably bring up a PC in under a second. My handheld PDA comes up "instantly"; certainly similar principals used in handheld OSs could be applied to desktop PCs.

    28. Re:Interface-free? by treeves · · Score: 1

      You did notice how 'interface-free' was in single quotation marks, didn't you? That's all you need to know.
      It's also why I'll never eat at a place that has a sign that says "Fresh" Seafood, or the like.

      --
      ...the future crusty old bastards are already drinking the Kool-Aid.
    29. Re:Interface-free? by permawired · · Score: 0

      Bummer... I was expecting it to just be a blank page....

    30. Re:Interface-free? by Anonymous Coward · · Score: 0

      I counted about 4 interfaces.

      World Wind had menus across the top, he had some funky keypresses to make a keyboard appear. The graphics applications he was using had control points being used.

      Somehow he was able to pull up a menu with a list of other demo applications to run.

      How do you print? How do I open my spreadsheet and type my source code?

      It's a neat User Input device but the guy is wrong. He just keeps repeating himself until others think it's true. As you said there is always interface.

      This is great for large complex data sets but for day to day work that needs to get done I think most of us would still be living in flat land with a tactile response keyboard. I touch type, I feel where the keys are. I don't want to go looking around to find the keyboard or hope that the keyboard guesses what I'm going to type next. That never works in programming languages.

      Still a neat device, but not the be all end all he's suggesting.

    31. Re:Interface-free? by Atlantis-Rising · · Score: 1
      I can't say I agree with you With regard to the suspend state. There are simply too many things that can go wrong when not failing gracefully during suspend, especially with the network and external devices. It's possible, but it's currently not practical.

      ---
      That said...
      Yes, users are idiots. Obviously you have never worked in any sort of technical support. Why do you think users get spyware? Because they are stupid. It doesn't matter what the dialog says. It doesn't matter whether the dialog is useful (as it often is- for example, if you force shutdown of a Windows box with many windows open, a dialog box will probably pop up for each one of them, asking if you want to close it and what you want to do with all the work. You can't just not have that dialog box and scrap the work, or not have that dialog box and save it somewhere the user can't get at it... or.. you get the idea.)
      The problem is users think that their computers should be simple. They treat the computer as if it's a car, which has exactly three critical buttons and a wheel. They don't understand that everything done on a computer is 'critical' in one way or another- if it wasn't critical, you wouldn't have seen it. Computers are complex objects, and therefore the fact that you're NOT deluged with messages about what the system is doing all the time means it's doing them by itself and not bothering you. But there's a lot that can go wrong, and that means a lot of confirmation dialogs.
      It's not the programmers fault if the user does not understand what they're doing. It's the user's fault.

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    32. Re:Interface-free? by Iron+Condor · · Score: 1

      With regard to the yes/no dialog box, the user is always forced to make a choice. They'll ignore it anyway, if they're going to ignore it

      Well, ignore this:

      Not deleting all files? [OK][No]

      or this:

      Cancel current operation? [Yes][Cancel]

      or this:

      Stop HD format? [Retry][Format]

      Using a computer should be dangerous. You should be sweating in anguish every time a box pops up. You should dread ever clicking the wrong thing. We'll see how much you're going to habituate on clicking "yes" then...

      --
      We're all born with nothing.
      If you die in debt, you're ahead.
    33. Re:Interface-free? by Dabido · · Score: 1

      At the beginning of the pice, he does refer to it as an interface. During the piece, he claims the interface disappears, and later on he says 'once again there is no interface', even though he's using what looks like an interface at the top of Google Maps.

      So, he sort fo contradicts himself during the talk, but I'd say he means there isn't the usual sort of interface whcih needs to be learned to be used.

      It's more an intuitive interface. Even then, I'd assume you'd need to learn something in order to figure out how to get from one application to another.

      Still, it's very impressive, even if the term 'no interface' is technically incorrect.

      --
      Sure enough, the cow costume was hanging up next to the superhero outfit and sailors uniform. (S,Spud)
    34. Re:Interface-free? by hspallek · · Score: 1

      "users are idiots" I think this is a very arrogant statement. Being an enduser of many software products as well as a developer dealing with endusers, I more often utter the opposite "developers are idiots." Your car analogy is flawed because when the first cars came up, owners probably said exactly the same about cars "users think that their cars should be simple" and "Cars are complex objects." However, mainstream manufacturing has shown that operating a car can be simplified. Blaming the user is easy and takes away from the burden which you as developer have. I just participated in a heuristic evaluation of verious software packages for practice management and it turned out that many of the long-time known usability guidelines were violated. I would submit that this applies to many software packages beyond the scope of our study. Clearly the developers' fault. Today's software seems to be designed by engineers who are not designers. The design is driven by having technical limitations in mind and the need to be backwards compatible. Thus, you see such "leapfrog" innovations when it comes to the new software by, for instance, Microsoft. Some people call this progress, I would rather describe it as rearranging the deck chairs of the Titanic. CU Heiko

    35. Re:Interface-free? by Lotharus · · Score: 1
      There are OSs that do not crash, just took at medical equipment or space equipment like satellites.
      That is true. Those OSes (almost) never crash. They also (generally) run exactly one program, and do exactly one well-documented set of tasks, and have a very small set of possible control inputs. Personal computers, on the other hand, are expected to run myriad programs, designed by myriad authors (who frequently are not in communication with each other), and handle random control input. Essentially your comparison is invalid.

      All systems have a failure point.
    36. Re:Interface-free? by Atlantis-Rising · · Score: 1

      The difference is that cars are relatively complex only in mechanical ways. The operation of a car is very simple, because a car only does a half-dozen things. Essentially, paring down the operation of a car can be done to four essentially operations; applying torque forward, applying torque in reverse, turning, and braking- and there is pretty much one button for each of these operations.

      Learning how to drive a car is nothing like learning how to operate a computer, because your car is extremely simple at the end-user level. (That said, cars have never particularly been simplified since their induction, other than the removal of the crank.)

      Computers will always be complicated objects- that's simply a part of what they are. They're complicated to manufacture, complicated to repair, and complicated to operate, because there's such a variety of different inputs they can accept, a massive variety of ways they can process that input, and then a variety of ways they can output that data.

      No variety of mainstream manufacturing will change how easy it is to operate a computer without changing what a computer, as we know it, is. A UI that's intuitive and easy to use may seem like a change, but it's actually an abstraction that removes from the features of the computer and trades ease of use for functionality. The reason is simple. Ease of use is equated with 'lack of options'. Users want their computers to say 'go' when they press the green button marked 'go', and that's fine; you can equip a user's computer with a little green button marked "go" and take away their keyboard and mouse, and write a UI that only has one button, a Go button.

      But they won't be able to type on it, they won't be able to do anything, really. But it'll be simple!

      --
      "It is possible to commit no errors and still lose. That is not a weakness. That is life." -Peak Performance
    37. Re:Interface-free? by Anonymous Coward · · Score: 0

      I don't think there is a reason why PCs need to run a myriad of programs. The general consumer uses a PC for word processing, web browsing, e-mail, and games. Sometimes printing and editing digital photos and listening to music. Except for the games these tasks are fairly well defined and do not have a large set of control inputs. Redefining a PC to not do everything or accept any input would allow for a much stabler consumer product. Of course a less stable platform allows for greater flexibility for development and expansion, but I don't think the average PC consumer needs these things.

    38. Re:Interface-free? by syukton · · Score: 1

      So the guy who started the Macintosh project at Apple isn't a technocrat?
      A guy who thinks that computers shouldn't have to boot up doesn't have a good idea?

      It is, in fact, only recently that we have had flashmem and the concept of keeping your 'bootfiles' on a seperate flash partition to read from for a quick boot has been a realistic and close to mainstream idea for the desktop.

      Oh, really? So those old IBM PCs didn't come with a BASIC environment in the ROM? What about the Commodore 64? Putting an operating environment on a ROM or EEPROM is not a new idea. A PDA doesn't generally need time to boot either, so why does a desktop machine?

      "Why should you have to double-click anything? What does Ctrl+D mean one thing in one program and a completely different thing in another? And what's the point of the Yes/No confirmation if the user is in the habit of clicking Yes without thinking about it?"
      All of those things make sense in the context they are being used in, and they're relatively intuitive. After all, it's not the programmers fault the user is an idiot, especially with something as simple as a yes/no dialog box, as long as the dialog box is written in language comprehensible for the designed userbase.


      Is there any way for the user to know what the active context is, though? Do they get a notification that says "In this application, these hotkeys mean X where in the application you were just using they meant Y" ? The yes/no dialog box is an interesting point, and I'll use this as a hypothetical situation: If all of the operating system yes/no dialogs have "Yes" as the default button, should all applications on that operating system follow the same convention? If not, why not? Why is it that there is no conventional standard for applications in this regard? Is it because some Yes/No dialogs have ask a positive question while others ask a negative one? "Do you want to save the changes to this file?" vs "Do you want to discard the changes to this file?"

      Computers both can be and should be easy to use. They should be a tool we use to get work done, like a hammer or a shovel. Even a more complicated tool like a multimeter or an oscilliscope is ready to be used at the instant that you turn it on. There is no reason why computers cannot be the same way for the significant majority of tasks (word processing, spreadsheets, email, web browsing, instant messaging). Things don't need to be as complicated as they've become.

      --
      Reinvent the wheel only at either a lower cost, greater effectiveness, or your own personal enrichment and satisfaction.
  2. Interface free? by chanrobi · · Score: 1

    So, what exactly what his hands touching during the 9min 23s video?

    1. Re:Interface free? by AlexDV · · Score: 1

      They keep using that word... I do not think it means what they think it means.

  3. Great news for people with hand injuries. by Anonymous Coward · · Score: 1, Insightful

    This is a great development for people with hand, finger and wrist injuries. Many of them have profound problems using a keyboard, so a touchscreen like this actually works better. They're not always as efficient as somebody using a typical keyboard, but I've worked with people who can type up to 45 words per minute on such touchscreen devices.

    I'm also reminded of this story of a man who seriously injured his hands while blogging. This is the sort of device he may wish to look into, once it becomes widely available.

    1. Re:Great news for people with hand injuries. by scavenger87 · · Score: 1

      For blind people, keyboard with tradiotional buttons is the best known interface, because most of them rely on remembering some typing orders to be able to surf in common Windows menus. This is the case before the speech recognition reaches a satisfying level.

    2. Re:Great news for people with hand injuries. by arth1 · · Score: 1

      This is a great development for people with hand, finger and wrist injuries.
      Producing them, you mean?

      Look up "Gorilla Arm Syndrome" if you need a refresher why this and similar approaches have always failed.

      Regards,
      --
      *Art

  4. Shown on CommandN by Chanc_Gorkon · · Score: 1

    This was shown on CommandN and commented on and blogged to death since FEBRUARY! GOSH!

    --

    Gorkman

    1. Re:Shown on CommandN by mjeppsen · · Score: 1

      Indeed, it's been making the rounds for quite some time now. Still, it was a fantastic demo and the technology implementation is nothing short of brilliant. As I noted recently @ FresHDV:
      "...Sony Vegas just included a new "draw your keyframe vector" type feature in version 7. Imagine capabilities like that in software, only more dynamic and married to something like this user interface."
      In essence, trace your keyframes. With this interface, the possibilities would be much more fluid and dynamic. You could quickly flesh out a concept or look in seconds, and then dig into the detailed controls to fine-tune it. A boon for motion graphics creatives, or even users that just want to make cool Ken Burns-inspired photo montages without earning a Ph.D in keyframing.

      It has to be said...I sincerely welcome our new Interface-Free Touch-Screen Overlords!

      Matt Jeppsen
      www.FresHDV.com

    2. Re:Shown on CommandN by crossmr · · Score: 1

      I knew I'd seen it before when it got to the photography part.

  5. This is a very interesting set up by skogs · · Score: 2, Interesting

    This is an exciting setup...and I agree with his assertion that the OLPC (one laptop per child) is sort of like introducing millions of children to our inane weaknesses instead of our strengths. Really, I know that something like this wouldn't completely remove the need for a keyboard and such for many years, but it is a striking evolutionary step forward.

    Just think how easy all those dramatic situations would have been in the 24th century if the Starship enterprise had some of these!

    --
    Who is this that even the wind and the waves obey Him? Surely this computer must submit also!
    1. Re:This is a very interesting set up by jpardey · · Score: 4, Insightful

      Oh no! Children may use conventional tools, rather than futuristic things that are not in production yet, and probably won't be for 10+ years! When will we ever learn?

      --
      I have freaks! I did something right...
    2. Re:This is a very interesting set up by x2A · · Score: 1

      "When will we ever learn?"

      Another ten years after that, ahhh!!!

      --
      The revolution will not be televised... but it will have a page on Wikipedia
    3. Re:This is a very interesting set up by esocid · · Score: 1

      My friend is actually doing his undergraduate research on creating a "touchless" interface that uses cameras to recognize gestures so you can manipulate menus and such with only hand movements. So removing the need for a keyboard is coming closer all the time.

      --
      Absolute power corrupts absolutely. indymedia
  6. Looking Glass 3d by 1053r · · Score: 1

    It would be interesting to see this integrated with Sun's looking glass desktop...

    1. Re:Looking Glass 3d by theshibboleth · · Score: 0

      I'm pretty sure this makes Looking Glass obsolete.

  7. Hand me a doughnut while I work on this would ya? by Anonymous Coward · · Score: 3, Insightful

    Hand me a doughnut while I work on this would ya? Everyone take a moment and look BETWEEN the keys on your keyboard. Now put that all on your monitor.

  8. Old story, and no such thing as 'no interface' by streak · · Score: 3, Insightful

    Ok, everyone realizes this was recorded in February right?
    Last I checked its the end of October.
    Jeff Han has been covered I don't know how many times on how many sites (probably on Slashdot too - haven't checked the archives yet).

    There's no such thing as no interface btw.
    Yes, you can remove a lot of the mode-switching with different gestures, but there is always going to be some sort of interface to allow you to access other functions.
    In my mind, once you get above about 4 or 5 gestures, things start to become confusing for people again - what was that gesture again? Thus defeating the purpose of no interface.

    1. Re:Old story, and no such thing as 'no interface' by Tremor+(APi) · · Score: 2, Informative
      --
      [Z?]
    2. Re:Old story, and no such thing as 'no interface' by Aqua+OS+X · · Score: 1

      Word. I saw this months ago.

      That said, "no interface" is a figure of speech. Technically, every tool we use has an "interface" of some sort. For example, the interface for a pencil is arguably the wood stalk that's intended to reside in your hand.

      By "no interface" we're really talking about interfaces that are intuitive and reference more natural metaphors of interactivity.

      --
      "Things are more moderner than before- bigger, and yet smaller- it's computers-- San Dimas High School football RULES!"
    3. Re:Old story, and no such thing as 'no interface' by Anonymous Coward · · Score: 0
      There's no such thing as no interface btw.

      I thought it was particularly odd seeing him say that there was no interface on that mapping program, while there's a row of icons across the top of the screen.
    4. Re:Old story, and no such thing as 'no interface' by islisis · · Score: 1

      Agreed, 'no interface' perhaps on a practical level when it comes to touch and drag, but for the zooming he should probably have said no 'no GUI'. A point I think is just as big anyway (in another context), as setting up some mouse gestures acts extremely well on the desktop today.

      As a general idea, any interface which is literally at your fingertips or at your cursor being better than a toolbar or icon is something I agree with. I always prefer using desktop popup menus and application context menus.

    5. Re:Old story, and no such thing as 'no interface' by catwh0re · · Score: 2, Informative
      I've seen various incarnations of this video all through the year. In particular it's often referenced when speaking about Apple computer's gestural patent applications which detail very similar techniques as shown in this video.

      In particular we can see the zooming (into maps, etc) gestures in the patent imagery. http://hrmpf.com/wordpress/48/new-apple-patents/ Although these ideas are not too-new, the related apple patents date as far back as Jan 2005 (through to Oct 06)

    6. Re:Old story, and no such thing as 'no interface' by bogado · · Score: 1

      The pencil is actually a good example, many of us "grown ups" don't think twice when we get a pen or pencil to start writing or drawing. So the pencil/paper technology is almost "interfaceless", right? Wrong, just go to watch some children drawing with pencils and you are likely to see them getting the pencil in an awkward way that makes it very hard to have any kind of precision, the paper below is not well fixed and the strength applied in the pencil almost aways end up breaking the tip.

      So we do learn how to use the pencil/paper interface, we just do it so early in life that most of us do not really think about it. This multi-touch is a revolution, and if it can recognize writing with a stylus it would be very cool to have. There are a few things that I question, though, fingers have natural oils on them, and the screen will become dirty and ugly in no time. Other problem is with on-screen keyboards, those do not have a sensitive feedback, this is essential to any one that type without actually looking at the keys. And how does that computer knows that he want a keyboard, anyway? It simply shows up when he make a magical hand shake with the screen, I don't see why this is different from a command, that has to be remembered, in a command line interface, mainly if you need to communicate more and more with the computer.

      --
      []'s Victor Bogado da Silva Lins

      ^[:wq

    7. Re:Old story, and no such thing as 'no interface' by Aqua+OS+X · · Score: 1

      Quite honestly, the goal would be to abandon the keyboard for something more intuitive. They keyboard is somewhat of a lame input device.

      --
      "Things are more moderner than before- bigger, and yet smaller- it's computers-- San Dimas High School football RULES!"
  9. outstanding by gladbach · · Score: 1

    That has to be the coolest thing I've seen in a long time.

    --
    "Computer games don't affect kids; I mean if Pac-Man affected us as kids, we'd all be running around in darkened rooms,
  10. X11 style by JoshJ · · Score: 1

    Seems like modifying X11's style of copy-paste would work really well for moving chunks of text- highlight it with one hand, then paste it into a text body with the other hand- it'd be faster since you wouldn't have to move each hand as much. If you insist on a literal interpretation of "middle-click", it'd also make for a great way to mod posts down on /. ;)

  11. Re:Windows only thanks to Flash requirement by Anonymous Coward · · Score: 0
    > Thanks for making the web less accessible with this crap

    No problem! And don't worry, theres more on the way!

    Kind regards,
    WWW Bastardisation Dept., Microsoft

  12. People who work with CAD and GIS will start crying by stroustrup · · Score: 1

    If they see this application. Bring it out to the market soon. Mr.Google here is something you should be buying.

    --


    If you lost your job today, don't despair. You may die tomorrow anyway.
  13. This year != recently by QuantumG · · Score: 1

    in the computer industry.. and yes, the fact that this stuff isn't actually available to buy yet means it aint coming out of the lab. Why? Cause it takes people who are willing to accept risk to turn research into products and not every grad student is into taking risks with their life.

    --
    How we know is more important than what we know.
  14. Really more about the display than anything else by bryz · · Score: 1

    The coolest part about this demo is the multi-touch display. I don't really see anything that innovative about the UI's or the lack of UI's that is presented. The only thing about touch screen displays is, at work I already get annoyed when a person comes over and presses their grubby fingers on my display. I would be quite upset if it was encouraged for people to come over to my display and drag all 10 of their grubby fingers all over my display. Where are the 3D non-touch human interface devices?

  15. FROM THE Ancient news Dept. We have.... by Anonymous Coward · · Score: 0

    Very Very Very Very Very Very Very Very old news. OMG

  16. Oh for fucks sake by glwtta · · Score: 3, Insightful

    Sure, it's neat - giant touchscreen with multiple points of contact and gestures that zoom and pan.

    And this is what's going to "change the way we interact with computers"? Odd as it may sound, most application interfaces don't revolve around zooming and panning; there are considerably harder problems left to solve.

    Funny he should mention RSI too, because that keyboard that will free you from the bonds of conformity, and that's displayed on a hard surface, will kill your wrists in a matter of months.

    The thing is great for the Earth-type applications, but that's about it. It's cool technology - why must every innovation promise to change all future computer interactions?

    (btw, if that picture viewer's "Pile of Crap" metaphor is where UI design is headed, I'm never upgrading again. I have my desk to act as a pile of crap, it won't make me feel more comfortable with my computer if it emulates that)

    --
    sic transit gloria mundi
    1. Re:Oh for fucks sake by jargon · · Score: 1

      It actually reminds me a lot of Raskin's ZoomWorld. "Pile-of-Crap" isn't so good, but having a zoom in interfance for storing data and applications is actually super intuitive and useful.

      --
      /dev/psychic: No medium found
    2. Re:Oh for fucks sake by chill · · Score: 1

      The thing is great for the Earth-type applications, but that's about it.

      Just because you lack vision, don't assume everyone else is just as blind.

      This would provide a great addition for editing video, audio or image collections. I've just scanned in over a hundred images related to genealogy and this could provide an excellent and FAST interface for sorting them. Combine it with audio annotation and decent voice recognition (dictation) and it would save me weeks of work.

      My kids take tons of photos, and organizing them is a pain. This would be just like doing it with regular, real-life pictures. Drop 'em into piles, then go from there.

      Anything where large amounts of information have to be categorized, organized or manipulated would be a good market for this.

      How about creating levels for games? Positioning elements, dragging and dropping -- this is just so much more natural and faster than using a mouse. Don't like games? Then re-arranging furniture in a house design app; or landscaping.

      All that control- and shift-click manipulation with a mouse is just a poor attempt at replicating what people do naturally -- grab and move things with their hands.

      --
      Learning HOW to think is more important than learning WHAT to think.
    3. Re:Oh for fucks sake by AusIV · · Score: 1
      I agree. It's a fun toy, and it might lend itself to some useful new applications, but for current computer uses, it's not worth much. Web browsing wouldn't gain much if anything from that kind of interface. Word processing on such a computer would be a complete pain in the ass. Their photo organizing app looked pretty useless, but I could see that being made more practical. Web browsing, word processing, and media organization are the three main things the average joe uses their computer for, and media organization is the only thing this interface could conceivably help with.

      The other issue is gestures. I use The Firefox extension All-in-one gestures. It's great for things like go back, go forward, close the screen, enlarge that image, remove that object, but I remember about 10 gestures out of the 50 or so offered by the extension. I wouldn't want to constantly have to refer to a gesture index to remember how to do slightly less common tasks, I'd rather just have a button I can push.

    4. Re:Oh for fucks sake by Anonymous Coward · · Score: 0

      So many applications for this. Turn in your geek card.

    5. Re:Oh for fucks sake by Anonymous Coward · · Score: 0

      I'm a programmer. I can't see how I can benefit from such an interface at work.

      The only thing that I can think of is drawing diagrams, but most people don't do that very much. Besides, without more of an interface than zooming and panning, how can I select different types of diagram elements? How do I right-click to get a context menu with my fingers?

      No, it's cool tech, and I'm sure there are millions of applications that are made more intuitive with such an interface. But it's not the solution to end all problems.

    6. Re:Oh for fucks sake by AnimeDTA · · Score: 1
      How do I right-click to get a context menu with my fingers?

      I see this as better implemented as multiple mouse-like input devices than touchscreen implementation. You're also limited by viewing this from a mouse perspective, one with multiple buttons even. It won't be intuitive to integrate in all the functionalities that exist currently, but noone when they first use a mouse finds it exceptionally intuitive. We won't know till we really try to tackle the problem.
    7. Re:Oh for fucks sake by chill · · Score: 1

      How do I right-click to get a context menu with my fingers?

      Press and hold, about 1 second, is the current method on devices with touch screens. That's how it works on the Nokia 770, for example.

      --
      Learning HOW to think is more important than learning WHAT to think.
    8. Re:Oh for fucks sake by kabrakan · · Score: 1

      Actually, data visualization, which he touched on and didn't really say anything about, could go a long way with unique interfaces like this. Visualizing data is one thing that is still has a lot of work to go, but exploring large amounts of data visually could really use new HCI techniques. Personally, i think this thing is pretty cool, and i think there is definately potential in it (perhaps with haptic feedback through a glove?)

      --
      Slartibartfast:"Is that your robot?"
      Marvin:"No, I'm mine."
  17. GREAT FOR PR0N!!! by Anonymous Coward · · Score: 0

    No longer will one hand be religated to the mouse!

    1. Re:GREAT FOR PR0N!!! by joshetc · · Score: 1

      Wait, you masturbate with two hands? Nifty.

  18. Better video here by vmardian · · Score: 1

    A better name for this article would have been "Multi-touch screen applications"

    And there is a better video here:
    http://www.youtube.com/watch?v=zp-y3ZNaCqs

    No commentary, but a few more apps are shown.

    --
    PowerLevel.com - A next generation marketplace for virtual items and services
  19. Re:Windows only thanks to Flash requirement by Who235 · · Score: 1

    Come on, mods. Don't mod parent offtopic.

    Anyway, man, here's the YouTube video which I was able to watch (also running Linux with an older Flash version).

  20. Few comments: by quakeroatz · · Score: 1

    - The map application had menu items at the top. Isn't that an interface.
    - Interfaces aren't "bad" or something we need to get rid of. Like a table of contents in a book, people need some reference that tells them how, where, and when to interact or gain value from a object.
    - This demo reeks of cool geek energy and zero business direction. Lava lamps and bright dots that fly, cool!

    - This technology is obviously suited for one major purpose, the driving force of the internet and giant hard drives, PORN!

    Ok... maybe photo editing and 3d modeling. But, not without an interface!

    1. Re:Few comments: by oGMo · · Score: 1

      Really, "interface" was not the right word at all. The touchscreen and gestures are the interface. The word he was looking for was "widgets" or specifically "scrollbars".

      Additionally while it was neat, it's not suited for everything. It would work great for playing with Xgl or graphical things, but it's not going to help much when writing code, papers, spreadsheets, and generally all the things most people do most of the day.

      As for RSI, he doesn't seem to be much of an ergonomics expert... typing on a flat surface with no tactile feedback is not great. Perhaps they can augment the display with other technologies to help this.

      All in all, it's really cool to watch the demos, but it's unlikely to change the world like he wants everyone to believe. And it's rather arrogant to dismiss the OLPC simply because it's "conventional". The alternative at this point is children having nothing.

      --

      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage

    2. Re:Few comments: by monoqlith · · Score: 1

      Additionally while it was neat, it's not suited for everything. It would work great for playing with Xgl or graphical things, but it's not going to help much when writing code, papers, spreadsheets, and generally all the things most people do most of the day.

      I'm not sure about this. In the photo library application demo, he brought up a keyboard with his hands, typed out a label for a photo, and put it away, in fewer than 10 seconds.

      It seems pretty widely adaptable and convenient, especially if we can make the transition from physical keyboard and mouse to "virtual" keyboard and our hands, respsectively. The mouse was supposed to be away of extending our native manual precision and dexterity into our computer programs - now that this screen is here, the mouse is pretty mcuh obsolete, and we can bridge the hand-computer gap in a seemingly more natural, more direct way. Not only that, but the virtual keyboard frees us from the physical constraints and space requirements imposed by having an actual physical keyboard.

    3. Re:Few comments: by oGMo · · Score: 2, Interesting
      I'm not sure about this. In the photo library application demo, he brought up a keyboard with his hands, typed out a label for a photo, and put it away, in fewer than 10 seconds.

      Right, but again, this was a demo application that was designed to look neat and take advantage of the multitouch screen... not be useful. How much time a day do you spend rearranging your photos on a lightboard? While it looked cool, it didn't do much. You couldn't sort, there was no categorization, no album interface, no way to post them, no real photo manipulation, or basically anything that would be useful for anything beyond browsing pr0n. (Any bets on whether this was their very first app?)

      It seems pretty widely adaptable and convenient, especially if we can make the transition from physical keyboard and mouse to "virtual" keyboard and our hands, respsectively.

      What I'm saying is that while this is neat for quick applications that don't require much text, it would be painful for multi-hour coding or authoring. And this is what most people do. For this kind of use, there is one absolute requirement: you don't need to look at it. And if you're not looking at it, you don't need an LCD powering it. (Any sort of predictive or dynamic keyboard violates this rule and makes typing require too much thought.)

      The mouse was supposed to be away of extending our native manual precision and dexterity into our computer programs - now that this screen is here, the mouse is pretty mcuh obsolete, and we can bridge the hand-computer gap in a seemingly more natural, more direct way.

      Yes, touchscreen interfaces are very neat. But they're not the answer to the world's problems. They won't magically make you be able to produce art where the mouse or tablet or whatever was getting in the way before. It may streamline things a bit, but it doesn't remove the need for skill.

      Not only that, but the virtual keyboard frees us from the physical constraints and space requirements imposed by having an actual physical keyboard.

      Again, only in very limited situations. Plus, onscreen keyboard means losing screen space, which is arguably far more valuable than desk space.

      --

      Don't think of it as a flame---it's more like an argument that does 3d6 fire damage

    4. Re:Few comments: by Gabrill · · Score: 1

      Why is everyone ignoring the fact that a standard keyboard would still be available to work with? The other points of the presentation were still valid also, such as lower cost and multi-point sensing. I would certainly think that if the lower cost part was serious, we could use it to change computing from a stand-off display to a touch sensitive display table. (Which would be ultimately more user friendly than the disjointed mouse touchy and monitor visual system we use now). You could even keep your standard widgets, because I didn't see any way of globally panning the way you can with the standard scroll bars. Ok so maybe shooting people in Doom3 would look more like whack-a-mole than ever before, but is that a totally bad thing?

      --
      Always going forward, 'cause we can't find reverse.
    5. Re:Few comments: by monoqlith · · Score: 1

      Right, but again, this was a demo application that was designed to look neat and take advantage of the multitouch screen...

      The only reason I brought it up was to show that a touchscreen-only interface wouldn't end typing efficiency by removing the keyboard, and thus this touchscreen system would still be useful and efficient in productive tasks because oyu still have access to a virtual keyboard.

      What I'm saying is that while this is neat for quick applications that don't require much text, it would be painful for multi-hour coding or authoring. And this is what most people do. For this kind of use, there is one absolute requirement: you don't need to look at it. And if you're not looking at it, you don't need an LCD powering it. (Any sort of predictive or dynamic keyboard violates this rule and makes typing require too much thought.)

      It would be painful in this current incarnation. I don't see any a priori reason why future screen development couldn't allow for a virtual keyboard that's just as comfortable as the keyboards we use now. People can adapt to new technologies, albeit slowly, and technology adopts as well. And as the other poster said, there's no real reason why we need to remove the standard keyboard entirely from the picture right away either.

      You dont' "need" an LCD powering it. Just the same people don't "need" 2.16GhZ Intel Core Duos or incredibly powerful GPU or 21" Cinema displays. Yet they still buy them, even though they aren't needed for 99% of tasks. The thing about good technology is it enables things to occur that you didn't know were possible before, and more improtantly that you didn't know you *wanted* to be possible. I'm sure there are applications for an LCD-powered keyboard that neither you are I, not being able to tell the future, are predicting right now, and can turn out to make such an invention incredibly valuable.

      Yes, touchscreen interfaces are very neat. But they're not the answer to the world's problems. They won't magically make you be able to produce art where the mouse or tablet or whatever was getting in the way before. It may streamline things a bit, but it doesn't remove the need for skill.

      Right - but that's not the goal. The goal is not to remove the need for skill. We're trying to make it easier for people with skill to realize their "vision." People who still work in physical spaces with physical tools don't migrate to computer replacements most likely because the computer replacements can't be absolutely manipulated in the way physical objects can, and thus it wouldn't really make sense at technology's present state. This screen is just one more step to erasing the barriers to adoption for many people who could benefit from widely applicable, extremely useful digital technology, but can't migrate in its current form.


      Again, only in very limited situations. Plus, onscreen keyboard means losing screen space, which is arguably far more valuable than desk space.


      One important thing that the presenter mentioned was that the device was "scalable" - meaning various versions of it can have different sizes and applications. I'm sure a screen of sufficient size that an on-screen keyboard wouldn't be so costly in terms of screen space. Also, the keyboard can be put away when you don't need it, saving that screen area for other tasks. Moreover, can you imagine the implications for future PDAs, tablet PCs, and other portable devices, which need to get rid of the keyboard because it reduces portability?

      This technology might take a long time to adopt, I'm not arguing that. But saying it has no foreseeable niche or wide applicability(which is in part what I think you're saying) I don't think is accurate given the demonstration.

    6. Re:Few comments: by Anonymous Coward · · Score: 0

      "now that this screen is here, the mouse is pretty mcuh obsolete, and we can bridge the hand-computer gap in a seemingly more natural, more direct way"

      Like tapping on an unresponsive, non-tactile screen?
      The mouse and keyboard are perfect already. The only few minor changes that need to made are:
      All keyboards should be made tactile (you know - the way they USED to all be made). 99% of keyboards made today are piles of unresponsive, cheap crap. The only good keyboards I know of are the Cherry tactile range, which are outstanding. Unfortunately most people's fingers are no so deadened by years of typing on 'dead' keyboards that they can't even recognise the difference between a tactile and a non-tactile keyboard.
      The interface needs to be changed ONLY where unnecessary use of the mouse occurs: things such as sizing arrows need to be made bigger, radio buttons should be got rid of and there should be no 'dead' space in between buttons - what purpose does it serve, other than to make hitting the button more difficult?
      Icons are often a waste of space (i.e. look at the XP desktop) and words would be a MUCH better way of displaying applications in this case. Other than that, funnily enough, my keyboard and mouse work absolutely perfectly. I don't even need to wait "fewer than 10 seconds" to access my keyboard - it's already bloody here, right in front of me, where 99.999% of the population want their keyboards!!!

      The guy selling this concept was selling snake oil. Nobody needs it. All this crap about being able to sort through photos - perhaps it would have been a bit easier if he didn't have them randomly thrown onto the display in the first place? I seem to manage quite happily browsing my thousands of photos in Powerdesk. The zooming option could easily be implemented in a matter of minutes by any competent programmer.

  21. Re:Windows only thanks to Flash requirement by BasilBrush · · Score: 1

    What do you mean Windows only? Works fine on my Mac.

  22. Re:Windows only thanks to Flash requirement by supasam · · Score: 1

    Works fine on my mac!

    --


    Suck a lemon?
  23. Re:Windows only thanks to Flash requirement by subtilior · · Score: 1

    Works good on mac

  24. mmm :/ by IamTheRealMike · · Score: 1

    Well it makes for a great demo but I notice he didn't actually manipulate any information there, just graphics.

    What I'd be really interested in is seeing some kind of email or office app done this way. I suspect it's much harder to apply these techniques to very data-heavy displays or data based around language rather than graphics. That's not to say it's a bad idea - multi-touch will probably arrive on our desktops at some point, but I see it as being a supplement to what we have now rather than replacing it completely.

    I love seeing new UI research though. WIMP has so many flaws, it seems clear we can do better given what we've learned in the past 25 years ...

  25. Re:Hand me a doughnut... by Terminal+Saint · · Score: 2, Insightful

    Everybody clean between your keys. Now clean your monitor.

    --
    It's sad when choosing an installation directory on your own qualifies you as an "advanced user."
  26. Re:Windows only thanks to Flash requirement by dubonbacon · · Score: 1

    get the Zipped MP4 there : http://ted.streamguys.net/ted_han_j_2006.zip (It's linked from the article : podcast thingy) If you can't read MP4, PLF is your friend.

    --
    sw5YRhw4ln3pr7$Ock1/4ma0u8Lw2Tm5l6/7DOiC5e6t4NSb6T en 6g5AOCPa2Xs!MSr!p! hackerkey.com
  27. Not quite "interface free"... by kaan · · Score: 1

    In fact, it absolutey does have an interface. Granted, it's a simple interface, and one that contextually changes with each application, but it's still an interface. Basically, all he's showing is an interface that essentially has two mice, not one, and instead of using your hand to manipulate a physical mouse (which is then translated onto the screen), they've built a complicated touch-screen system to eliminate the mouse altogether. And then they added a second one. Don't get me wrong, this stuff is neato, but it isn't really that impressive. Looks like an insanely expensive touch-screen display, with software that supports two mice.

    Also, I can't quite let it slide the claim on the website - "he demonstrates - for the first time publicly - his intuitive, "interface-free," touch -drive computer screen". They need to really emphasize the "publicly" part of that statement. I saw a show on National Geographic (might be a year or two old, too), pretty sure it's the same exact research group with some of the same types of demos like in the video. They very clearly used the same "interface-free" design to navigate city maps. The show was about stopping terrorits or something (it was actually kinda silly), and it emphasized this two-handed, "mouse-less" map navigation stuff so much that it almost seemed like an advertisement.

    Perhaps they should call it "dual mouse" interface? :P

    1. Re:Not quite "interface free"... by corychristison · · Score: 1

      I'm not sure where you are getting "dual mouse" from. You can use as many fingers as you please and it will register them all as an input device.

      Otherwise I cannot agree more. :-)

    2. Re:Not quite "interface free"... by Anonymous Coward · · Score: 0

      That, and the fact that the display is pressure sensitive. I would liken it more to a drawing tablet.

  28. Old news, move along by Anonymous Coward · · Score: 0

    This video is nearly 9 months old, David Pogue (http://pogue.blogs.nytimes.com) mentioned it months ago.

  29. Minority Report interface sucks! by Anonymous Coward · · Score: 0

    Could you imagine a whole day of waving your arms, all directions, 8-12 hours a day!

    It is stupid!

    1. Re:Minority Report interface sucks! by Gabrill · · Score: 1

      Yeah, tell it to the guy who stands in front of the jets that take off from aircraft carriers!

      --
      Always going forward, 'cause we can't find reverse.
    2. Re:Minority Report interface sucks! by bluekanoodle · · Score: 1

      I work in the casino industry. Many of our dealers do just that, and many of them deal with RSI after just a few years. Thanks, but I'll keep my keyboard and tab key.

  30. How to get it out by Garrett+Pennell · · Score: 1

    This isn't something that would immediately go to the Desktop. I can see three markets for this technology: 1. Education Imagine a child's desktop and a computer's desktop becoming one thing. If somehow, in the future, made cheap enough this could be put on kids' desks in school. No need for computer labs. No losing homework. And then you could have a big "chalkboard" version that has capability of displaying something a student may have to share with a class. It's a long way off. It's not going to be economically feasible anytime soon. But that's a possibility later on. 2. Tablet Computing If you don't see this one, you're blind. It fits perfectly. It's similar, but with no pen. And the platform would be more natural as a "tablet." You can pull up a (nearly) full-sized keyboard on a layer above what you're typing into, then dismiss it without anything getting in the way. I mean, it's not like you're going to be moving anything else while you're typing something, right? 3. Public Use Kiosks. ATM machines. They're all cumbersome and haven't changed much since the 90s. You could have an entire wall in an airport that's just one of these interfaces. You walk up to it wherever convenient, tap the screen, and you get an intuitive screen displayed exactly where it's comfortable to you. The front office of a business (more beneficial for some than others). If strategically placed and designed, these big displays could do alot of nifty things. I don't see it making it's way onto a desktop, but if done right, the desktop could be considered nonpoint.

    --
    If you need me to fix your CPU, send me an internet and I'll get right back to you. Thanks.
    1. Re:How to get it out by aaza · · Score: 1
      1. Education Imagine a child's desktop and a computer's desktop becoming one thing. If somehow, in the future, made cheap enough this could be put on kids' desks in school. No need for computer labs. No losing homework. And then you could have a big "chalkboard" version that has capability of displaying something a student may have to share with a class. It's a long way off. It's not going to be economically feasible anytime soon. But that's a possibility later on.

      Is anyone else reminded of the battle-school desks from Ender's Game?

      --
      In theory there is no difference between theory and practice.
      In practice, however, there is.
  31. Minority report??? by www.sorehands.com · · Score: 3, Insightful

    This is not from the Minority Report that was released in 2002. This was shown in shuttle interface in Earth the Final Conflict which aired in 1997.

    This type of interface was also in The first $20 millions is the hardest. But that came out in the same year as The Minority report.

    1. Re:Minority report??? by mqduck · · Score: 1

      This is not from the Minority Report that was released in 2002. This was shown in shuttle interface in Earth the Final Conflict which aired in 1997.

      This type of interface was also in The first $20 millions is the hardest. But that came out in the same year as The Minority report.


      Thanks for clearing that up. I guess this is why the call it "news for nerds."

      --
      Property is theft.
    2. Re:Minority report??? by tricorn · · Score: 1

      Don't forget Johnny Mnemonic (well, unless you really want to), which came out in 1995.

  32. RTFA by mnmn · · Score: 0, Offtopic

    I dont know.
    I attempted twice to check out the video but the ad got in the way CNN style. I took about 10 seconds of it and gave up.

    No matter how interesting, I'll NEVER bear an ad before a small online video.

    --
    "Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
    1. Re:RTFA by corychristison · · Score: 2, Interesting
      No matter how interesting, I'll NEVER bear an ad before a small online video.
      I think I can help you. Well, in most situations, anyway... hehe.

      On topic: I feel this technology really could grow... I would like to see it more like the Nintendo DS. With Dual screens. One being your main form of input. Perhaps by having an overlay application of a scalable keyboard similar to the one featured in the video. And you can use the primary display for, well, display. I dunno. It's late and I'm tired... if you understand what I mean, mod me up! ;-)
    2. Re:RTFA by Anonymous Coward · · Score: 0

      I believe I've seen a prototype for a Laptop exactly as you describe. The name of the manafacturer escapes me now, and so does a link. Can somebody else more helpful link to what I'm thinking of?

  33. about RSI and ergonomics... by kaan · · Score: 1, Interesting

    Not only is the keyboard an issue, consider the rest of his body! He's bent over the screen, neck bent to view the screen that's 2 feet below eye level. Any basic ergonomics advise says you should put the top edge of your display at eye level. Anything lower than that and you'll experience neck and back pain. Keyboard-related RSI will go nicely with a stiff neck.

    I swear, if this were from a business selling some new product, I'd say they were trying to boost sales. But he's a researcher. I guess they must be up for more funding or something...?

    1. Re:about RSI and ergonomics... by parc · · Score: 1

      He's giving a presentation. Would you rather see the back of an input device or the presenter?

      Cut him some slack.

    2. Re:about RSI and ergonomics... by Anonymous Coward · · Score: 0

      > Cut him some slack.

      Either the virtual keyboard will be low enough for non-keyboard RSI, which is bad for neck and back. Or the whole screen will be at an appropriate position for eye level, which means your arms are being held up unnaturally, also not good.

      This is a fancier version of why laptops are bad (ergonomically speaking), and why many people who use a laptop for extended work opt for a laptop stand plus external keyboard & mouse.

  34. Re:Hand me a doughnut while I work on this would y by AusIV · · Score: 1
    Ever cleaned your keyboard? If your keyboard is even built so it can be cleaned, you have to pry the keys off to clean beneath them.

    Ever cleaned your monitor? It usually involves a cloth and a spray bottle, and takes a few seconds.

    I'd much rather have to clean my monitor than my keyboard.

  35. The Pentagon already bought this,,, by prof_peabody · · Score: 2, Interesting

    I recently attended a demo of a similar device at my company. The pentagon already has purchased units and the company is trying to branch out to private sector applications. They were using for collaboration with geographical software (gis data).

  36. Just don't squirt your semen on the screen! by Anonymous Coward · · Score: 0

    Hand me a doughnut while I work on this would ya? Everyone take a moment and look BETWEEN the keys on your keyboard. Now put that all on your monitor.

    It's okay that you masturbate to all that pornography that you find online. A lot of people do it. But have you ever tried squirting your cum into a tissue or into toilet paper? If you do that, instead of just letting it spray all over, you won't get as much, if any, on your keyboard.

  37. Re:Windows only thanks to Flash requirement by Chanc_Gorkon · · Score: 1

    Ok....Slashdot must be borked.....all of these replies to my comment about stuff only working on windows (by the way, the link works just fine if you have the new Flash 9 Beta) and I didn't even say anything about it except that this whole posts is OLD NEWS!

    --

    Gorkman

  38. Neat, but doesn't look useful by slusich · · Score: 1

    It's a very cool looking product, and I'm sure there are some uses for it, but I don't see this becoming commonplace by any means. It just doesn't seem to be a really better way to interface with our machines then what already exists.

  39. Good idea for real 3D work. Maybe 2D. by Animats · · Score: 1

    This is good. One of the major problems with graphic design systems, both CAD and animation, is that it's only possible to select one thing at a time. Many operations involve two objects, and you're forced to some sequential select-and-manipulate interface. This gets you past that.

    Many high-end animation systems will accept multiple input devices, from MIDI keyboards to knob boxes to articulated skeletons. At the low end, we have the scroll wheel, which was a big improvement. Finally, you could do two things at once without shifting modes. This is a further step in that direction.

    Video editors on deadline are going to want this thing. The obvious application is a replacement for the Avid NewsCutter, which sells into an environment which is not very price-sensitive.

  40. this article is full of shit by Anonymous Coward · · Score: 0

    1) he specifically uses the words "the kinds of interfaces you can build on it"

    2) this guy is the worst public speaker in HISTORY

  41. Re:Hand me a doughnut while I work on this would y by friedmud · · Score: 1

    I actually use a touchscreen all day long... my Tablet PC. In some senses it's kind of worse than what's shown in this video... because I rest my whole hand on it for a long amount of time while I take notes in class.

    So does it get dirty? Yep... after a couple of weeks of use it gets a pretty good film on it. Is it bothersome? Nope. Unless you are looking for it you really can't tell... it's actually the texture that let's me know when it's dirty (it's not quite as slick to write on). I just carry some windex wipes with me and wipe it down a couple of times a month... no big deal.

    Now... like some of the other people have said... take a look at your keyboard... mine is infinitely more dirty than the screen on my tablet PC. Even if I did wipe it down a couple of times a month (which I don't... well.. I brush it off maybe when I'm dusting... but not really clean it) it wouldn't be as clean as a freshly wiped down piece of glass.

    Being from the Tablet PC crowd I've really grown attached to being able to interact with my computer through my "fingertips". To me, this video was really cool... and I hope the tech comes down to us lowly consumers as fast as possible...

    Friedmud

  42. no interface? by rhesuspieces00 · · Score: 1

    you mean no human ever interacts with the computer?

    I can understand if you don't care for windows, but I think there is a better solution.

  43. Video slas[...buffering..]hdot[...buffering..]ted! by grolschie · · Score: 1

    I think that streaming media is very [buffering]....

  44. Neat demo. Needs Mandelbrot. by Alsee · · Score: 2, Interesting

    As he was manipulating the map application it really jumped out at me how cool it would be to run a Mandelbrot set app that way. It would have made a fun and awesome addition to the presentation. If I were working in his lab that would almost certainly be the first thing I would add to the system.

    -

    --
    - - You can't take something off the Internet! That's like trying to take pee out of a swimming pool.
    1. Re:Neat demo. Needs Mandelbrot. by digitalstreets · · Score: 1

      I know of at least one -- a port of Jeffrey Heer's "refractal" (refractal.net) to "HALCYON GLAZE". You can find it in somewhat working condition at http://brien.resist-the-b.org/ronline. I think claiming multiple-touch interfaces will revolutionize computers is wrong -- locus of attention is real. Most people can't concentrate on more than one area of the screen or task at a time.

    2. Re:Neat demo. Needs Mandelbrot. by Anonymous Coward · · Score: 0

      ...and tasks such as touch typing and playing the piano are therefore completely impossible.

  45. This is not new by Anonymous Coward · · Score: 0

    It is obvious that the people at the talk "oohing" and "ahhing" are not in the field of large screen interaction. The interaction stuff is standard fare, and not really innovative.

    The multi-touch technology is pretty good, however. There are other multi-touch technologies (from the likes of MERL and SMART), but I this one is better in several ways.

  46. B E T A (as in not complete) by Anonymous Coward · · Score: 0

    It's BETA, quit whining.

  47. The GUI by mqduck · · Score: 2, Insightful

    Very neat and completely useless. I don't know about you guys, but I find it much easier to find my data in my nice hierarchical filesystem than by digging through a garbage can fan full of papers, which is what this GUI simulates.

    --
    Property is theft.
    1. Re:The GUI by AnimeDTA · · Score: 1
      ging through a garbage can fan full of papers

      Hmm, what with games where you're a ball and roll around collecting junk that sticks to you, theres no end to what new games may take form in... soon to come:

      Dumpster Diving!
    2. Re:The GUI by Anonymous Coward · · Score: 0

      Exactly. This 'system' is a joke - who the hell wants to keep 500,000 odd files in a great big bloody mess? If I want to find my files, I simply look in the folder that I put them in. It's called ORGANISATION. If I can't find a file, I use a SEARCH command. It's not difficult, and it WORKS, whereas this dumbass 'system' doesn't. Who wants to view their photos thrown all over the place and then try to find one in there? How do you organise them by date, so I can see the photos I took last Sunday, on this system?

      In short, what is wrong with the way we already do things?
      There are no improvements here - this idea only makes things infinitely WORSE.

    3. Re:The GUI by Stokey · · Score: 0

      I think he made a mistake in calling this "no interface" as any interaction with the computer, by definition, requires some form of interface...

      Anyhow. Imagine a call centre at a bank. The call comes in from a recognised number and the operators screen is filled with the details of the customer. After a fairly standard security process using a virtual keyboard, the operator moves into a sort of virtual desktop like the light box demo. Your accounts are blocks, the bocks can be zoomed revealing individual transactions, individual transactions can be enlarged and read off the details. Links to other accounts can be visiually represented. Other customer information can be layered, semi-transparent or otherwise, over the screen. Previous call histories, important dates, renewals etc. OK, you can probably do all of that with mouse/windows technology, but it's the speed of manipulation that's impressive here. For simple data anlysis, you do only need the pan/zoom functions alongside the virtual keyboard. It would give the call handler a much better "view" of the customer than the flat data records they have access to now.

      Maybe a touch trivial? How about full 3D MRI scans tha can be viewed and manipulated on a single screen without the doc needing to use a computer. Hotel booking agents that have 3D representations of the hotel with occupied rooms in red, empty in green etc. The views from the rooms could be represented etc. Again, it's not impossible to do with today's tech, but you can manipulate the data much more quickly...

      Either way though, either it's "arms up until it hurts" or heads down until my neck packs up". Ho hum...

      --
      Natsu gusa-ya, Tsuwamono domo-ga, Yume no ato
    4. Re:The GUI by 1310nm · · Score: 1

      Guess you missed the menu system on the NASA aerial photography app.

      If each of your fingers is a mouse, what would prevent you from, say, putting one of your meaty pokers on a drive, file folder, or individual file? What if Nautilus gave you the ability to grab and zoom into files of any type, or move them around, similarly to how he was manipulating the photos?

      Thing is, I couldn't see myself standing up all day at work flailing my arms around for 8 hours; the touch-sensitive surface would have to be quite a bit smaller to not require too much wide, repetitive motion throughout the day.

  48. ohhhhh yeahhhhhh by macadamia_harold · · Score: 1

    So, what exactly what his hands touching during the 9min 23s video?

    I'm not sure, but I can tell you what *my* hands were touching during that 9min 23s video.

    1. Re:ohhhhh yeahhhhhh by klang · · Score: 1

      you were thinking about "squeezing" applications, weren't you?

    2. Re:ohhhhh yeahhhhhh by Anonymous Coward · · Score: 0

      and "squirting" pictures...

  49. Also see this video too by mh101 · · Score: 1

    This reminded me of this video I watched a while back, with Google Earth and Warcraft III on a giant touch-screen display using two fingers to zoom or select units, etc. Pretty cool stuff. Too bad it's probably still to expensive to hope for it to become mainstream anytime soon.

    --
    Duct tape is like the Force. It has a light side, a dark side, and it holds the universe together.
    1. Re:Also see this video too by crovira · · Score: 1

      What cost?

      Its a piece of glass that has the image back projected.

      If you have a projector, you're already good.

      The interesting part of this is the multiple detection points.

      There are a few of ways to do this most of which involve stress deformation of a laser beam through the glass.

      Wake me up when he stops having to touch a flat surface.

      --
      MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
  50. No interface? by earthbound+kid · · Score: 1

    "The only intuitive interface is the nipple. After that it's all learned." Anon

  51. "They should have one in the google lobby" by zoftie · · Score: 1

    As the guy notes that they should have this in google lobby. More or less it is good for 'removed' visual data manipulation. Nothing serious, like office work. What is missing, something that was learned ago, is safety brackets data removal or change. This interface will allow less technical people to use the computer. What is missing for the demonstration, is critical data alteration. You won't see this being used in the office for spreadsheets, word processing, etc etc - real meat of the computer industry. Tactile feedback of a flat screen, for typing is absent as well.

    So to define what it can be used for is this: displaying and sorting data, not alteration, modification and/or creation of data, except non-critical visual data. Uses for this don't run along with what computer traditionally for. These people will need to open new markets... failing that technology will fade into the past.

    Anyway how much is one of those screens?
    2c.

    1. Re:"They should have one in the google lobby" by vidarh · · Score: 1
      You won't see this being used in the office for spreadsheets, word processing, etc etc

      Really? The first thing I thought when seeing it was that this would be perfect for things like Visio or other diagram editors, but also for moving text and images around in presentation apps like Powerpoint. It would also be a great interface for doing things like cut and paste, or for changing text sizes etc.

      The uses may not be huge in all kinds of apps, just the same way as mouse usage varies, but they might mean profound changes in how we organize interfaces, and mean that a lot of clutter can just be removed from the interface because the operations can be intuitively done without any icons or menu choices.

    2. Re:"They should have one in the google lobby" by zoftie · · Score: 1

      Mouse was successful because it was cheap. It did cost alot less then system's value. Such display will only be successful in changing the way people interact with computers, if chinese can crank out a millon of these in say less then 500-1000 range. And the researcher is excited about joes and janes using multipointer display.

      On other note, pressure sensitive displays are prone to wear, since one has to flex material in places. So displays have to be cheap to warrant replacing them now and then for low cost. There can be sensor overlays of course, that would speed up the revolution. Something you can mount on your existing LCD...
      2c

  52. Re:Windows only thanks to Flash requirement by daeg · · Score: 3, Insightful

    What were they supposed to do, write a transcript so you could read it with Lynx? Or maybe offer the entire video is an animated GIF?

    Not everything can be fully accessible to everyone.

    I'd wager that having it as Flash video makes it more accessible to more people than say, embedding it with other proprietary video software like Windows Media Player or Real Player, or even offering the file for direct download using some codec that you assume everyone has (not everyone can offer 10 different encoded videos so you can watch it on fringe systems). Flash video is, fortunately or unfortunately, the lowest common denominator across the widest variety of systems at this point.

  53. Interfaces are natural by tygt · · Score: 4, Interesting
    I realize that the point of this (TFA) is about trying to make things more intuitive and natural. But, as others have pointed out in other words, interfaces are a natural aspect of life.

    I have an interface in front of me right now. I have pen, paper; I've got a camera... if I want to record a visual of something, I have to pick up my camera. Never mind that the camera has one of these "non-intuitive interfaces" that we (rather, the article) are trying to remove, I still have to do something to get it done. Anything that I do interfaces with reality.

    One of the goals of the iconic desktop originally was to duplicate the real desktop in some fashion to make things simpler for humans to interact with their work on a computer, so that there wouldn't be too much of a translation layer to build between real and virtual work. Similarly, some try to implement handwriting recognition to remove the interface of the keyboard from the writing process.... until they realize that geeks like us can't write for crap and can type ten times faster as well.

    Regardless, of course, there's got to be some way to tell the computer that you actually want to resize the strange hand-like object on that screen the guy had (I think it was a hand, my sound was off and I lost interest rapidly) rather than add to the drawing. There's got to be some way to change modes, as he did between drawing the outline, getting it filled in, and then moving it around - that's all interface. Sure, it looked sweet that there wasn't any menu pull-down happening, no mouse, but really, you've got a pretty damn simple application that can be manipulated in this fashion.

    Do anything complex, and you'll have to have a more complex interface suddenly.

    "Computer... Computer... (McCoy hands Scotty the mouse) Aye. Hello computer." -- Scotty

    Even talking to a computer would be an interface..... a pretty complex one, though definitely one that could be considered intuitive, if you could use your chosen language for commanding it rather than some cryptic "ok, list the files, sort by date then name.... uh.... ok that one no that shit fucking computer where's my mouse"

  54. For now by AnimeDTA · · Score: 1

    I would just like to have a second mouse cursor if I have a second mouse attached, and apps designed to allow me to do those crazy things with a second cursor. Large touch screens would be nice, but whats really affordable now are multiple mice. Heck even if apps didn't have any special support for extra mice it would still be nice to have a second mouse cursor. Is there no demand for this sort of functionality in a productivity environment as opposed to the creativity type environments? I keep hoping with each iteration of Windows that support for multiple mouse cursors will be native.

  55. Keyboard by WhatsAProGingrass · · Score: 2, Interesting

    His keyboard Idea sounds pretty cool. I would like to see some more practical applications than what he showed. Games would be cool with this interface. I think the idea is great, moving objects on your screen as if they were actually on your desk. But gestures will still need to be learned. Also, we would all get neck problems from staring down all the time at the screen rather than looking straight ahead. All in all, this technology seems very interesting.

    --
    Mark
  56. Re:Hand me a doughnut while I work on this would y by Gabrill · · Score: 1

    And then wipe it completely clean and sterile with an alcohol wet nap. Then try the same procedure with a keyboard.

    --
    Always going forward, 'cause we can't find reverse.
  57. Re:People who work with CAD and GIS will start cry by Gabrill · · Score: 1

    I can just see it now. Do you use a metal edge ruler and a high quality compass with it? How come the drafting eraser leaves big blotches of new lines on the display? LOLOLOL.

    --
    Always going forward, 'cause we can't find reverse.
  58. Other videos by Anonymous Coward · · Score: 0

    Any more tips of interesting videos from there?

  59. Annoying presentation, cool technology. by errordactyl · · Score: 1

    That was so annoying. The technology is cool but in the end it was only just ok cause I mostly wanted him to shut up especially when he talked about there being no interface.

    But this is a significant broadening of the "vocabulary" used to interact with a GUI. For data entry, i.e. coding or taking notes or writing email, there seems to be nothing new..... but that guy strikes me as kind of a dumbass so perhaps someone out there does have something cool and hasn't told anybody yet. We'll have to wait and see.

    --
    $_.=["a".."z"," "]->[rand 27] while !/just another perl hacker$/;
    1. Re:Annoying presentation, cool technology. by dreamer-of-rules · · Score: 1

      Heh. I felt that too, but honestly, he's a geek and an engineer, not a sales toastmaster. It's an impressive technology, and it just hasn't found its applications yet.

      I could see this interface used for large-scale resource management-- emergency services and military being the most obvious. Or World of Warcraft and Civilization. ;) The data-mining aspect he mentioned is interesting, but three dimensions is probably too limiting-- we probably don't need better visualization, but better search/modeling algorithms. It might be useful in network analysis, like in biochemistry. I'm not sure the lightroom aspect is very useful, but it could find a use in detective work for managing photos and evidence (like in Minority Report, I suppose). Anyway, I wish them well.

      I appreciated that at the end it seemed that the conference was setup specifically to find those applications.

      --
      Everyone is entitled to his own opinions, but not his own facts.
    2. Re:Annoying presentation, cool technology. by errordactyl · · Score: 1

      Ah you're right, I was being too hard on the man. He was trying to do something cool at least, unlike me. If he's reading this I hope he accepts my apologies for calling him a dumbass

      --
      $_.=["a".."z"," "]->[rand 27] while !/just another perl hacker$/;
  60. Dear Santa by Gerocrack · · Score: 1

    Fuck the PS3, where do I preorder one of these?!?

  61. been there by pbjones · · Score: 1

    slashdotted that.

    I think /. covered it when the video was first done. you still need a file manager etc.

    --
    There was an unknown error in the submission.
  62. 38 more by Alsee · · Score: 0, Offtopic

    There are 38 more available, on a wide range of subjects.

    I just finished watching an extremely impressive talk by Ashraf Ghani, former Finance Minister of Afghanistan. Dear President Bush, please listen to this guy.

    I've already selected and downloaded 3 more videos which I plan to spend the next hour watching.

    -

    --
    - - You can't take something off the Internet! That's like trying to take pee out of a swimming pool.
  63. get rid of physical? by demon411 · · Score: 1

    from the video "there is no reason in this day and age we should be conforming to a physical device" The whole idea of Tangible Interfaces is to exploit our natural ability to manipulate physical objects. In fact the guy that developed the minority report stuff, John Underkoffler, was big in Tangible Interfaces when he was a student at mit media lab. In my opinion, physical objects aren't being used enough in interfaces. I do like the fact that touchscreen interfaces gets rid of the indirection than occurs when you use a mouse to move a cursor to manipulate some icon.

  64. Flat surface interfaces are a dead end by BoberFett · · Score: 1

    While they may be useful while other technology matures, the life of interfaces based on flat surfaces is limited. The keyboard, the mouse, this touch screen (cool though it may be) are a decade away from obscurity. As it has in the past, I think the game industry is going to open the doors to the public of true 3D interfaces. If the Wii is as big a hit as is predicted, and works as well as some hope, people are going to start expecting that sort of control in the future. The days of hand pain from using current interface tools will hopefully end, because no matter how "natural" that keyboard or mouse is, it's natural for one person and not another. I for one would love to have an interface that involved nothing more than my hands in mid air making natural, comfortable movements.

    And for those still stuck on the porn aspect, just imagine what that could do for you.

  65. Re:People who work with CAD and GIS will start cry by uradu · · Score: 1

    Hardly. This is good for rough manipulation as shown in the video, but quite useless for finer control--the highest pointing accuracy it can achieve is the half inch square under your fingertip. I always get a yawn when I hear that some new interface technology will replace everything before it. These technologies tend to be more cumulative, adding to a richer interface when taken together--mouse, keyboard, touch screen and microphone together can lead to a much more sophisticated interaction when each one is used for its strengths rather than exclusively.

  66. Goatse Interactive by Anonymous Coward · · Score: 0

    ewww! enuff said.

  67. kinda price by mennucc1 · · Score: 1

    the linked talk also won the price for " The Most Gratuitous Use Of The Word Kinda In A Serious Scientific Presentation".

  68. good god man! by Anonymous Coward · · Score: 0

    He invented the drawing tablet!

  69. Again?! by MBoffin · · Score: 1

    How many times are we going to see this posted? This is getting ridiculous. It was neat the first time. Now it's getting old.

  70. Other ideas... by Sean0michael · · Score: 1

    Combined with this Pen-based Interface and the many different ways of interacting with files in this system, we could be on to something extremely cool, functional, and versatile.

    --
    Funtime Candy Wow! - my plan for eventually conquering Japan.
  71. Interface free by WhatDoIKnow · · Score: 1

    Is that free as in 'freedom' or free as in 'beer' ?

    :wq

  72. Re:People who work with CAD and GIS will start cry by mwvdlee · · Score: 1

    Look at the size of your fingertips, look at how small changes in presure and orientation can distort the fingerprint's outline, now imagine just how precise such technology could be.

    It's still cool though, and I'd certainly like to play with this (I assume I won't have enough money to buy one for the next 10 years).

    --
    Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
  73. Re:Windows only thanks to Flash requirement by smoker2 · · Score: 1
    Well speaking as a linux user, Realplayer works just fine here, and so does Flash.

    I have a piece of software called SwishVideo2 which takes video and creates flash movies. They realised that Flash 9 broke all the movies that their product created (when viewed using Flash 8 and earlier) so they issued a patch that allowed Flash 8 and earlier to view their Flash 9 compatible movies. Why should everybody have to redo all their work just so Macrodobe can charge a new fee ?

  74. Re:Windows only thanks to Flash requirement by x2A · · Score: 1

    100% correct. One of my old clients switched over to using flash for videos, and more people can watch them now, and easier, than ever before.

    You can't complain at people because your choice of OS is missing software to view their files. I have this new idea of picking the tools you need, then installing the OS required to use them. On my servers, firewall, media machine, I run linux. On my laptop I use for browsing+work, I use windows. In each case, I picked the best tools for the job.

    --
    The revolution will not be televised... but it will have a page on Wikipedia
  75. Already being sold. by Kurayamino-X · · Score: 1

    There's already a company that is selling a product with a multi-touch sensor that doesn't require a camera behind the screen to see your fingers (which is how this rear-projected screen works) right here. It's a 15 inch LCD interface for controlling MIDI and OSC applications.

    --
    ...I got nothing.
  76. heat by hey · · Score: 1

    Why is there no manual (or instructions) necessary to know that touching the bottom
    of the lava lamp adds heat? It doesn't in real life.

  77. Bring on the screens. by paragon_au · · Score: 1

    I envisioned this as having a screen in front of you, and a touch screen at your finger tips. Both displaying everything.
    I don't think it would take much effort at all before you'd rarely have to actually look down and see what you were doing.

    I also think that we'd have to keep an interface, but it could be more like OS X's menu (Or like how he changed things in world wind).
    You would still need to have menus for some things, but for the most part you could remove a lot of the menus.

    I also liked the idea of having a virtual keyboard. You could program up different varieties of keyboards (No more QWERTY vs Dvorak). You could have one for programming C/Python/Whatever where you could have common features inserted just like you were typing. (Yes you can do this with programmable keys, but not per application with visuals).

    I think, depending on what it's like to tap on a screen all day. His would be great. And I can't wait to see it evolve and go into production.

    For 95% of what I do this is just as good or better. And I am sure for another 4.8% of that you could think of ways to make it work. And the rest of the time, you can always have a bluetooth wireless mouse and keyboard at the ready hidden away.

    Bring on the screens!

  78. jaded by gravesb · · Score: 1

    Its amazing how jaded some people here are. Anyway, I want this to be a wall in my house.

    --
    http://bgcommonsense.blogspot.com
  79. Re:Windows only thanks to Flash requirement by MobyDisk · · Score: 1

    I've never understood why doesn't work. It works for JPEG, GIF, etc. The reason video isn't accessible is because soembody, one day, decided that video is somehow fundamentally different than images.

  80. Re:Look into the future. Other video here by Psykechan · · Score: 1

    Sure, it's neat - giant touchscreen with multiple points of contact and gestures that zoom and pan.

    Yes, it's neat. Hey, we are geeks so that's the point!

    If you want to see some applications that can benefit from it immediately, check out this video that shows both Google Earth and Warcraft III being run using this multi touch interface combined with voice recognition.

    I've been using a multi touch interface for over a year now via my PowerBook's touchpad and iScroll2. Let me tell you that panning around applications by touching two fingers to the pad becomes second nature rather quickly and will make you very excited about this new technology.

    I agree with the virtual keyboard problem. RSI would be worse on a system like that, not to mention the fact that touch typing would be near impossible due to no helper bumps for the F and J keys to tell your index fingers where home row is. I guess it doesn't matter since you would still be looking at the screen while typing but that has been my concern for other setups that have been pushing virtual (and usually projected) keyboards.

    As for Jeff Han calling it a "no interface" interface and then proceeding on touching icons at the top of the screen... well he is looking at this as being a revolutionary way of interacting with a computer. In truth, this can be used right now to bring us an evolutionary interface that will make people's computing easier, more intuitive, and more productive.

    And as geeks, we should always be impressed by that.

  81. multigen smartscene by phitar · · Score: 1

    i remember using smartscene, by multigen, a 3D version of this 2D interface (head monted display, powergloves...) for a prototype of a game creation tool at electronic arts, 10 years ago...

    you could grab space between thumb and middle finger, objects between thumb and index. all rotation, zooming, moving object, ... were done similarly but in 3D.

    still, well done demo. excellent presentation skills !

  82. Re:impossible? by meburke · · Score: 1

    I'd like to remind you that many of the things we take for granted today were considered impossible ideas only a few years ago. As Larry Ellison mentioned in one of his presentations (in 1995) "..in the last 20 years, computing power has increased a million-fold..." Of course, a lot of his predictions were based on the questionable assumption that computing power would continue to increase at the same rate. I think he may have under-estimated it. (At this point, that is probably as likely as over-estimating it.) Still, if he was right, your assumption that it is impossible to achive the goals you mentioned would be wrong.

    --
    "The mind works quicker than you think!"
  83. Re:People who work with CAD and GIS will start cry by SoapDish · · Score: 1

    Precision of the interface is not needed for CAD.

    Everything is done with either numerical entry, or object snaps and constraints. Many 3D design packages actually involve doing a rough sketch, then adding constraints to the geomety, then adding the numbers.

    An interface like this will make tool seletion faster, rough drawing faster, and numerical entry will be easy too. The only drawback is that it may be more difficult to select objects with less precise input.

  84. This is NEWS ? by gungh0 · · Score: 1

    I saw this video about 6 months ago, its hardly newsworthy. BTW - Nothing like Minority Report, they had to wear special gloves to use their "interface" ;)

    --
    No, really !
  85. under 1 second by Anonymous Coward · · Score: 0

    >"There has never been any technical reason for a computer to take more than a few seconds to >begin operation when it is turned on."
    >I can name half a dozen;

    I can name at least 1 where it doesn't. RISC OS. When set up right, turn on to desktop is under 1 second.

    On linux, typically the main problem is that init is often written in sh, and does its work sequentially. Some people have tried making a C version of init, and/or just starting processes in parralel. It helps, a lot.

  86. Wow by ubergenius · · Score: 1

    I must say, I am not easily impressed, but this has impressed me. I'm not jumping for joy or anything, but the ease of manipulation and the ability to use many different points of contact is definately intriguing if it's portable enough.

    Now all we need is an API.

    --
    Student Manager - Take control of your education!
  87. Re:Windows only thanks to Flash requirement by tinkerghost · · Score: 1

    Shrug FC6 ran it fine - of course I took the extra 30 seconds to drop the Flash9 beta into my system.

  88. tiring or a sore neck? by Anonymous Coward · · Score: 0

    if you put this flat or on a slight angle you'd get a sore neck from poring over it all day. OTOH if you put it up vertically, you'll develop some killer arms from holding them out unsupported all day.

    Outside a kiosk or big screen for collaborative work - like a massive whiteboard... I'm sold on the coolness, but not the practicality.

  89. Stylus anyone? n/t by tinkerghost · · Score: 1

    no text

  90. Think of the gaming possibilities as well... by Tarlus · · Score: 1

    Couple this technology with a future successor to the Nintendo DS, and it could continue to take the DS into a more innovative direction!

    --
    /* No Comment */
  91. The real significance of this by viewtouch · · Score: 1

    The real significance of this is that any technique he uses in a video release for public view becomes part of the body of work of prior art that can be used to prevent future attempts to patent anything shown in the video.

    When I first developed, but didn't patent, the graphical point of sale software paradigm in the mid 80's I began a fifteen-year effort to travel the world and show it to thousands upon thousands of people. As a result, none of the aspects of the graphical POS software user interface could be patented and the use of the software paradigm was adopted in virtually every country of the world free from the impediments of intellectual property assertions by anyone.

    This is exactly what I also hope happens to this man's efforts - that people will also copy his ideas and build countless useful, intuitive touchscreen interfaces (yes, the display itself is the interface, by definition, even if he doesn't concede that it is) and the people doing this work will forever be unhindered by organizations asserting intellectual property rights on the interfaces that drive these systems.

  92. Does this work in the light... by Hauke · · Score: 1

    Seem not to work when the lights went on, or why does he grap the screen at the end for no avail?

  93. Missing the point -- literally retarding by holophrastic · · Score: 1

    It's a beautiful and attractive technology. It'll be great fun for gaming and artistry. However, it's a *horrible* interface for computing -- because it misses the point of computing entirely.

    Computers don't make tasks simpler. They don't make tasks for efficient. They don't make things easier. They do one thing and one thing only (as productivity tools), they make tasks more organized.

    The whole point of one mouse pointer, one focus, one character cursor, is that your tasks is streamlined. One river moves faster than multiple streams.

    Go ahead and author an invoice, a book report, an essay, or a contract with multiple focal points. Better yet, why don't you instruct someone else to make six changes at once.

    A huge part of organizational skills is being able to separate and structure an abstract task into sequenced components. That's not computing, that's converting abstract thought into structured logic.

    But hey, a straight example from the demonstration: resizing an image. Bigger-smaller, well done. But I want it to be 159 pixels wide. You can zoom in, bring up a ruler, snap and maintain, but that's just got to be more interface.

    Oh, and good luck selecting another application without a menu-system.

    I miss the good old solution. We have hundreds of languages on this planet. There was a time when command-lines and adventure games exposed natural language as an interface. Now that's intuitive. It allows for thousands if not tens of thousands of instructions, and also allows for interactive prompting, clarification, and response.

    We prefer to direct other verbally, as opposed to physically. So I quote "Back To The Future II" when I say: "You have to use your hands?"

  94. Vid Warning Please! by adavies42 · · Score: 1

    It's past time for /. to warn us when a link goes to a video. The last thing I want is to preload a page in a background tab and suddenly have loud music inexplicably start blaring at me. If pdfs deserve warnings, videos deserve far stronger ones.

    --
    Media that can be recorded and distributed can be recorded and distributed.
    -kfg
  95. Re: disagree by Myopic · · Score: 1

    I have that multitouch keyboard (Fingerworks TouchStream) and I'm typing this sentence on it right now. It may be difficult for you to understand without ever having tried it, but this keyboard absolutely does help with RSI. The hardness of the surface doesn't even enter into the question -- the keycaps on your keyboard are hard, aren't they? -- the important part is how hard you have to press the key to generate the keystroke, which is essentially zero on this keyboard, far less than even light-touch traditional keyboards. On this keyboard you barely, lightly touch the surface to type a key, hardly hard enough even to hear your finger touch the surface.

    Furthermore, the gestures on the keyboard are in fact very natural, certainly at least as natural and unforgettable as learning keyboard shortcuts. There are dozens of gestures, and all the easy ones can be learned in a mere minutes because they are intelligently designed, so that similar operations have similar gestures (eg copy paste cut).

    I can't speak for the whole world, but this keyboard definitely revolutionlized how I use computers. Unfortunately the company is now out of business, their technology reportedly purchased by Apple, which of course will sit on it and never use it. Some people have claimed that the Mac's new two-finger scrolling on the touch pads is due to this technology, but if that's true then it's a sad trivialization of the potential of the tech. And frankly, my keyboard is a limited implementation of the overall multitouch gesture idea.

  96. Slow! by srblackbird · · Score: 1

    I posted this ages ago!! ( on Wednesday August 16) http://slashdot.org/comments.pl?sid=194260&cid=159 23171

    --
    "The test of the morality of a society is what it does for it's children." -Dietrich Bonhoeffer
  97. Re:Windows only thanks to Flash requirement by rabiddeity · · Score: 1
    What were they supposed to do, write a transcript so you could read it with Lynx?

    This is moving offtopic, but yes, a transcript would be nice. It's not for those running Lynx, but more for those of us who surf without sound (at work, or at home because most flash sound is obnoxious). Or how about those who can't hear, hm? Sure, it takes time to type out what's being said on a video. You could stick that text in the article for those without Flash, and you could add it as captions under the video as it plays. If what you have to say is that important, spend that time. Your "lowest common denominator" is more likely text PAIRED with video. That is, if you can be arsed to do it.