Slashdot Mirror


What Will The Future Desktop Interface Look Like?

b O b 1 9 19 A writes "The TechZone has an interesting article wondering where computer interfaces are going. They discuss some alternatives to the traditional desktop, and propose a framework in which future interface designs may be evaluated. From the article: 'The next 10 years will be a transitional phase for interface design. 3D rendering technologies already have a stable home in the entertainment, video game, simulation, and design sectors. Although 2D interfaces have dominated everything else, I expect we will start seeing more 3D incursions. Operating systems and applications are beginning to capitalize on what 3D has to offer. The precise nature of how and where 3D can best be incorporated is an open question, and a framework to evaluate these questions seems appropriate.'" Big-time ad alert. Set your ad and flashblockers to stun.

21 of 339 comments (clear)

  1. Whatever works best with the... by arrrrg · · Score: 5, Interesting

    device that lets you move onscreen objects by just thinking about it. We can do a brain-controled 2-d cursor easily now, better stuff will be on the way soon.

    1. Re:Whatever works best with the... by Baddas · · Score: 5, Insightful

      I think this is the key to future interface design: Not the virtual representation, so much as the interface devices. As long as we're restricted to a 2d mouse and a set of binary keys, the different metaphors for the software are moot.

      Assuming we get something with positioning in all the dimensions of space (or at least, more than two degrees of freedom of mice) then you can start having interfaces which utilize those spaces.

      Of course, right now we navigate 3d spaces in video games fairly effectively, but it's a full-concentration task, using both hands. Which is not exactly ideal for something you multitask in, perhaps? As well as containing the restrictions of a physical 3d world such as gravity etc. Perhaps descent would be a better model.

      Just my thoughts off the cuff

    2. Re:Whatever works best with the... by lotrtrotk · · Score: 5, Funny

      Yess!! Soon I'll be able to browse for pr0n hands free =D

    3. Re:Whatever works best with the... by NanoGator · · Score: 4, Funny

      "Yess!! Soon I'll be able to browse for pr0n hands free =D"

      Of all the smilies to use...

      --
      "Derp de derp."
    4. Re:Whatever works best with the... by rpdillon · · Score: 5, Insightful

      I'm not sure I agree with this. In games (and movies) there is a natural tendency to move towards an illusion of 3 dimensions because the goal of those media is immersion: to make you feel as if you are "there". 3D is a natural way to go, since we tend to perceive the world in 3D. Of course, it is an unnatural act, because we choose to display those immersive environments on a 2D screen, so we naturally experience some sheer during transition.

      But, with a computer operating environement, I simply don't see the attraction. The environment of a computer is not in the business of being immersive, or distracting you from reality. It is in the business of making information available to you as quickly and accurately as possible. This goal does not particularly lend itself to 3D - as long as we have had langauge, it has always been expressed in 2D, whether it be carved or painted on walls of caves, chiseled into stone, brushed onto papyrus, or printed on newsprint. Even now, as I type this, I do so onto a 2D digital "paper" that is my LCD monitor. Would 3D lend any additional utility? I can't think of any.

      I attended JavaOne last May and went to a session on Looking Glass, Sun's 3D desktop environment. As much as it was attractive, it didn't really add a whole lot to everyday tasks. Sure, they could represent a filesystem in 3D, but it wasn't really any more efficient than midnight commander. You can "fold" away windows to the side of the display, rotating them back into the monitor to get them "out of the way", but it essentially boils down to window shading, only horizontally, rather than vertically.

      Of course, there are exceptions. Sun demonstrated a music program where you could add instruments to a song as tracks, and control their volume and balance by moving them in 3D in relation to your real life speakers. To make something softer, you could move it further "into" the monitor. To make it only audible on the left speaker, you could move it to the left side of the screen. Quite novel, but certainly not an application that necessitates a 3D "desktop" environment. It could just as well be run as a standalone program in Windows, Linux, or Mac as they are today.

      So while I agree that if we were to have a 3D desktop, it would be nice to have a 3D input device, neither seem to add much utility. Personally, I'm stunned that the multi-desktop (virtual desktop) navigation system hasn't made more inroads. I'm addicted to it in KDE, and Windows' powertool feels like a cheap hack by comparison. I'm stunned that neither Windows nor Mac come with it by default. Mac uses Expose, which strikes me as a complex work around to achieve a similar effect. In the future, I think we'll use other subtle advancements like virtual desktops to extend the functionaility of the user interface in ways that allow us to *organize* the information as we access and use it, rather than displaying it in some drastically different way, like a 3D desktop.

  2. Hopefully in the future I'll still be able to say by CptPicard · · Score: 5, Funny

    It's a UNIX system! I know this!

    --
    I want to play Free Market with a drowning Libertarian.
  3. 3D not that useful by Bogtha · · Score: 4, Insightful

    Current interfaces aren't 2D, they are 2.5D. There is a z-axis, it's just less immediately obvious than the x and y axes. Ever put one window on top of another? Yep, that's depth.

    The reason why 3D interfaces aren't really that useful is that you really need a 3D input device to make use of it. But the trouble is, the way our bodies are built, it's very tiring to wave our hands around all day long. At least with a 2.5D interface, our hands are resting on something.

    The other problem is that the value 3D provides over 2.5D is very small. What does it actually get us? We can already put things behind and in front of each other. We can already zoom in and out of structures. We can't rotate well - but that's not something that I think stops useful things from happening.

    What we need aren't 3D interfaces, what we need are smarter interfaces. Not necessarily natural language processing, but simple stuff that works and is practical. Tab completion in UNIX shells is a good example. Intellisense in IDEs is another. Clippy is rumoured to have actually been useful in the lab, before it was hobbled for desktop computers. Spotlight is making things easier to find.

    These are the kinds of interface enhancements that will be of most use, and they can come along piece-by-piece without anybody noticing, without needing new hardware, and without users being forced into a new paradigm.

    --
    Bogtha Bogtha Bogtha
    1. Re:3D not that useful by Bogtha · · Score: 3, Funny

      Maybe the next step is to take a shot at a female-centric interface. Not that anyone on /. would know where to start, of course :)

      This is a good start.

      --
      Bogtha Bogtha Bogtha
  4. You know what I think looks cool? by bersl2 · · Score: 4, Interesting

    This looks cool.

  5. Many ideas by JanneM · · Score: 3, Insightful

    There are many, many interface ideas out there; anyone who's attended a SIGCHI or similar conference can attest to just how many, how varied - and how weird - they can be.

    However, it's getting pretty clear that the WIMP stuff we have really is pretty good. We hit upon something which while far from perfect still is reasonable. Other interface ideas need to be substantially better, and without serious flaws, and that is difficult to achieve.

    Having a 3D component is a good example. There is little doubt that it will be used in _some_ form at some point in the future. It is also clear that getting it really right is not easy; so many projects have tried and failed already. When what we have is already pretty good, the bar is very high for mistakes, drawbacks and problems.

    To connect back with some earlier desktop discussions recently, this is exactly why having a multitude of desktops is a good idea - not just two, but ten or more projects, all trying various ideas and directions. Chances are one of them at least will stumble upon a new, better way of doing something; a new, better way that the others then are free to copy and improve on. That is also why it is so important to have more than one toolkit - ultimately you are constrained to what the toolkit allows you to do, and thus you need more than one to take into different directions.

    --
    Trust the Computer. The Computer is your friend.
  6. Re:4D by Ruff_ilb · · Score: 3, Insightful

    So what, your fourth dimention is time?

    "OH SHIT, I can't access outlook, I've got to go back in time!"

    But seriously though - look a few posts down - the person found some serious gripes with a 3d interface. Here are mine:

    Ok, a 2d interface is immediately intuitive. 2D screen, 2D Mousepad, 2D interface. Simple. But with a 3+D interface, we lose intuitive-ness (and therefore efficiency) in the name of a more advanced system. Some people navigate quite well in 3D, sure, but try handing a copy of blender (or any other modeling software) to someone and get them to navigate in 3D. Challenge them to make a series of coencentric spheres, even. Even if they can do it, it becomes WORK. And no one wants to do more work then they have to.

    On a lighter note, the Star-Trek allusion at the end of the post makes me agree with the first poster. As our computers get faster and faster, we'll probably end up interfacing with them in more intimate ways - I don't mean to say that we'll all become like the Borg or anything, but even improvements like voice control (subvocalization? Or is that just a bad SF tech...?) or touchscreens, or heck, almost ANYTHING else. The Mouse + Keyboard can hardly be the most efficient way to interact with our computer, methinks.

    ~Ruff_ilb

    (Sorry for the horrible spelling.)

    --
    http://www.TheGamerNation.com/Forums
  7. Complete Article Summary (if slashdotted) by mybecq · · Score: 5, Funny

    Page 1 through 5
    [ A d .. A d . l i n k ]
    [ Ad ] A [ a d s .com ]
    [ AD ] r
    [ Ad ] t i c l [ A ]
    [ AD ] e [ AD ][ D ]
    [ Ad ] T e x t
    [ AD ] 1,2,3,4,5
    [ A D mediaplex.net ][ AD ]


    PS. My eyes have stopped hurting now.

  8. Here's was I think would be useful by presidentbeef · · Score: 3, Interesting

    A desktop system with easy-to-program (read: the average consumer can do it) widgets and interfaces. Probably with some nice web services integration. People who just need to read email and surf the web only need a couple widgets, maybe a mail checker or something. People who work in offices and do really repetitive tasks have ways of easing that through the widgets (again, very easy to program/setup widgets!).
    I think anything that allows people to really use their computer the way they want would be great. I'm not saying it doesn't already exist, but I mean something where nearly everyone becomes accustomed to using a computer as a configurable tool. Something where all those times people say, "Well, I just want it to do [this]!!", they can easily set it up to do whatever it is.

    Just my thoughts.

    --
    Everything I need to know about copyrights I learned from Slashdot.
  9. like a desktop by RhettLivingston · · Score: 4, Interesting

    It is sad that anyone has the vision of people still sitting in front of displays ten years from now. My prescription, switch to glasses with very high resolution across the full field of view but the ability to be transparent too, give the computer multiple cameras placed strategically around the room so that it has a full 3D view, integrate head position detection and a point of view camera into the glasses also, and then create an interface where the computer places virtual objects in your environment in a natural fashion. i.e. Let's read virtual books on our real desk, see the images of people we're talking too remotely as if they are sitting in a chair in our office, have virtual office decorations, have a virtual whiteboard that we can stand in front of and interact with (just a blank space on the wall that the glasses allow us to see as a whiteboard for a while), etc. i.e. augmented reality should be our 10 year vision.

  10. The tasks performed on a computer. by SmallFurryCreature · · Score: 4, Insightful

    I introduce first to you the humble progress bar. A good progress bar does two things. It shows how far along something is (percentage complete) and it show that activity is taking place and your computer has not just frozen again.

    So in days past when screen were primitive you simply had a row of dots appearing with maybe if your lucky the occasional 5% added to give something like ......5%........10%....

    Add the capabilty for backspace and you usually got a little spinning character made up out of -\|/ to show action taking place. Some more advancement and you got a full bar like 0****5****10****15..| (work with me here this is hard to do in text)

    But then GRAPHICS were added. YEAH. So now you could draw a bar slowly being filled (but for some reason loosing the activity indicator). Color was added and now you could make the bar turn from red to green.

    2.5d add shadow effect to make the bar appear round. 3d and it can stand up like a real seperate bar on your screen.

    And what is the freaking point? Well none. All of them did their work and clearly showed what was happening. Okay they became better looking but it gave no real advantage.

    So are there other tasks that can benefit from better graphics? I think you have the following main type of jobs on a pc.

    1. Finding things. Locating that file you know you have but have not got a quick link to. Either you search for it by entering some params, this does not need more then a text interface. You navigate a file tree for it. text interface like Midnight Commander works perfectly fine. Oh graphics enable nice extras like previews for images but that is useless when I am searching for a mp3 file and the previews for text documents are so small I can't spot the difference. That is leaving aside that the preview options are usually so slow that I can move a thousand times faster in MC then the graphical browsers. 3d benefits? Can't think of any.
    2. Manipulating content. Well unless your trying to edit a 3d content item what is the point? The article already points out that text is best displayed on a 2d service. Now sound manipulation might make sense in 3d, after all stereo sound IS 3D in away so instead of manipulating two 2d waves you could mix them in a 3d wave signal. Never seen this so either it is to hard or it does not offer any benefits. Office/paint/code in 3d? Only as a way to make things extra clear (in the same way that it is easier to code with color highlighting) but no. 2d seems to work fine.
    3. Organizing content. Now we are talking. As the article points out 2d is horribly limiting to make complex relations, anyone who has ever drawn a relationship diagram will have found themselves having to cross lines wich always makes things confusing. Add a 3rd dimension and you never have to cross lines. HOWEVER the huge price you pay for it that you now have to control a 3rd dimension wich seems to make things a lot more difficult. You already need a bloody complex mouse to manipulate a large 2d scene (x-y axis mouse + 2 scroll wheels) a 3d scene is even harder. Every 3d game with a free roving camera proves it.

    Yes I would like a 3d interface when I am manipulating or inspecting the relations between objects on my pc. But is this a common activity? Well I look up at the tabs of my opera browser. Current desktops already have a sort of 2.5d and perhaps my tabs would be clearer if tabs of new pages where "behind" the tabs they originated from. I arrived at this input screen by opening a new tab from the story page (helps me remember where I was when I am finished here) but this tab is at the end of the tabs not indicating that it has a relation with a tab almost at the beginning.

    Still with me? Another example. My music collection has a lot of soundtracks. Trying to organize it completly is a nightmare. Especially if I also want to organize it by genre (so I can easily switch depending on mood). Luckily I am on linux so I can use symlinks so an album can be both in

    --

    MMO Quests are like orgasms:

    You may solo them, I prefer them in a group.

  11. People just don't work that way though by xtal · · Score: 4, Insightful

    People don't work like that though. Do you think the LASIK industry is predicated on people liking wearing glasses? They do a good job of hiding my broken nose.

    You know what I'd really like? The same interface I have now, on a 30" LCD that costs $1000. Hell, make that three of them. I'm using three 17" LCDs right now and two notebook computers next to me. What does joe sixpack want bad? a 60" plasma TV.

    That I suspect is what the future will bring.

    You want my predictions for 10 years?

    Great big, high resolution displays, and probably several of them.

    A wireless keyboard sitting in front of that display.

    A wireless mouse sitting right next to it.

    Next to that monster display will be a pad of engineering paper, and a pencil.

    A big plasma TV on the wall, perhaps displaying video conferencing.

    No guarantees on where the computer is - probably nowhere to be seen.

    Perhaps a PDA or remote storage device capable of wireless networking.

    That's the future. What's on the screen will probably look very much like what is there now.

    --
    ..don't panic
  12. Absolutely, positively the wrong metaphor. by shmlco · · Score: 5, Insightful
    Flat screens of documents are just fine. We just need smarter organizational and retrieval tools.

    3D? Okay, visualize trying to find a real piece of paper in a box in a 20,000 SQFT warehourse. Now, if you want to wander around a virtual 3D space doing the same thing like a rat in a maze looking for the cheese, feel free.

    So, to my mind, 3D organizational spaces are the wrong direction. Spotlight and Google Desktop are the first steps in the right direction. Why should I have to organize my work and documents into trees of folders and project hierarchies? Why add keywords when the computer should understand context? Shouldn't the computer be able to do that kind of scut work?

    Picture the perfect assistant. "Donna, find that claims letter I sent to Bob last week... no... no... yeah that one. Scroll down... down... okay. It's approved. Attach the current spreadsheet and forward it to Dave. Oh, and let me know if he has any changes."

    Now, picture "Donna" as your automated, computerized, super-assistant, with whom you can communicate by voice from anywhere, anytime.

    Live with a program like Spotlight for a while, and you start to find yourself bypassing the Finder and Desktop and folders altogether. What's needed is a better way to communicate (voice), and a system smart enough to know who Bob is, who Dave is, what a claims letter is, understands "last week" as a variable period, and can put it all together.

    Yeah, it's the Star Trek interface.

    --
    Any sect, cult, or religion will legislate its creed into law if it acquires the political power to do so.
    1. Re:Absolutely, positively the wrong metaphor. by TheJorge · · Score: 3, Interesting

      Ah, all that would be well and good. But what if the computer recognized that by "last week" it might include a couple days before or after the seven day period ending on the previous Saturday, particularly if there were no claims letters sent to Bob or Robert or Rob strictly "last week". And by "current spreadsheet", you don't mean the excel document you have open, but the up-to-date sheet of claims information your company has on record. Though when you refer to the "current spreadsheet" in 5 minutes, you'll be talking about a completely different document.

      Picking up context to apply to keywords in a document or "reading" a document isn't difficult. Actually applying context to natural language and making accurate decisions about them is what's useful.

      And of course, I'd much prefer, "I've got the claims letter you submitted to Bob last week-- it's approved. Shall I attach the current spreadsheet and forward it to Dave? I'll let you know if there are any changes..." but that might be asking a bit much. For now.

      With the Enterprise computer able to do so much, why were these lowly human controlling it?

    2. Re:Absolutely, positively the wrong metaphor. by jacksonj04 · · Score: 3, Interesting

      I know this is suicide on slashdot, but take a look at the WinFS PDC demo.

      --
      How many people can read hex if only you and dead people can read hex?
    3. Re:Absolutely, positively the wrong metaphor. by Hurricane78 · · Score: 3, Interesting

      Have you ever held a speech for 8 hours in a row? You don't want to do that. Believe me.

      Okay, we can say that what we need is something that *fast* in usage. There are only a few "interfaces" of you body that are on a thing you could call the "fast lane" we humans have in our brains. These are mainly the hands and the speech system (mouth and throat muscles).

      So those two interfaces make sense, but using speech only makes sense if you use all informations avaliable, meaning mood/emotions and the subtile "meaning" in how it sounds.

      Else you can stay with the hands.

      Or even better: combine them.

      But the best would be of course a direct neural adapter. ;)

      --
      Any sufficiently advanced intelligence is indistinguishable from stupidity.
  13. Asymptote? by Julian+Morrison · · Score: 4, Interesting

    I think we're already approaching an asymptote in desktop UI. Future interfaces will be faster, smoother, have live raytraced shadows and hardware transparency and blah, but they'll be basically the same windows and mouse thingy as they have been for the last decade and a half. The big shift won't be better general UI, it will be a trend away from general UI and towards a profusion of single-task small devices with custom UI. Example, ipod. Another example, satnav units for cars.