Slashdot Mirror


The Future & History of the User Interface

An anonymous reader writes "The Mac Observer is taking a look at UI development with lots of video links to some of the latest developments in user interfaces. It also has links to some of the most interesting historical footage of UI developments, here's one of the 1968 NLS demo. From the article: 'Sadly, a great many people in the computer field have a pathetic sense (or rather ignorance) of history. They are pompous and narcissistic enough to ignore the great contributions of past geniuses... It might be time to add a mandatory "History of Computers" class to the computer science curriculum so as to give new practitioners this much needed sense of history.'"

23 of 249 comments (clear)

  1. Multi-touch by identity0 · · Score: 5, Interesting

    The multi-touch interface demo on Youtube was interesting, I saw it a while ago.

    The thing that makes it different is how casual the interaction is compared to file & image programs today. You see the guy just touch the screen and rotate, zoom, and move images around and organize it, instead of opening up dialog boxes, secondary windows, or menus to access the functionality. It's very basic stuff, but you see how powerful it is, kind of like how Google Maps is compared to the old static kind of online maps.

    It's like today's image programs are concerned with precicely doing something like zoom to exact levels(%100/%50/%33/etc), but this programs let you do it to "whatever zoom feels right", without worrying you with the details.

    Hey speaking of which, I wish cameraphones had a much more fluid interface for picture organization, so I can add keywords, associate it with people on my contacts, etc... but what do they care, as long as they make money off the ringtones :(

    1. Re:Multi-touch by srblackbird · · Score: 2, Interesting

      http://tedblog.typepad.com/tedblog/2006/08/jeff_ha n_on_ted.html

      There you go :)
      Don't forget to view the other TED talks!

      --
      "The test of the morality of a society is what it does for it's children." -Dietrich Bonhoeffer
    2. Re:Multi-touch by bunions · · Score: 2, Interesting

      100% agreement.

      A lot of the limitations on the UI stems from the hardware we use to talk to the computer. The multitouch stuff is awesome, and if/when we see some hardware support, you'll start to see some very, very interesting new stuff.

      As much as I hate 'media' keyboards, if they were just standardized I'd be very happy. I'd love to have several software-configurable scrollwheels and sliders. Universal out-of-the-box support for secondary/tertiary/n-ary small LCD displays would also be nice.

      --
      there is no need to sign your posts. this isn't usenet. your username is right there above your post. stop it.
    3. Re:Multi-touch by Stalus · · Score: 2, Interesting

      Honestly, I think the reason things like the multi-touch display is that we're too focused on having a single device for everything - or rather the price point isn't low enough yet not to. A vast majority of what people do on their computers is generate text... word processing, e-mailing, IMing, etc. That multi-touch display is no replacement for a physical keyboard. Yeah, you can pop one up on screen, but how many people have you heard complain about a keyboard just not feeling right? While such a display might be nice for art, photos, mapping, etc, it would be awful for what most people do most of the time, and businesses aren't going to sink money into that.

      Another downside to such a display is that it would be physically stressful for prolonged use. There's a reason we train ourselves to touch type and use keyboard navigation. I'm not too thrilled by the idea of my primary interface being one that requires large arm movements.

      Despite all that, the other reason UIs don't change much is that what people seem to see as UI advances just complicate the UI rather than simplify it. I love how the AI word spends all of their time trying to reduce dimensionality, and the UI world is always trying to increase it. Keep it simple! A cooler looking, higher dimensional UI is not necessarily a better UI.

    4. Re:Multi-touch by Eideewt · · Score: 3, Interesting

      I think you're selling multi-touch displays short. While I agree that a device doesn't have to do everything, it's clear from the number of people who are dissatisfied with human-computer interfaces that the things they do could be done better. You're also underestimating the amount of mousing that people do. Touchscreens are no replacement for the keyboard, but they are a good replacement for the mouse (except maybe in FPS games, a special case).

      Computers have a few things they do well: accept textual input, display data on big screens, and multi-task. From those it follows that anything graphical or textual is a good fit, and that while "one device to do everything" is a bad idea, one device that does many things that it happens to be good at is a great idea. For example, it's extremely common that a person wants to access the web while working on a project. It's better to have one device that can help you gracefully juggle everything you're trying to do than to have a typewriter, a web browser, a CD player, your clock, a "download machine" and a telegraph key (for IMing), each with its own chassis, competing for desk space. Up to a point, combining functions makes sense.

      Computers also do one thing very badly: they don't accept input from anything other than a keyboard very well. Specialized fields do have devices that work well: graphics tablets for graphics artists and MIDI keyboards for composers, for example. The driving force behind multi-touch displays is that the "interface for the rest of us", the mouse, is a difficult and inefficient thing to use. We all have ten built-in pointing devices which we can use with aplomb -- some people even manage to use their toes as a few more -- and multi-touch displays are a way to make use of those. Much as I dislike the desktop metaphor, I must invoke it here: using a mouse to interact with a computer is akin to using a single stick to push your papers around on your desk. It's just not the best way to go about it.

      I very much doubt that it would be stressful to use a multi touch display for a long time. In fact, I suspect that it would be much less stressful than making the constrained motions required by a mouse. Joints are *made* to move. It might still be a little exhausting at first.

      I agree that UIs are best when they are simple... but simple is in the eye of the beholder. To me, a UI that allows me to use my skills in a direct way is a simple one. Using my fingers to move on-screen objects = simple to me. A complex UI is one that requires me to perform actions in ways that take more effort than the direct way. The direct way is the way I would do it if I were manipulating physical objects. For example, menus (especially nested ones) and window managers that don't (i.e. I have to drag and position windows myself, when the window *manager* should do it) are complex to me. Above all, attempting to convey a huge variety of instructions by pushing a box around and clicking buttons on it is complex, because it adds another layer I have to work through. If I ever my my GUI fairy godmother, I'm asking her for a laptop with a touch screen. Maybe a multi-touch screen if she looks generous.

  2. Creaky and old fashioned? How about useful. by posterlogo · · Score: 5, Interesting

    FTA: The current state-of-the-art User Interface (UI) we've been enjoying has remained largely stagnant since the 1980s. The greatest innovation that has been recently released is based on video card layering/buffering techniques like Apple's Expose. But, there is a large change coming. Rev 2 of the UI will be based on multiple gestures and more directly involve human interaction. Apple is clearly working in the area as some of the company's patent filings demonstrate. Nevertheless, these videos might make Mac (and Windows) users experience a huge case of UI envy, as a lot of UI development (in XGL in particular) makes the current Mac UI seem creaky and old fashioned.

    The guy seems to think that the stagnation of the UI is an entirely bad thing. It seems to me that when something works well, people like to stick to it. I really don't think the majority of people need multiple desktops floating around let alone a brain interface. The only widely practical new UI technology I saw was multi-touch interactive displays (or touch screens in general, though they have been around for a long time and are still not very popular). As far as his comment that the new-fangled UIs make the Mac seem creaky and old, well, that's his opinion I guess. Some would just say the Mac UI is useful as it is. Even some of the new features in Leopard seem unnecessary to me. It's never bad to innovate, just don't automatically assume every new cool thing is practical or useful for most people.

  3. Assuming that I won the lottery tomorrow... by MarcoAtWork · · Score: 3, Interesting

    ... and I could stop working and go back to university to get another degree full time and end up into research, where would the state of the art of the UI/human-computer-interaction field be? which degree would one want to pursue? where?

    I've always been fascinated by HCI but have yet to be able to pursue this in a work-related setting (where I tend to write backend code, basically as far away from users as you could possibly get).

    --
    -- the cake is a lie
    1. Re:Assuming that I won the lottery tomorrow... by kbielefe · · Score: 2, Interesting

      We have some human-machine interaction specialists where I work. I know their educational backgrounds are varied, but I'm not sure what the basic requirements are.

      We make military aircraft, so they are concerned not only with the computer interaction in the cockpit, but also with the positions, labels, and feel of switches, knobs, controls, instruments, ejection buttons, etc. For some reason quick and reliable person-machine interaction is considered important when people are shooting at you. (Haven't we all been tempted to motivate certain Microsoft engineers the same way at one time or another?)

      It's a lot of fun to go down to the simulator and watch these guys work, but I know there is a lot of tedious work in between the simulator "play" time. Just don't limit yourself to desktop computers when you think about possible careers in the field.

      --
      This space intentionally left blank.
  4. Re:Creaky and old fashioned? How about useful. by megaditto · · Score: 2, Interesting

    Reminds me of Alice in UNIX land. An oldie but a goodie.

    What I am still waiting for is multi-pointer capable x11 (two mouses) and pressure-sensing mouse buttons.

    --
    Obama likes poor people so much, he wants to make more of them.
  5. Re:Overlapping windows by mcrbids · · Score: 2, Interesting

    Your points are interesting. But they have already been largely mitigated!

    1) Your points on overlapping windows is interesting. But KDE already addresses that. When I open a new window in KDE, it opens the new window over the area of greatest unused space. Overlapping continues, but as unobstructively as possible. Contrast that with Windows' means of opening windows about 1/4" below and to the right of the previously opened window, which almost assuredly wastes as much screen real estate as is possible.

    2) Can't comment on shortcut keys and internationalization, other than to state that most programs let you customize this.

    3) Multitudes of widgets with overlapping functionality. Care to elaborate?

    4) "Jumpyness" is more natural! When you flip pages in a book, you go from one page straight to the next. It doesn't "slide", you flip it and that's it. How is page up/down any different?

    --
    I have no problem with your religion until you decide it's reason to deprive others of the truth.
  6. Intuitiveness by FlyByPC · · Score: 3, Interesting

    Amazing how naturally he uses the mouse -- back in 1968!

    --
    Paleotechnologist and connoisseur of pretty shiny things.
  7. Re:I'm outraged! by Tackhead · · Score: 4, Interesting
    > Where are the glorious UI innovation like Clippy and Microsoft Bob?

    On the shitcan of history, like the unreadable choice of default font on Slashdot, the Star Wars Galaxies NGE, the changes to Yahoo's stock message boards, and two recent changes to Google Maps, one of which has made broke printing impossible (users are now reduced to taking goddamn screen captures and printing those!), and and another one that auto zooms and recenters, instead of merely re-centering the map, on double-click, making navigation a time-consuming process of setting a desired zoom level, clicking to recenter, slowly loading a bunch of tiles you don't need, then unzooming back out, and loading yet another set of tiles.

    In each of these cases, user feedback was nearly universally negative, and yet the "improvements" remain in place.

    If this is UI innovation for Web 2.0, give me Web 1.0 back.

  8. self study as elective was denied by cadience · · Score: 4, Interesting

    I graduated in 2003 with a BS in Computer Engineering and a BS in Software Engineering.

    During my studies I proposed multiple times to do an independent study of the history of the computer field to count for 3 credits of my general electives. I was denied every time, even with support from the head the Engineering department. The liberal arts department continually stated that the purpose of the electives is to gain breath in knowledge. I finally took a (very interesting) class on Greek mythology.

    I agree with the premise of increasing knowledge, but not the implementation. The college should encourage independent research when a student can blend his primary interests to meet a "credit based requirement".

    What are your thoughts?

    Understanding history of your profession should be as important as understanding your culture and your history. Your profession will become a part of who you are as well! Without context, you're clueless.

  9. Useless Crap by Anonymous Coward · · Score: 1, Interesting

    I looked at those videos, and most of the time the operator is spinning the damn cube, or waving a window.

    Now you tell me, how much time are you going to spend doing that? I turned off the XP menu fade-in right from the start.

    How about some useful stuff that actually helps organization, like virtual desktops did - a rather simple and cheap trick that didn't require everybody to upgrade to the latest octo-GPU CrossFile SLI-ed system.

  10. Re:Nobody's paying attention by Lugae · · Score: 3, Interesting

    I have two more:

    1. The gas pump that once you pick up the pump the prices disappear asking you to "Select Product."

    2. The ATM that the button that you used to press "Withdrawl" on the next screen would withdraw $200. Shouldn't that go to the smallest amount or a "Go Back" button?

  11. MUD and MMRPG players know ... by cpu_fusion · · Score: 3, Interesting

    That the biggest UI change yet-to-come has to do with moving from a single-user desktop metaphor to a collaborative virtual space that leverages a lifetime of perception of the real world. When computers evolve into a more transparent role in our life, layering this digital world on our physical world will be next. It's coming sooner than we think, will we survive that long though?

  12. Whatever the next UI is, it won't be "intuitive" by Dr.+Zowie · · Score: 5, Interesting

    Several years ago I had the delightful privilege of talking about interface design with Jef Raskin (who designed many aspects of the Macintosh UI).

    He pointed out that "the only intuitive user interface is a nipple."

    Several days ago my wife and I had a new son, so of course I watched them learn (together) how to breastfeed. It was not obvious to either one of them how to make it work -- they had to explore and figure it out together.

    It appears that Jef was wrong: even nipples are not an intuitive user interface.

  13. Re:I'm outraged! by pilgrim23 · · Score: 2, Interesting

    Clippy came out of Bob, Melinda saw that it was good. But seriously though, about that same time period was the dawn of CDROM as a media type. Many magazines shipped with CDs, and each had a GUI. The gamer mags in particular had various custom GUIs for selecting their content. Some were based on shopping, some on Office or Home (ala Bob) Some on really weird stuff (Anyone remember the elevator ride to hell on old PC Gamers?). It seems those were some real free wheeling days of UI development, but none of that seems to have gone anywhere.

    --
    - Minutus cantorum, minutus balorum, minutus carborata descendum pantorum.
  14. Re:Two mice. by MadEE · · Score: 2, Interesting
    Seriously. Most of that stuff can be done with two mice. Why hasn't anyone implemented that yet? Just grab the image from the ends and drag to resize, or drag one end to rotate, or whatever. Two mice would be much more natural. Sure, you'd probably use the one in your good hand more, but for some stuff it would be great (perhaps handling 3D models?).
    It probably hasn't been implemented yet because it would be quite confusing to keep up with which pointer does what. There isn't that problem with these displays as the pointer is under your finger and it's hard to lose. But there are a bunch of advantages to this over 2 mice, the most obvious being it allows more then 2 pointers. The second the display could allow physical tools to be used on the display instead of simulating the tools. Third it's touch sensitive allowing command modifications by force. I have to disagree with it being more natural, how more natural can you get then actually touching the object on the screen the only thing I could think more natural would be touching the physical object itself.
  15. Re:Overlapping windows by grumbel · · Score: 2, Interesting
    I don't like working that way personally, and I suspect the reason we've moved away from that model is because most people don't. Remember the early Windows versions?

    I think the throuble with tiling is that it simply doesn't work that well as a generic concept, there are simply to much applications around that are just to small to make sense in a tiled workspace, ie. a small calculator should overlap, not tile, since else he can't be seen in full and wastes a lot of screenspace. However in Blender or Emacs tiling works great, much better then MDI solution which present windows in a window, this is probally because Blender and Emacs deal with one kind of data only and don't have to work with hundreds of different applications which made have wastly variing requirements.

    However, while tiling has a fair share of problems, our way to manage windows is also far from optimal, there is a lot of time wasted with moving windows around and aranging the screen in such a way that it is actually usable Apples Expose helps a bit, but real solution is probally to move to a fully zoomable desktop, so that one isn't restrited by screen borders, but can simply zoom out when more space is needed. This also helps a lot with orientation, since you can simply place everything side by side and still reach it and don't have to lower/raise yourself through a stack of windows.

    It's not reasonable to expect such mnemonics, input through an alphanumeric keyboard, to work any other way -- unless you can think of a better one where alphanumeric input is both easy to remember and language-independent. Good luck.

    How about an LCD Keyboard that actually displays those shortcuts so that you don't have to type them blindly in the first place? Might of course still take a while those are actually available and affortable, but the problem with shortcuts is certainly solvable in a better way.

    I remember when some word processors and the like included a "smooth scrolling" option. No one used it. It turned out that most people wanted the screen to scroll quickly instead.

    That isn't because smooth scrolling is a bad idea, but because it simply was badly implemented. Now I don't necesarily blame the developers for that, because some things simply can't be implemented well with todays hardware, ie. when I press down I don't want the screen to scroll automatically for half a second, thats just not really a good way of doing it. However I also don't want the screen to just jump around, since that is extremly disorientating. So what could the solution be? How about a pressure sensitive scroll button, the harder I press the faster it scrolls and scrolling both starts instantly when I press and stops when I depress. Or how about a scroll wheel that actually scrolls smoothly instead of just sending up/down events on every click?

  16. Not tame users, tame designers. by Kadin2048 · · Score: 2, Interesting

    I don't think it's that you "can't get people to convert," it's that the designers haven't come up with a compelling reason to get people to abandon what they know. Someone who's worked with a mouse+keyboard, desktop-style GUI for (in some cases) 20 years or more, isn't going to completely retrain themselves without a darn good reason. Right now, there aren't many compelling reasons to switch.

    In essence I'm agreeing with you; there certainly haven't been very many really radical designs, and because of that, there haven't been many designs that really offer the average user that much more benefit over what they're using now.

    Offer something significantly better -- enough to cover the retraining cost -- and people will flock to it. There's nothing particularly enjoyable for most people about using a QWERTY keyboard and mouse, it's just what they're used to because it's "good enough." Come up with an interface that lets people enter data as quickly and accurately as they can with a keyboard, and move objects as easily as they can with a mouse, and view and comprehend data as quickly as they can on a monitor, and -- like my grandmother used to say about building a better mousetrap -- people will beat a path to your door. It's just that to date, nobody has really built that better system; at least not that I've ever seen.

    Designers seem hesitant to go 'outside the box' because they percieve users as being tame, but really it's the users who are cynical about new designs, because most of them are nothing but lame rehashes; "difference for the sake of difference," which throw away optimizations painstakingly made over years (or in some cases decades) without offering much new. It's not until designers really go outside the box that they'll stand a chance of finding a Better Way, and when they do, the users will follow.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
  17. Re:Overlapping windows by CaptainCarrot · · Score: 2, Interesting

    You make some interesting suggestions, but there are practical issues.

    Take your example of a stovetop. Your observation is a fairly obvious one, but the obstacle is that there isn't room for the knobs to be placed in a square, due to other overriding design considerations. That's why almost no one does that. There is instead a conventional arrangement that is the same from stove to stove, so you only have to learn it once.

    That's one reason the current arrangement of shortcuts would be difficult to change. Everyone knows that <ctrl-o> is Open, <ctrl-s> is Save, etc. If someone decided to do it differently, he'd be bucking the trend of literally thousands of applications and is not likely to be successful. He'll probably just piss off his users instead.

    You dismiss the non-intuitive aspect of this with a simple "but", but I assure you that intuitiveness is very important to users. They prefer intuitive over rational every time, and they don't want to have to be "power users" to take advantage of what should be a simple feature.

    Your idea about the numbers will not only not work for menus with more than 10 items, it would be very annoying for the many applications where the menus are user configurable. Every menu rearrangement would also change the shortcuts. I can't see anyone being happy with that. However-- please note that where you can customize menus, you can also customize shortcuts. Why not do that if you're unhappy with the default arrangement?

    But mapping shortcuts graphically in any meaningful sense obviously can't be done. At that point it's no longer a shortcut -- it's the GUI you were trying to short-circuit with the shortcut in the first place! The fact is there must be some mnemonic or some other very easy-to-remember system, or it simply won't get used. Users always take the simplest path. A shortcut is supposed to be simpler for often-repeated tasks once you're only moderately well-versed in the software. Make it too complex, and it will no longer be simpler than selecting from a menu with a mouse.

    I think a more sensible hand-balancing arrangement for alt-tab would be to keep the key combination with the left side and let you select one of the windows with the right. It surprised me trying it just now (it hadn't occurred to me before) that Windows will not allow you to do this even though you get something that looks like a box full of icons to pick. I seriously doubt most people are interested in (or able to unless they're twitch gamers) to "instantly" hit a number key on being presented with an entirely novel menu. In any event, there's no reason to free up the mouse cursor for repositioning since the most likely target (the window you're trying to switch to) won't be available until the switch is actually made. There's no place to move it to.

    So pay attention to your HCI class. I never took one myself. I'm just speaking from about 20 years' experience in writing apps for users who are often sitting in the same office. When they don't like something about the UI (graphic or otherwise), I get instant feedback.

    --
    And the brethren went away edified.
  18. get a simpler microwave by cyclomedia · · Score: 2, Interesting

    mine has two dials:

    1. power
    2. time

    to start it you close the door, to stop it you open the door or ding the time dial yourself

    though they are getting harder to track down. Why my toaster needs 5 buttons as well as the time dial i will never know, presumably they'll be getting clocks soon too.

    --
    If you don't risk failure you don't risk success.