Slashdot Mirror


Usability Testing Hardy Heron With a Girlfriend

toomin writes "Reviews of the latest Ubuntu version, 8.04 Hardy Heron, are everywhere, but most of them are undertaken by geeks familiar with Linux. This guy sits his girlfriend down at a brand-new Ubuntu installation and asks her to perform some basic tasks. Some of them are surprisingly easy, others frustrate and annoy. There are lots of little usability tweaks he stumbles upon just by seeing the desktop experience from the point of view of the mainstream user."

22 of 846 comments (clear)

  1. Smart move by caution+live+frogs · · Score: 5, Insightful

    That's how user testing should be done. It is really much too difficult for someone familiar with the program or OS to see what is not obvious or confusing to a novice user. The people that program the UI don't always think like a user - they usually think like a programmer, and that doesn't always work.

    1. Re:Smart move by Bombula · · Score: 5, Insightful
      What is positively astonishing is how persistent this problem is. Look back at the thousands of linux threads over the last 10 years, and you will see the SAME complaint again and again, and again. And again. And AGAIN. It is farking ridiculous.

      How hard is it to sit down and run a simple test like the (excellent) one this guy did with his girlfriend for every release?

      To Ubtunu's credit, most of the fault lies with the applications and not with the OS itself. Well-designed apps like Skype make things simple and intuitive for new users. But Ubuntu itself could develop specs for developers that required basic intros, wizards, etc for introducing and explaining the simple but non-obvious stuff to new users. Conversion rates would then skyrocket.

      Again, there is no logical reason why this hasn't been implemented before. The only explanation is therefore stupidity on the part of the developers - both on the OS and the app side. Cue the irony tag, given how clever most of these folks like to think they are. I guess what it shows is that being a math jock or code monkey with a stratospheric IQ doesn't make you a good UI designer any more than it makes you a suave and charming socialite.

      --
      A-Bomb
    2. Re:Smart move by h4rm0ny · · Score: 4, Insightful


      It is a good article. But we might be seeing early stages of a conflict between friendliness and elegance. For example, I was annoyed when I upgraded to Hairy Hardon that it had decided I needed folders called Documents, Music, Pictures etc. in my home directory. A couple of the things suggested had less to do with usability than they did to do with familiarity to someone brought up on Windows. I don't think Linux environments should be so keen to emulate the Windows environment. It's a short term benefit with long term consequences. And even the short term benefit is a small one - look at the later iterations of Office: built around the concept that you don't need to read instructions, that everything should immediately be self-explanatory. A noble goal, but not one possible to reconcile with utility. I think I would rather a short, well written Introduction to Ubuntu than try to make everything look like Windows.

      --

      Aide-toi, le Ciel t'aidera - Jeanne D'Arc.
    3. Re:Smart move by grm_wnr · · Score: 5, Insightful

      No, it doesn't. I fact, it is a already a huge advantage that she did not have to install Ubuntu (Note: It's not that installing Windows is easier, but people do not install Windows, they buy computers with Windows on them. This is a real problem that no amount of whining about the unfairness of it all will make go away.) Now, imagine if she had the wrong wireless chipset; 0/12 points right there, instantly.

    4. Re:Smart move by KutuluWare · · Score: 5, Insightful

      Not really. The goal isn't to make Ubuntu "as easy to use as Vista". The goal is to make Ubuntu "usable by everyone". Comparisons to Windows will only invite the subconscious tendancy to stop when Ubuntu reaches parity, no matter how counter-intuitive it may be.

      Doing things the "Windows way" is frequently easier because people are familiar with it, in which case it makes sense. But there are plenty of things Windows gets way wrong that Linux can get right.

    5. Re:Smart move by Bonobo_Unknown · · Score: 5, Insightful

      Who cares?
      The aim is to make the Linux desktop experience better, not to justify it's failings as somehow being ok because it's just as difficult to use as windows.
      "Easier than a Mac!" That should be the mantra, not:
      "Windows is just as crusty!"...

      --
      We don't believe in radical loony monotheistic religions from the middle east -- we're Christians.
    6. Re:Smart move by Bonobo_Unknown · · Score: 4, Insightful

      I think I would rather a short, well written Introduction to Ubuntu than try to make everything look like Windows. No-one that should read said introduction will read said introduction. You won't either, but I'd hazard a guess that you don't need to.

      Looking like Windows / intuitive operation and user friendliness are distinct concepts but they all meet at a nexus.

      If a metaphor works, is understood, and is in common use, why change it?
      --
      We don't believe in radical loony monotheistic religions from the middle east -- we're Christians.
    7. Re:Smart move by Xacid · · Score: 4, Insightful

      I've heard this same argument for years and really it just sounds like whining to me. The linux community tries in a lot of aspect to stray far far away from Windows out of principle yet fail to impliment the things Microsoft actually got right.

      The typical user should not have to open up a term window to install a program. It should be click and guide you through the rest. That was always my biggest complaint. Sure I could fire up some synaptic or whatever it was but that's not exactly intuitive - I had to have a nix friend of mine tell me it even existed.

      Linux, nor Ubuntu, will thrive as a dominant OS as long as users like "Erin" still have trouble figuring things out.

      Ok, so don't take things from Windows - but figure it out from the Apple OS. Even granny can use those.

    8. Re:Smart move by malevolentjelly · · Score: 5, Insightful

      Well, Windows has 91% of the OS market share.

      At this point, you need to win those people over by offering an easy experience. At first, people will treat it like Windows. After a while, people will eventually treat it like Ubuntu. Linux still has a hold over userbase from the DOS world where men were men and functionality was won through hard labor.

      This probably occurs when people switch to mac as well.

      But you are right- if Ubuntu ever matches Windows' functionality or market share, they will probably slow down in usability development. Like most open source (and closed source to a lesser extent) it grows through mimickery.

    9. Re:Smart move by Russ+Nelson · · Score: 4, Insightful

      When people say "intuitive", they really mean "familiar" -- Jef Raskin.

      --
      Don't piss off The Angry Economist
    10. Re:Smart move by Blakey+Rat · · Score: 4, Insightful

      This coming from a person who still doesn't quite get the concept of "variable-width fonts" and "text-wrapping."

      The only thing that is "intuitive" is a nipple.

      Could we retire this tired old phrase, please? Not clever.

      The notion of installing new Windows apps through the
      control panel would make perfect sense if the relevant
      control panel app did what it's name implies.


      Yes, well, that was part of the point wasn't it? You can improve on the things Windows gets wrong (which is frankly a lot of things), you don't have to be a perfect clone of Windows. The point is that you should be *at least* as good as Windows, and right now software installation on Linux isn't.

      This is one of those areas where Linux really excels
      but not insisting on being some sort of Windows clone.

      A distinct product is going to have some meaningful
      differences, imagine that.


      Yes. OS X and Windows have differences because they came from different multi-tasking philosophies... Macintosh apps were designed (back in the 80s) to take over the screen so that you were using one application at a time. Thus, current Mac applications share the same menu bar at the top of the screen, and its content changes as you change the current app. Windows was designed differently, so it works differently.

      It's a meaningful difference. And yet both Windows and OS X are more usable than Linux.

      What the Linux community needs to do is to take the best from Windows, the best from OS X, and then improve on that. It especially needs to stop constantly comparing itself to Windows, and judging itself on its own merits. As a Mac-user, it bugs me that both major Linux window environments are complete rips of Windows.

    11. Re:Smart move by Anonymous Coward · · Score: 4, Insightful

      >> The only thing that is "intuitive" is a nipple.
      > Could we retire this tired old phrase, please? Not clever.

      It's not only not clever, it's not even correct. Babies need to learn to nurse, and it's the first sign of developmental problems when they don't learn it quickly.

    12. Re:Smart move by SanityInAnarchy · · Score: 4, Insightful

      What, KDE?

      The same KDE that uses single-click everywhere by default, that has an optional Mac-style menu bar... The same that, on Ubuntu, has a clearly OS X inspired control panel... That KDE?

      And you're confusing "usability" with "discoverability". Discoverability is important for the first hour or two of using an OS, maybe the first few days. Usability is important for the rest of your life. I'm glad Ubuntu focuses on the latter.

      --
      Don't thank God, thank a doctor!
  2. Re:Exceptionally good. by 4D6963 · · Score: 5, Insightful

    2) Watch youtube. Unsuccessful. No Flash.
    11) MSN. Unsuccessful

    Yeah well, I have a girlfriend too, and all she ever does on a computer is watch music videos on YouTube, write e-mails and chat on MSN. Maybe you'd like to weight your rating based on how important something is to the person tested (by asking them). Downloading a torrent and changing your mouse speed will probably rate to 0 while MSN will probably rate to "Why the hell would I need a computer if not for MSN?".

    --
    You just got troll'd!
  3. Re:No Windows Clone by grm_wnr · · Score: 5, Insightful

    And most people would rather stay with XP instead of moving to Vista. Just like they'd rather stay with XP than moving to Ubuntu.

  4. Re:Exceptionally good. by Barny · · Score: 4, Insightful

    Yeah, have had that problem with YouTube on ubuntu as well, and it only happens if YouTube is the first site you go to, they fubar their refer to adobe.

    If she had of gone to, say, ANYWHERE else first it would have been fine and just popped up with a bar saying "i can haz plugin?", say yes and bam, its all good.

    Long and short, it should have flash already on it.

    Oh and she was lucky it was the 32bit version, installing and using skype is pretty hard when there ain't a 64bit binary available for the platform (last time I looked anyway).

    --
    ...
    /me sighs
  5. Re:Exceptionally good. by grm_wnr · · Score: 4, Insightful

    >she should have read the release notes

    Ahaha, good one. I thought the very point of this exercise was that users do not behave like developers expect or would like them to. Reading release notes is certainly among the things they rarely ever do, and so this hints at Ubuntu doing something wrong more than anything else.

  6. Re:Interesting by nkh · · Score: 4, Insightful
    I can confirm that this is a rather strange world we're living in. My wife wants to switch to Ubuntu (and thus wiping Windows XP from her computer) because of some reasons I had not expected (from my point of view as a hardcore developer):
    • Frozen Bubble is available on Linux, as well as a lot of good games
    • Less viruses than XP, and so no need for an anti-virus
    • Firefox and "MSN" chat are available on Linux
    • Free IT support when I'm available at home
    I know that it may seem redundant but computer noobs switch for very strange reasons and we must listen to their needs if we want Linux to "succeed on the desktop."
  7. It's a fine line... by JustinOpinion · · Score: 4, Insightful

    The article several times suggests that the solution to some of these problems is, essentially, user education: having balloons that signal "new item installed" or wizards open the first time you launch a program, telling you how the program works.

    The problem is that this approach often doesn't work. For one thing, it annoys the piss out of experience users. For another thing, new users tend to ignore most of that information... mainly because they are being overwhelmed by new information and can't possibly assimilate it all.

    Take, for instance, the problem that was encountered when changing screen resolution. The tester changed the resolution easily, but then she clicked the "Keep settings" immediately, which locked her into graphic settings that were hard to change back. Part of the problem, I suppose is that the system allowed the user to make a ridiculous change. But part of the problem is also, perhaps, that the user is very used to clicking "OK" on any dialog that gets in the way: there are too many new things to read and learn, and the easiest way to get things done (in the mind of a new user) is to dismiss those annoying boxes as quickly as possible. Would a second popup, that described in detail why this low resolution was a bad idea (and how to undo it when desired), have changed anything? Doubtful. Most users would just click "OK" without reading it.

    All this to say that I'm by no means convinced that adding more balloons, wizards, and dialog boxes will magically make it easier for users to figure out what's going on. I don't know what the solution is: usability is a tough problem. There is a place for helpful information (balloons, tool-tips, etc.), reminders, and wizards. But too much of this becomes decidedly counter-productive.

  8. That this story even exists is part of the problem by beadfulthings · · Score: 5, Insightful

    Yeah, and it's a huge part. It's the 800 pound gorilla part.

    Testing for useability needs to come in much, much earlier in development, and it needs to involve a much wider cross-section of human beings. And as it's being done, development of adequate documentation and help needs to go hand and hand with it.

    It's so easy to disparage girlfriends, the middle-aged, and the elderly--in short, anyone whose job or study is not technical--that I think it's becoming ingrained in the cultures responsible for developing the various operating-system distributions and open-source software packages. This is going to cause them to suffer over the long haul. It's what makes them such a tough sell to people in business.

    There's an immense population of middle-aged people, for example, still in the work force. And interestingly enough, they've actually now all got 20 or 25 years' experience as end-users of computer systems. They're not stupid. They all have jobs that they need to get done. They're not interested in being part of user communities and forums. They're not interested in the ideals of free and open-source software. They're not interested in sticking it to Microsoft. They're not interested in that warm feeling of accomplishment that until recently accompanied getting your printers hooked up to OpenOffice--after wasting hours of productive time doing it. They're interested in using their computers as tools to accomplish their current day's work.

    Issues of usability and documentation aren't much fun. They're probably the least glamorous and most boring functions of developing the software. That's why they get such short shrift in open-source development. Nobody really wants to take them on, so we're treated to excrescenses like having people guess how to get out to a command line to install their audio player or their scanner or their printer.

    Large-scale developers of proprietary software know precisely where their bread is buttered, and they attend to all this as a matter of course.

    "Girlfriend" articles seem to appear quite regularly every few months, so at least somebody is thinking about this even at a ridiculous level. A lot more people need to be thinking about it at a much more serious level.

    --
    "Here's what's happening. You're starting to drive like your Dad..." - Red Green
  9. Wonderful emphasis by kria · · Score: 4, Insightful

    I'm sorry, but I'm sick of things like this - his girlfriend HAS to be some untutored user who has no clue about computers, tee-hee. As a female computer programmer, should people assume my husband is computer illiterate? No? Then why assume his girlfriend is?

    Isn't it enough to say that the installation was tested with a novice user instead of putting stupid assumptions and implications right in the freaking headline?

    And of course, what kind of replies do I expect to my post around here? People marveling that a woman is posting on slashdot that will be modded up as funny. Given the nature of my post, I also expect some responses telling me to calm down or calling me a feminazi. There, I've taken care of those responses, you can stick to ones that actually address what I've said.

  10. Re:Exceptionally good. by Spudds · · Score: 5, Insightful

    By the time you are telling them "GIMP... which stants for GNU Image Manipulation Program.. GNU is for GNU is not Unix" they lost all interest and just tell you to please resintall Windows. Who the hell would do that?
    If you're talking to a novice you're not going to go into tons of detail about acronyms and such, you're going to say "GIMP does stuff that photoshop does"

    I think your argument is silly.