Slashdot Mirror


GNOME Usability Study Report

pdiaz writes: "Here is a report made by Sun Microsystems people about GNOME usability. They collected a bunch of professionals (lawyers, engineers, Graphic Designers, etc..) and put them in front of a Gnome desktop. They were asked to perform some tasks and tell what some icons, menus, etc., do. Some quotes are really funny, like when they asked what does the terminal emulator icon launch." Very interesting stuff, and this approach is necessary because once you've gotten accustomed to the system it's no longer possible for you to evaluate how it appears to an inexperienced user.

14 of 313 comments (clear)

  1. yep by Anonymous Coward · · Score: 5

    Some quotes are really funny, like when they asked what does the terminal emulator icon launch."

    It is exactly that attitude that makes Gnome unusable to the average PC user. Until that changes, Linux won't make inroads. Taco has already addressed this though. MS spends lots of money doing this kind of thing. The best we have done so far is a cheap rip off of that. We constantly rip on MS for bad software, yet when push comes to shove, we're just trying to give away free versions that look like theirs. It isn't working. This is an important first step in usability testing for Gnome. KDE would be wise to do the same, though they are probably about a decade (maybe a little less) ahead of Gnome in usability. Gnome could/can catch up by doing things like this. KDE can't remain idle, and MS won't remain idle.

  2. agreed by mosch · · Score: 4
    Studies like this will help make GNOME as usable as KDE, and maybe some day, both of these desktop systems will make an attempt to create usable UI, instead of simply copying MicroSoft, and calling it innovation.

    For example, why does everybody copy the design that the 'window kill' button should be right next to 'maximize'? That's horrible design, put window kill on the left, maximize and minize on the right.

    Why is it possible to click down on the 'K', move the mouse a few pixels up, release the mouse, and log yourself out. If you have a fast computer, and you use KDE, you've probably done this before.

    GNOME allows an application to use the entire task tray, then when you have two applications, it uses half that size.... and it squeezes down. It's efficient use of space, but it's inconsistent and makes it harder to tell with a single glance what's running. KDE makes good use of the space without this annoying inconsistancy.

    What the hell are these icons? Stop being cute, start being useful. If you're running KDE, hit the K menu now and tell me what the following icons mean 'quick browser', 'bookmarks', 'toys', 'system', 'preferences' (these last two are way too similar), multimedia or graphics. None of those icons gives you any intuitive notion of what you're about to launch.

    Additionally, I doubt I'm the only one who has taken the less-used apps in the menu for each level, made a folder called 'sewer' and stuck them in there. Yes, we're all proud that there are lots of applications now. No, we don't use 90% of them, and having them in our menus just slows us down.

    Things are improving, but it's still terribly ironic, the way copying Microsoft is referred to as innovation, yet when Microsoft copies, that's just plain wrong.

    --

  3. Paricipant 183: by grub · · Score: 4

    "Where's Clippy?" (P183)

    --
    Trolling is a art,
  4. Anything new takes getting used to... by geojaz · · Score: 5

    All interfaces take, well, getting used to in the beginning, this isn't exclusive to computer interfaces. I know that every time I get into one of my friend's vehicles I have to ask, "Hey, how do I turn on the lights? Where is x y or z?".
    That being said interfaces which are reasonable can be adjusted to within a reasonable amount of time. Gnome is certainly something that those of average intelligence with the right amount of time should be able to get down... If they are interested in it and there is some reason to adjust to it.
    So find a reason for people to use Gnome, and they will. (I am not saying Gnome doesn't have a use...)

  5. Usability vs. Transparency by leei · · Score: 5

    In designing systems and user interfaces, it is
    fundamentally important to not confuse two distinct concepts: usability and transparency.

    Usability is directly related to the efficiency of
    performing tasks and the ability to anticipate the
    user interface for new tasks.

    Transparency is the "intuitiveness" of the interface or system. It is primarily a measure of
    how easy it is for a naive user to come into the
    system and get a something done.

    Transparency is intimately related to the experience of the users being examined. In a certain respect, it is a measure of familiarity.
    Unfortunately, you will get high transparency
    scores nowadays if you simply look and act like
    MS Windows.

    Usability is a whole other bag of onions. Some of
    the features of a transparent interface are relevant in assessing usability, but only to a point. While transparency is something critical for new or casual users, it can be almost completely irrelevant to an experienced user. Once a certain level of familiarity is acheived, usable systems are those that make the most common tasks the most efficient to access and provide easy means of aggregating and controlling common
    sequences of tasks. Emacs is an immensely usable
    system that has a very low transparency score.

    It is interesting to note that the Usability Principles in this study seem to be correctly labelled: they *are* related to interface usability. However, the assessment methodology seems to be primarily measuring *transparency*.
    I'd say that this is a basic flaw in the study and
    colors the recommendations highly.

    It would be nice to see someone do a similar study
    but concentrate on the power users and address the
    issues around high performance usability.

  6. don't talk unless you've walked the walk by count0 · · Score: 5
    There's a lot of folks saying "but this isn't how people really use Gnome" or "the comments are insipid"

    Unless you've sat down and observed your interface getting tested with a usability professional or two who work with regular folks to see how the application works *in the real folks non-geek world* then you don't know what you're talking about.

    Really, how can you argue with behavior-based experimental data that "this isn't how people behave"? Oh right - with unfounded 3l337 opinion.

    Sure, there are other things we could do to better test usability - like have them spend a week or two with Gnome after this test, then test again to see how much they picked up.

    but until you're doing testing with your own projects, until you appreciate that these are real people in the real world (that same world you think should use Linux as a desktop OS) then you're really missing the point.

    cz

    see www.usability.gov

    IBM Ease of Use

    The perennial Jakob Nielsen

    Usability Professionals Association

    Webword Usability Blog

  7. Listen to the users! by Mr.+McGibby · · Score: 5

    There are going to be a lot of posts like, "What lusers! They need to RTFM so that they know that 'terminal emulator' actually means command line prompt!"

    This is not what you should take away from a user interface study. This *is* what the users see when first presented with the program. It really doesn't matter what the programmers/designers of GNOME think. If the user doesn't like it, then he doesn't like it! If he can't understand, then he can't understand.

    A long time tenet of communication is that if there is miscommunication, then it is usually the fault of the communicator who hasn't adequately taken into account the audience. If we as programmers/designers aren't using the interface to *communicate* then it is *we* who are failing to communucate, not the audience who is failing to understand.

    Why do you think that MS has slowly moved to simpler and simpler language? People don't need techo-speak to understand what is going on with the computer. Understanding phrases like "illegal operation" requires a bit of underlying knowledge about why such an analogy is being used. So why use it. Just say, "your computer just crashed, but it's okay. Just press that little button on the front of the computer so it can restart. Have a nice day!".

    --
    Mad Software: Rantings on Developing So
  8. People who never seen something else... by chrysalis · · Score: 4

    People familiar with Windows or MacOS will be lost with Gnome, or any new user interface. Because they already know icons, locations, shortcuts, etc. Working on something different needs time.
    My girlfriend never used computers before we met together. And on my computer, there's only OpenBSD, FreeBSD and Linux. I showed her how to log in, browse internet, paint, play music, print photos, etc. Her desktop has icons for main applications.
    And she's not lost. She can use the computer without any help. With Linux, FreeBSD or OpenBSD.
    The last week, she had to work on Word 2000 at her daily job. She was totally lost, found Windows slow and ugly, didn't understand why the word processor had so many complicated buttons and menus, etc.
    So no interface is more intuitive than another. It's just a question of what you are more familiar with.

    -- Pure FTP server - Upgrade your FTP server to something simple and secure.

    --
    {{.sig}}
  9. I can't wait... by stienman · · Score: 5

    I can't wait for all the idiots to start posting, "But they're going to make it just like Windows!!!"

    While the reality is is that not only are 'regular' users familiar with windows, but MS has spent significant resources studying exactly these issues and they are common even to those who are not familiar with windows. Many of these concepts (which the Linux community has shunned for years trying to avoid being like Windows) are going to have to be embraced (and extended) by the Linux community if they are going to gain any mindshare in the population.

    -Adam

    This sig 80% recycled bits, 20% post user.

  10. Thank you Sun! by SpookComix · · Score: 5
    This is *exactly* what has been lacking in Linux development for a long time. Now, with this data discovered, will developers make changes, or will they bitch about the user pool and continue to develop confusing, over-complex, bloated, non-intuitive interfaces?

    Take this ball and run with it, someone! Don't just bitch about how "Microsoft has conditioned everyone to look for a Control Panel!" Who gives a shit? If your intent is to write software for use by the masses, you'd better be damn sure and write it so that the masses will like it and want to use it!

    --SC

    --
    You read fiction? I write it! Lemme know what you th
    1. Re:Thank you Sun! by IronChef · · Score: 5


      I often get the feeling that the Linux crowd wants to convert the masses as opposed to winning them over. There's a big difference between the two.

  11. Re:Kind of sad, by slamb · · Score: 5

    Reading it, the comments seemed to be a lot of things like:

    "This is ridiculous! The start button is a foot? What does a foot have to do with a start button?"

    Read a little further. They gave the participants the very important hint that the foot is the GNOME logo and then:

    "Where everything is; like a start menu like in Windows." (P5, P9)
    "...to go to programs." (P3)
    "...a 'Go' button." (P11)
    "From my previous experience, I'd click there for a list of programs." (P2)

    Their guesses were all dead on. If you didn't know that the footprint was the GNOME logo, you'd be confused, too. Think of all the associations you can make with a footprint. Traveling, history...exactly what they guessed.

    "Whoa? How come the settings are under something called "Settings"?? Where is the control panel?"

    Your paraphrase lost the meaning of the original. Try this instead:

    "'Settings' should be in the control panel...'Settings' is not a program!" (P7)
    "I wouldn't expect 'Settings' or 'System' to be under 'Program'." (P9)

    They were not confused that the settings were in something called "Settings"; they were confused that the settings were in "Programs". Sounds like a pretty valid complaint to me.

    Microsoft has succeeded in making their own screwed up naming conventions the "standard" of computers everywhere.

    No. The users' expectations you've quoted were reasonable and not centric to a Microsoft desktop. You found what you expected to. You completely ignored all the information contrary to it.

  12. Gnome or KDE interface by Rosco+P.+Coltrane · · Score: 4
    I've used Gnome a little, and KDE a lot, so I'm probably biased, but despite the fact that some KDE components are not as well implemented as in Gnome, I still prefer KDE over Gnome by far. So do most of my colleagues (computer literate or not), so does my mum.

    Why ? because the strength of the KDE look-and-feel is that it's a close copy of Microsoft Windows, and this is good for 2 reasons :

    People who can use Windows are not disoriented by KDE (rah rah, old argument, I know ...)

    Microsoft being all about "first user experience" (read glass and chrome on a desktop anybody can use more or less intuitively), they probably spent a ton of money on the design of the Win95 interface, so why not reuse it ? It's far from perfect, but you can be pretty sure it'll be accessible to the mass thanks to M$ money, and KDE reuses all that R&D for free.

    M$ is not stupid, and they've been reusing the same old clunky Win95 interface for years now. IMO, that's because they know for sure it's what flies with the users. So, I like Gnome, it seems solid and well built, but I'm sorry to say, it'll probably lose the GUI battle because its single biggest flaw is its non-M$ look-and-feel.

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
  13. Re:An Idea for a user interface rfc by Eryq · · Score: 4
    I think there was a linux kernel configuration interface that worked much like this, except moreso.... it was reported to be like a text adventure game.

    - Look.
    You see files here. Also, a Trashcan and the Internet

    - Take Internet.
    You can't do that!

    - Drop files.
    Where?

    - Drop files in Trashcan.
    rm -rf /
    Done. 261792K deleted.

    - Ah! Undo! Undo!
    I don't understand that.

    - Get files from backup!
    I see no backup here

    - Get backup from Internet
    It is getting dark. You are eaten by a grue.
    C:\

    --
    I'm a bloodsucking fiend! Look at my outfit!