Slashdot Mirror


Instrumented GIMP To Identify Usability Flaws

Mike writes "New users of the GIMP often become frustrated at the application's unwieldy user interface. Now Prof. Michael Terry and a group of researchers at the University of Waterloo have created ingimp, a modified version of the GIMP that collects real-time usability data in order to help the GIMP developers find and fix its usability problems. Terry recently gave a lecture about ingimp and the data it collects. During each session, ingimp records events such as document creation, window manipulation, and tool use. A log of these events is sent to the ingimp server for analysis. The project hopes to answer questions such as 'What is the typical monitor resolution of a GIMP user?' and 'Is the GIMP used primarily for photo editing or drawing?'"

19 of 416 comments (clear)

  1. representative ? by tregetour · · Score: 4, Insightful

    I like the idea, but will the folks who use ingimp be at all representative of the user population at large? ... Especially of the user population that would complain about accessibility / usability. Is it worth it or is anyone talking about making such a thing an integral part of any project?

    --
    take it easy, but take it.
    1. Re:representative ? by NumaNuma · · Score: 4, Interesting

      This poses interesting questions. Those who are integrated enough to be willing to engage in the ingimp project are very likely to have differing behaviors or preferences. Additionally, one of the chief complaints people tend to have about usability is the inability to do something. By looking at the behavior of actions rather than desired actions, those actions which are easy to do in the current iteration will be seen as more desired, rather than simply more accessible. Meanwhile, those actions which are difficult to preform due to actual problems with the interface will be more likely to be overlooked.

    2. Re:representative ? by jeevesbond · · Score: 5, Interesting

      I like the idea, but will the folks who use ingimp be at all representative of the user population at large? ... Especially of the user population that would complain about accessibility / usability.

      My wife does Web design for University of Waterloo and she's always moaning about the usability of the GIMP. I too am more into design than development these days, so that makes two people who're--more or less--ideal for the task.

      Not to mention we have both customised our GIMP's to look and behave more like Photoshop (the missus was fiddling with the keyboard-shortcuts for ages). It seems this data should be collected in this project, as I doubt we're the only ones who've changed everything to our tastes, the developers should finally realise what people want in an image editor.

      On a related, by tangential, note: GIMP's new core (GEGL) seems to be nearing completion, with that comes all the things people have been clamouring for. Such as non-destructable layer effects, CMYK etc. If they fix the usability and shift to GEGL as the core of GIMP it might finally become the Photoshop killer we've all been waiting for! Failing that Krita is coming along very well as an image editor, it lacks a few features, but is far more usable than the GIMP.

      Overall, I don't think anyone should be saying: 'year of the Linux desktop!' just yet. But this is definitely a step in the right direction. :)

      --
      I'm going to transform myself into a mighty hawk. Either that or I'll just go and work at Dixons, haven't decided yet.
    3. Re:representative ? by Soulfry · · Score: 5, Informative

      Because involvement in human-subjects research is voluntary, there will always be a self-selection bias. However, we can still estimate the representativeness of the population by understanding the types of people likely to download and install ingimp, and those who are not. If you fall in the latter camp -- you'd never want to use ingimp -- we really want to talk to you. Send us an email at the email address given on the site: http://www.ingimp.org/contact.

      In any case, having some data is better than having no data at all. Currently, there is a very active and vibrant group of individuals working on GIMP usability issues (see http://gui.gimp.org/ ). ingimp's data complements this other data to help quantify the ubiquity of behavior/activity/computer hardware setups in the wild.

      Michael Terry

    4. Re:representative ? by Rei · · Score: 4, Interesting

      As someone who began using GIMP before using Photoshop, I find Photoshop's interface to be awkward and GIMP's to be natural.

      Given that a significant majority of people who use GIMP probably used Photoshop first, I wonder what percentage of "moaning about the usability of the GIMP" comes from simple acclimation to a different way of doing things? I'd be interested in seeing the results of introducing one group of people who haven't done any digital graphics work before to Photoshop, another group to GIMP, and seeing how long it takes them to feel comfortable and learn the ropes. Then, you'd have them switch tools and see how well they adapt.

      As it stands, I think we're seeing a lot of selection bias.

      --
      South Park pokes fun at sacred cows to make a point. Family guy pokes cows to hear them moo.
    5. Re:representative ? by Lumpy · · Score: 4, Insightful

      As a person that uses both daily the ONLY part of gimp I dont like is the same crap that all other software pulls.

      From version to version ,dont change where a function or item is. They moved the lighting effects all over the fricking place. and every new version seems like it's a damned easter egg hunt.

      Photoshop does NOT change locations of things very often. (V4.0 compared to V8.0(cs) does have some different locations but not many)

      it's what pisses off every windows user when a new release comes out. "where did they hide function "XXXXX" this time!

      After using a new version of gimp for a few days, it's as usable as Photoshop. Some people lose their mind when they have to do different things in similar apps, I dont. It's like my wife who cant drive the Ford because the wiper controls are different from the GM. I find it entertaining.

      --
      Do not look at laser with remaining good eye.
    6. Re:representative ? by Solra+Bizna · · Score: 4, Informative

      The 'G' in GTK stands for "gimp," FYI.

      -:sigma.SB

      --
      WARN
      THERE IS ANOTHER SYSTEM
    7. Re:representative ? by Skye16 · · Score: 4, Insightful

      But when you're NOT using a multimonitor display, it's a fucking nightmare trying to arrange things in a useable, friendly manner.

      My main "this is fucking stupid" remark is the irritation at having menus for each of the little sub windows. I can handle saying "File->New" on the tool palette, if I absolutely must, but everything fucking else is just wrong, wrong, wrong. Gimp is the ONLY application that EVER does things this way; the only reason I want "Gimp to be like Photoshop" is because at least Photoshop follows the same fucking UI paradigm as the rest of the god damned operating system (or desktop environment). From my novice->intermediate usage of Linux over the years (i.e. I feel comfortable I can install and get Linux to do whatever I want, but it still takes a while sometimes), I haven't found a single fucking program that does similar things to Gimp. I'm not saying they don't exist - I'd be astonished if they didn't, but I am saying the fact that MOST don't work that way is an utterly confusing lack of consistency. If Gimp is so tightly coupled with GTK, and one would assume, Gnome is pretty tightly related to GTK, then you would THINK that consistency across Gnome applications (at least those that come bundled with the vanilla Gnome release) would be pretty in tune with each other. I've not yet seen that to be the case.

      That is what irritates me. Gimp will always be an easter egg hunt for me; I only use it at work since I don't have a ripped off version of Photoshop there. I would be okay with that if the UI were at least similar to other UIs on the Gnome DE. But they're not. Not even close.

      This is exacerbated even more when you consider the fact that I primarily use GIMP on Windows. I realize the GIMP is targeted primarily for Linux distributions, but to expect people to be happy with a UI paradigm that is utterly foreign to their OS of choice (whether Windows or OSX) is at best silly and ignorant.

  2. Representative? by McDutchie · · Score: 4, Interesting

    I already see one potential problem with this approach, and that is that it collects usability statistics from ingimp users, not GIMP users. How would it be guaranteed that the two groups are statistically equivalent?

    (No, I have not RTFA yet.)

  3. Gimp needs to be surpassed by junglee_iitk · · Score: 4, Insightful

    There are far too many anomalies of usability, lack of features and intricacies required for Gimp. Today, Photoshop is the industry leader, and anyone doing serious editing is using it. To be successful, Gimp must surpass it in more than one way (the one way being free). Kind of like what Firefox did to IE. Unfortunately, Gimp is no where ready for that. And I get a feeling that it is (heading to) nowhere.

    I have been using Gimp for a long time. When I first installed Linux it was the only program everyone used to talk about. KDE's kolourpaint was not yet there for general purpose paint-brush replacement. I have used it for years under the hood of open-source fanboyism. And I think that is the reason why it has suffered. It had no competition, and now it is just a software which you don't want to open, again.

    Now, I know it is not a paint-brush replacement. But it is neither a Photoshop replacement... and the middle land is already full of other utilities. Inkscape, Krita, ... may be even Blender. The problem is that no one wants to be in the middle. Utilities need to rise to the top, or they face the fate of XMMS. I hope there will be a replacement in GTK too, just to show Gimp how to use the toolkit :)

    PS: posted this on journal before... this is shameless re-posting.

  4. The main usability flaw I find by LM741N · · Score: 5, Insightful

    is in getting others to use the program because of its name. Lets have a contest to rename the GIMP.

    1. Re:The main usability flaw I find by Laur · · Score: 5, Insightful

      Then who defines what is "stupid" and what is not?
      While I see what you are saying, naming your software with the same name (or acronym) as a derogatory term is pretty stupid by any criteria. Ask yourself, would you use the New and Improved Graphics Generation and Enhancement pRogram? Would you tell your friends about it? Would you suggest it to your boss?
      --
      When you lose something irreplaceable, you don't mourn for the thing you lost, you mourn for yourself. - Harpo Marx
  5. Audio-visuals by kabdib · · Score: 4, Funny

    With cameras and microphones and other things:

    ----

    "Our performance traces indicate large amounts of cussing when images are resized."

    ---

    "Wow. During that file open, three hundred users gave the finger to the camera."

    "And that one guy --"

    "I don't want to talk about that guy. Wahwahwahwahwah I-can't-hear-yoooo. Don't remind me of what he did."

    ---

    "Nine hundred instances of users hitting the computer with a hammer while cropping. At least, that what we think the accelerometers were saying."

    --

    "The rapid rise in temperature was probably caused by the users pouring gasoline on the system and lighting a match. We'll try to address that issue in the next release."

    --
    Any sufficiently advanced technology is insufficiently documented.
  6. Re:GIMP and Photoshop by croddy · · Score: 5, Informative

    For a while, I actually believed the folks that repeated ad nauseum the mantra that GIMP's user interface was difficult compared to their beloved Photoshop. Then one day I sat down to try to do some quick photo edits on a Photoshop box. Two hours later, I gave up on its bizarre layer model and just installed the GIMP so I could get some work done.

    The ease-of-use of a graphic user interface, in general, correlates far more with the user's pre-existing familiarity with the interface than it does with any design decisions of the interface itself. There are certainly areas where GIMP's user interface could be improved, but let's not pretend like it's some kind of embarrassment -- because it's not.

  7. Scary by suv4x4 · · Score: 4, Insightful

    You know, how do you recognize a project is someone's pet project? It's an overcomplicated solution for a problem with a trivial solution.

    Want to find out what makes the GIMP ui suck? Ask the damn users! They won't exactly shy away from telling you.

    I'm a Photoshop user and I have GIMP installed here to use the occasional esoteric plugin functionality. Let me tell you few things you can immediately get busy fixing:

    1. for some reason GIMP developers decided every single thing needs its own window and its own menu bar. It's weird as f*ck: put the entire layout in a single window with integrated panel layout (similar to how Eclipse does it, for example).

    2. each plugin is its own modeless exe dialog that takes arbitrary amount to start after it was called (at which time you can modify the processed image.. sometimes, and sometimes GIMP crashes because of it): create a proper lean plugin API and modal plugin dialog.

    3. the menus and options are all over the place: there seems to be no strategy at all about what goes where

    4. GIMP has really bad startup time, and performance, compared to commercial graphics editors (such as Photoshop)

    5. There's no way at all to organize your layers in a more complex setup: there are no layer groups, layer folder, or anything like that. It's just a big sack of flat layers, that you can select one at a time, and link them together. This is Photoshop 4 level functionality, and most graphics editors are waaaay past that by now.

    6. There are no proper drawing tools in Gimp at all. For a graphics package that claims to be targeted at geeks making icons and web devs making web designs, this is ridiculous. We're forced to fake our ways with selection tools and scripts, which covers only a fraction of what we need.

    7. A personal issue I have with Gimp: no proper grid. I use the grid in Photoshop all the time, set on unobtrusive "pixel" mode, and usually at 8, 16, 32 pixels with subdivisors. In Gimp, no subdivisors, no pixel mode, and for some reason the *mere fast of displaying* the grid, makes everything slow down to a crawl.

  8. SUV / New Coke / added armor fallacy. by Ungrounded+Lightning · · Score: 5, Insightful

    The project hopes to answer questions such as 'What is the typical monitor resolution of a GIMP user?' and 'Is the GIMP used primarily for photo editing or drawing?'"

    Looks to me like they're about to fall into the fallacy that caused Daimler-Chrysler to do a redesign of the Jeep line that killed their market.

    The marketing department looked at what fraction of SUVs were actually used off-road. They came to the conclusion that it was small. So they redesigned their line to be more comfortable on-road at great cost to its off-road performance.

    Turns out that a significant fraction of their market was people who NEEDED the off-road capability - and had the resources to pay for it, reliably buying cars, year after year, through all economic cycles.

    Jeep stopped being the car they needed and became another clone of the rest of the market: "Mall Terrain Vehicles" that LOOK like an off-road car but are really just a funny-looking small/high van that qualifies as a "truck" to escape the fleet mileage regulations. Their guaranteed market went elsewhere and they were in head-to-head competition with a slew of vehicles over which they had no advantage.

    Similarly, Coke looked at all the people buying Pepsi, saw that they were younger and that Pepsi's main difference was that it was sweeter, and replaced Coke with New Coke, which was sweeter yet. Result: People who drank Coke because they liked a less-sweet drink switched to Pepsi.

    And then there was the high-ranking officer in WW II who spent months counting all the bullet holes on the returning bombers, then did a big presentation on how those areas should have armor added. At the end of his presentation a lower-ranking officer asked "Shouldn't we, instead, add more armor to those areas that are only lightly holed? After all, this sample represents only the planes that came back."

    = = =

    I think the same thing could happen here: Paying attention to what people do a lot of just focuses on what you're already doing right - at the cost of ignoring the things that people do occasionally, or only some people do, but which they need to have. Further, the things they do rarely may be used rarely specifically BECAUSE they're hard to use and the interface needs improvement.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  9. Re:GIMP will always be a gimp by Aminion · · Score: 5, Funny

    You can put lipstick on a pig but in the end, you still have a pig.
    ... and that pig will be the object of thousands of zoophiles' hot fantasies! Wait - what were we talking about...?
  10. Fanboyism, user interfaces... by Spy+der+Mann · · Score: 5, Insightful
    Another key to remember is that it's free. That goes miles in my book.

    That is an awful mistake for F/OSS fanboys. "Oh, it's free, so we shouldn't complain". This is like being blind to the problem. If it's free and it works, why isn't EVERYBODY using it? (In other words, why is Mozilla Firefox MUCH MORE popular than the GIMP? Think about it).

    Sometimes we can forget that graphical applications are meant to be used by designers who use most of their time retouching photographs and stuff. Here, time is money. And if the lack of usability in the GIMP makes me spend 5 times more the time than I would with Photoshop (and i'm being considerate), it's just not worth switching. To put it another way, Photoshop's user interface _IS_ worth the price. I still can't believe the GIMP guys CANNOT make something as user friendly (or don't want to, which is worse). It shocks me and frustrates me.

    A quote from a designer's blog:

    You know that Linux is ready for governments and businesses when a 30 day review points out DVD and photo editing as the main weaknesses -- and not because there are no Free Code replacements, but because they aren't quite good enough yet. The reviewer only tried two applications, GIMP and Kino. I share his feelings towards the GIMP photo editor, which I regard as an "old school" Free Code project where the developers would rather tell the users why their program is, in fact, highly usable than conducting serious usability tests and making improvements. To be fair, the existing GIMP user base, which is used to the current implementation, may also resist significant changes.

    That is not to say that the quite remarkable GIMP functionality could not be wrapped into a nicer user interface. GIMPShop is one such attempt, which I have not tried. I hope that it will become a well-maintained fork; I don't have much hope for GIMP itself to improve in the UI department. I am personally partial to Krita which, while still young, seems to have generally made the right implementation decisions, and is truly user-focused (as is all of KDE -- I love those guys). I am not a professional photo editor, so I don't know how mature Krita is for serious work. It is good enough for everything I do.


    Ooooh... what a bold statement! The GIMP is *NOT* user-focused. Don't tell me.

    See, professionals don't want just "a better pile of poo" to do their imaging work. They (and I, too) want something that IS EASY TO HANDLE. Because in graphical applications, form is function. And this is something that many programmers (at least many of those that I've discussed with) simply fail to understand.
  11. Or IBM optimizing the most-heavily-used opcode. by Ungrounded+Lightning · · Score: 4, Interesting

    Then there was the time IBM instrumented a mainframe to determine what instructions were heavily used so they could focus their optimize-the-microcode effort on them.

    They found one particular instruction that accounted for some exceedingly large fraction of the execution time. So they went to work on the microcode and doubled its speed. Then they deployed the new microcode and measured the application performance, expecting to see a big improvement.

    It didn't change a bit.

    After a little more research they discovered they'd optimized the idle task's wait loop.

    = = = =

    Collecting data can be useful. But making good decisions based on it requires wisdom and insight.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way