Shuttleworth Suggests 1-Way Valve For User Experience Testing
darthcamaro writes "No surprise but Ubuntu's Mark Shuttleworth has come out swinging in favor of the Linux desktop. Speaking at Linuxcon yesterday he detailed the things that he thinks Linux requires in order to win the desktop wars. Those include: co-ordinated software releases, better quality and design, some user experience testing and oh yeah, a dose of 'shut the f*** up' too. During his keynote, he extended an invitation to any open source application to submit their software for testing by user-experience experts. The sessions would be recorded for posterity, and the developer would not be able to interact with the user. "'If the developer is in the room, they have to say nothing. It's the shut the f*** up protocol,' Shuttleworth said. 'You sit and watch someone struggle with the software that you've so lovingly produced.'"
Users always ruin the best software.
He knows what he's talking about. We don't need more RMS but more people like Shuttleworth. Pragmatically minded, not focused only on ideals. If somebody wants follow only ideas I suggest Green Peace or monastery.
"an experienced, industrious, ambitious, and often, quite often, picturesque liar" - Mark Twain
Ok, sounds like a cool idea. I would LOVE the Amarok2.x devs to sit in on that session.
"The price good men pay for indifference to public affairs is to be ruled by evil men." ~Plato (427-347 BC)
and oh yeah, a dose of 'shut the f*uck up' too.
Wow, it's a good thing that asterisk was there. Somebody might have seen something profane.
Promote proofreading. Don't mod up sloppy posts.
I've done a bit of software dev here and there, and I've never had the luxury of being near the users when they first prop it open.
For that reason, I've developed a habit of showing a beta to a nearby co-worker, or a friend, and ask them "Check this out."
And when they say "What is it?" - I haven't done my job right.
The problem is, we have this odd expectation that any software, from a compiler, to a game, to an office suite to a browser should be instinctive by use of other software. That is, they think Word processor == Word. So when you take another word processor such as Open Office, they expect it to work -exactly- like Word. Any differences are seen as "faults". Take someone fully new to computers and have them learn Linux or Windows and chances are they will figure out Linux faster. Take someone who has used Windows all their life and give them Linux they complain because things aren't exactly the same.
Taxation is legalized theft, no more, no less.
Because so many developers develop Open Source applications for personal satisfaction, they tend to focus on scratching their own itches.
A characteristic of usability testing is that your goal is to scratch the itch of your customers; your preferences have very little significance in the context of the test.
It doesn't take a genius to see a potential conflict in the two goals; on the other hand, a developer likes to see his code in actual use by actual human beings. To maximize this use, a developer must at least pay lip service to documentation and UI testing.
Many developers never make this conceptual leap, however.
"Man is nothing without the works of man" -- Helvetius
Ironically, Linux is a far better desktop OS than a Workstation OS. Microsoft is just too far ahead on making it easy to manage thousands of workstations with minimal setup.
Perhaps, but I don't think botnets really count as an example of superiority over Linux.
Desktop, workstation and server OS are obsolete ideas. In 20 years we probably won't even have these things or at least not worry about them. I can't say for certain what will replace the desktop, but I think it is going away in our lifetimes. Or perhaps we'll just have one platform that runs the same OS and same applications on our laptops, servers and phones.
They've been predicting the death of the desktop and a return to centralized computing for 20 years.
"Frequently wrong, never in doubt."
Sorry, the simple fact is there is no need for another desktop OS. Windows and Mac are fine. I don't know why people think Linux will _ever_ make headway in that space when there's no conceivable way it ever will.
Instead, how about focusing on being a workstation OS and a server OS?
Mr. RightSaidFred99, I think it's time for a big dose of, as Mr. Shuttleworth himself so elaborately expressed, shut the fuck up.
I am the lawn!
Your fears are unfounded. If they were valid, we wouldn't have GNOME & KDE & the hundreds of other desktop environments and window managers.
In fact, this will make things even better. KDE will still be KDE, but it will be more usable. Same with GNOME. Some of the more esoteric systems will not change, because they aren't aimed at regular people.
There is no single Linux OS that can be bettered/ruined by a single person. There are literally *hundreds* of Linux OSs. And even if there were just one single Linux OS, how can you argue *against* usability testing? If there's just one OS, and it goes through testing, it will almost certainly be made better, but if you *don't* test, it will still be the single Linux OS that everyone has to use, it just won't be as good.
My biggest complaint about Linux on the desktop is the lack of a true universal UI
Not much of a problem though, for most people, Linux isn't Linux but a Linux distro, that is if you have Ubuntu, you get GNOME, if you have Kubuntu you get KDE. Similar to how you can either get Windows XP or Windows Vista/7 with different UIs.
and the difficulty in user software (a user should be able to run every application without tweaking text files)
Most user-level applications don't require you to tweak text files unless you need some obscure setting. A few "pro" level applications (as in, your going to be programming or know something about computers) use text files because they are easier to edit, debug and generally give support for a knowledgeable user.
and ease of administration
Compared to Windows, Linux administration is a breeze. A Linux system ran by a normal user who doesn't screw around as root, will remain stable. Simply going to a site can get you a virus in Windows. Because of this and the -large- amount of viruses on Windows, it is pretty much required to run a virus scan pretty often. With Linux, even if you are running a vulnerable everything, chances are you simply won't get a virus.
Plus, with Windows update you never know what you are going to get, "features" constantly creep in (remember the search bar that was a "critical update"?) and large changes are considered updates. It takes a lot more work administrating a small amount of Windows boxes compared to Linux.
When it achieves the same level or better of intuitiveness as Windows, then it can compete.
Windows has not intuitiveness. The only reason why we think it has is because most people have been using it for 20 some odd years. A lot of the Windows conventions have been -proven- to be counter intuitive and plain confusing (anyone else wonder why Add/Remove programs is called that even though you really can't add in any programs from there). Windows is terribly unfriendly, we just have gotten used to it.
Taxation is legalized theft, no more, no less.
The idea that an interface can be entirely judged by how well a user handles it in the first few minutes of exposure is, in my opinion, one of the bigger *problems* with UI design of late. A quality interface should both be immediately accessible, and SCALE WELL TO MORE ADVANCED USE CASES. In my experience, Gnome, OS X, and the bundled native applications that come with each currently fail miserably at the latter. The former head of Apple's UI team makes a pretty good case for this being a problem here, although the article focuses specifically on a facet of the OS X design philosophy which causes scalability issues, rather than the problem in general. To borrow a line from the article: "The beginner today will be the expert of tomorrow. The user with 200 photos today will be the user with 2000 a year from now. The user with 10 songs today will be the user with 100 songs six months from now. The user with one or two extra apps on the iPhone will be the user with 100 apps three months from now."
True story here: dad's computer had OpenOffice, not MS Office. My sister's experience with OpenOffice's Impress was terrible: she needed to print all slides from a .ppt file, and couldn't find this option. As she had a tight deadline, and I had nearly zero experience with presentation software anyway, I shrugged and installed MS Office. She ran Powerpoint and found her way very easily.
Just a bit later, I tried to find out how one prints all slides from a presentation.
Guess what? It's done EXACTLY the same way in Impress and Powerpoint. Same function, same name, same location. See, this is not a "Photoshop versus Gimp" style comparison; interface-wise, they were nearly identical (that was before the "ribbon" thing). If she found her way in Powerpoint, she should have found her way in Impress. Yet, she somehow panicked with the new program.
What can a developer do about users that won't even TRY?!
Circumcision is child abuse.
... as a developer.
They basically have labs with one-way mirror. User is left alone in a sound-proof room and given a set of tasks to perform. Everything is recorded (including facial expressions and sound), and any developer can take a look at the test either from the adjacent room or from his/her workstation (using Windows Media Player). The only input the user gets is when he gets so confused he can't accomplish the task from the list. In which case the person conducting the test just says "next task" and that's it.
The experience is really humbling. You just realize that people out there are FAR, FAR less experienced with computers than you thought, and even working their email client is a challenge for most.
You make your assumptions on the basis of what's convenient for you. Guess what, people out there are not you, and what's good for you is torture for them (the inverse is often true, too).
We ended up redesigning the entire chunks of the UI sometimes, some features got cut, some scenarios overhauled. And in the end we still didn't do enough of usability testing (IMO), but such is life in commercial software development - you work against an arbitrary schedule.
"Windows has not intuitiveness. The only reason why we think it has is because most people have been using it for 20 some odd years."
Exactly. Those old exclusivity agreements that MS insisted on are still paying off. People are used to MS, and anything different is "wrong".
Not to mention - Dell, Compaq, and other OEMS basically did all of MS hardware compatibility for them. Linux is still struggling to make some hardware work that was "designed for Windows".
Just a few years of unfair advantage can translate into decades of revenues.
"Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
Windows has no touch screen support out of the box either.
Vista does. You're either full of shit, or talking about an ancient Windows version. Given, Vista doesn't have *multi-touch* screen support, but neither does Linux or OS X. And Windows 7 will. So... yah.
Please do the world a favor and stop spouting bullshit. If you don't know for sure, don't write the fucking post.
Comment of the year
It is 100% worthless.
I have a job to do, it involves many facets. I need to be able to do all of them. It isn't an option to say "No I am not going to do this part of my job." Well, my Windows system does 100% of what I need. It runs all the different kinds of software I need to do the various parts of my job. Ok, great. Now if Linux doesn't, it is worthless. Why? Because there's no point in running a different OS, if I still have to have Windows. If Linux does 80% of what I need, and Windows does 100%, then I might as well always be booted in to Windows. Why would I boot to a different OS, if it can't do everything?
Also, in terms of switching, it isn't good enough to say "You can do everything you need." It most certainly isn't worth a switch if you can do everything you need, but it is harder or more complicated to do. It isn't even good enough to say "You can do everything you need just as easy." Even if everything works as smooth as it does with what you currently have, it isn't worth switching because there's no advantage.
To be worth switching, you have to show how things are going to be BETTER. You have to show that you can do 100% of your job, and that it'll be better. Otherwise, it really isn't worth it.
I think that is part of the problem that often when people say "Well you can do what you need to do in Linux," they haven't really looked at what the person does. What the truth can be is "You can technically do what you need to do, but it'll be a whole lot of work, a good deal of retraining, and not nearly as smooth as what you have now."
Well Linux has "support" as well. In both cases additional drivers may or may not be needed. Since the parent was not in any way specific as to the type of touchscreen I was being as general as possible. Most Linux distributions provide support for a variety of touchscreens and drawing tablets out of the box. I know for a fact that Vista on one of the tablets I use needs a driver installed manually for the Wacom tablet. Ubuntu does not. It really depends on the hardware.
My comment was aimed at the people who rip on Linux because they have to install drivers (it really doesn't matter what type.) I was pointing out that you need to do that in other OS's as well.
"Frequently wrong, never in doubt."
Go do volunteer basic computer literacy session for your local senior center. Don't try to convert them to linux or get them using Firefox or anything dumb like that. Just ask what their problems are, and how you can help. You will quickly understand how broken and unintuitive computer software is.
Well, last time I did it, it went like this.
One of the grad students in the lab decided he needed to use Linux, but he only had experience with Windows. No problem, a good first step is to install Linux at home so he gets lots of exposure to it.
Okay, install Ubuntu. Not bad (the install process has come a LONG way - proof that UI improvements can be made). Okay, everything is going fine, but how come the second monitor doesn't work? Now there's a good question: Windows and OS X both would have autodetected the monitor and just made it work. Strike 1.
But sure, let's just open up the System->Preference->Display. Oops. Second monitor isn't there. Hm. Strike 2.
All right, Google it. Here's a utility that's supposed to do the job. Install, run. Wants to install a driver. No problem, do it. Which one? The latest one. Fine. Uh oh, X won't even start. Strike 3.
Okay, fine, it's been a while since I've edited an Xorg.conf file, but let's dive into it.... That's the point where the guy decided to wipe Linux and reinstall Windows, and I can't really blame him. It turns out later that after two strikes we almost had it, except you had to pick the next to latest driver because the most recent one dies a horrible death when used with more than one monitor.
By the way, I'm not at all sure you know what you're talking about. If you type "multiple monitors" into the Ubuntu help webpage you don't get "just go to System>Preference->Display. You get this:
https://help.ubuntu.com/community/XineramaHowTo
So either you're wrong, or the Ubuntu help web site is crap. Either way, strike 4.
I hope Shuttleworth's emphasis on usability pays off. There's no reason why Linux CAN'T deal with the myriad little problems like this one, and Ubuntu has not only fixed a bunch of them in the distro but also spurred other distros into fixing long standing, stupid issues.
For the benefit of those not familiar with this... the old behaviour of displaying updates was to display an icon next to the clock. The new behaviour is:
Friends' Ubuntu installations were rarely updated due to the limited attention received by the little icon. With the new [minimised] update window, the machines updated weekly.
It all comes down to visibility.
Cheers.
Yet Socrates himself is particularly missed.
A lovely little thinker but a bugger when he's pissed.
You're confusing two very different things. "Pay attention to the user's behavior" and "listen to what the user asks for".
The first is always valuable. Seeing what users do is just plain good. You should be doing that. You should absolutely be doing that.
The second, however, is a frequent mistake. Users don't know what they want. They know what they want to do, and they either know they can't do it or they know how they used to be able to do it, but the ideas they come up with to fix that issue tend to range the gamut from "barely acceptable" to "horrible".
Any change you make to an existing UI - *any change whatsoever* - will result in a storm of people calling for blood. No matter how good the idea is, no matter how good the change is, people will scream for it to be changed back. If you want to create a good UI, at some point you just have to ignore this. People yell for reversion, you tell them "no", and a few months down the line you find out if you made the right call or not.
You might think he made the wrong decision here, but "listening to the users" has absolutely nothing to do with real user experience testing.
Breaking Into the Industry - A development log about starting a game studio.
The two really aren't the same thing, they only seem that way because you've erroneously over-simplified his position to "listen to the users."
User experience testing is essentially about usability. If you put some dude who has never seen your software in front of it, can he use it to get his work done? Is there anything seriously impeding his ability to 1) learn or 2) use the software?
What you're referencing is that something changed and people don't like the change. For starters, most people don't like change even if it is ultimately change for the better. More to the point though, it has nothing to do with learning or using a piece of software. They simply preferred one behavior to another for a set of reasons that may or may not address any of the reasons the change was ultimately made. A user below suggested that the previous situation (apparently, an icon in the dock for updates) was terribly ineffective but that the new system now achieves much higher update rates. In a situation like that, where some users are annoyed by a behavior but there is a demonstrable and measurable net positive to the change, reverting it is probably the wrong answer even if his motto was "listen to the users."
For what it's worth, as somebody who has no vested interest in the change either way I think his response was perfectly reasonable.
Was it overwhelming public opinion? Sorry if I'm wrong in my assumptions, but I smell some bias in your post. It seems to me like you were one of the ones who want the change reverted. There's nothing wrong with that, but combine selection bias with the general megaphone that negative reactions get compared to positive ones (far more people hop on to review something they hated than loved) and I don't know it's as clear-cut as you suggest. Plus, this is a bugtracker. For all the increased likelihood of bad comments to good in general, most people wouldn't even think to log onto a bug tracker if they liked or accepted the new behavior. And why should they?
It's also worth mentioning that "listen to your users" wouldn't necessarily equate with "give your users everything they want" as well.
This has to win an award for the longest sentence ever posted on Slashdot, with a special mention for incoherence.
I'm a Programmer. That's one level above Software Engineer and one level below Engineer.
I really doubt that could even come close to being the longest sentence ever posted on Slashdot, although it might possibly be the longest sentence put together without including any punctuation or obvious structure - the trick really to building an excessively, almost absurdly, long sentence is to first ensure that it contains plenty of subclauses to pad out the length, adding extra detail without becoming complete sentences in their own right, which allows you to keep adding words without bringing the sentence to an end, followed by the addition of plenty of un-necessary, redundant and absolutely preposterously worthless adjectives and further extra description, and then the final stage is to replace natural sentence breaks with connective words, commas and semi-colons to paper over the gaps between what would otherwise be separate sentences and keep the run-on flowing so that the sentence can just keep on growing and growing without any real limit or inhibition to further growth, save for the limiting factor of the author's patience with the endeavour.