Research Proving People Don't RTFM, Resent 'Over-Featured' Products, Wins Ig Nobel Prize (improbable.com)
An anonymous reader writes:
Thursday the humor magazine Annals of Improbable Research held their 28th annual ceremony recognizing the real (but unusual) scientific research papers "that make people laugh, then think." And winning this year's coveted Literature prize was a paper titled "Life Is Too Short to RTFM: How Users Relate to Documentation and Excess Features in Consumer Products," which concluded that most people really, truly don't read the manual, "and most do not use all the features of the products that they own and use regularly..."
"Over-featuring and being forced to consult manuals also appears to cause negative emotional experiences."
Another team measured "the frequency, motivation, and effects of shouting and cursing while driving an automobile," which won them the Ig Nobel Peace Prize. Other topics of research included self-colonoscopies, removing kidney stones with roller coasters, and (theoretical) cannibalism. "Acceptance speeches are limited to 60 seconds," reports Ars Technica, "strictly enforced by an eight-year-old girl nicknamed 'Miss Sweetie-Poo,' who will interrupt those who exceed the time limit by repeating, 'Please stop. I'm bored.' Until they stop."
You can watch the whole wacky ceremony on YouTube. The awards are presented by actual Nobel Prize laureates -- and at least one past winner of an Ig Nobel Prize later went on to win an actual Nobel Prize.
"Over-featuring and being forced to consult manuals also appears to cause negative emotional experiences."
Another team measured "the frequency, motivation, and effects of shouting and cursing while driving an automobile," which won them the Ig Nobel Peace Prize. Other topics of research included self-colonoscopies, removing kidney stones with roller coasters, and (theoretical) cannibalism. "Acceptance speeches are limited to 60 seconds," reports Ars Technica, "strictly enforced by an eight-year-old girl nicknamed 'Miss Sweetie-Poo,' who will interrupt those who exceed the time limit by repeating, 'Please stop. I'm bored.' Until they stop."
You can watch the whole wacky ceremony on YouTube. The awards are presented by actual Nobel Prize laureates -- and at least one past winner of an Ig Nobel Prize later went on to win an actual Nobel Prize.
TL:DR
The features and interface will all be different in 6 months anyways for 90% of software. Anything that survives was simple enough to figure out already anyways.
When you are architecting software, this is actually something you should keep in mind. If you keep things simple then people can actually use your software. However, if you complicate things because you're "smarter" than the users then you can congratulate yourself on that but you have failed the users despite your length documentation.
Anons need not reply. Questions end with a question mark.
80% of your users only use 20% of your features. But it's a different 20% for everyone. Eventually you get to the point where everyone's got that one little feature they can't live without. That's where you get lock in from. It's how Microsoft keeps their office monopoly in the face of competition from Open Office and the like.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
I read manuals. I *like* manuals. They tell you how to operate the products you buy! That people won't read them is a real disappointment. The real surprise here is the negative emotional reaction. WTF? How do you get upset by reading about useful information?
Shutting down free speech with violence isn't fighting fascism. It IS fascism!
There's nothing I hate more than trying to figure out what some dyslexic English as a Third Language moron created using Google Translate actually meant.
Then there are the manuals that contain proper English that repeat everything, except the answer you actually need.
I had bookshelves full of Microsoft, Oracle and Solaris manuals that (with the advent of reasonably good search engines) I quickly tossed into the recycling bin,
Usually, people who tell others to "RTFM" have no idea where TFM is, or if there even is a FM, or if TFM covers the F subject.
They just blurt it out as if they get a cracker every time they do.
BWAAACK
RTFM!
RTFM!
RTFM!
RTFM!
RTFM!
RTFM!
BWAAACK
Research like this is causing software to be increasingly dumbed down to a point where it is extremely difficult to use. In the past you could configure software to work in a way you found desirable and productive, but now all the sophisticated is being removed and you're forced to work the way the UX designers dictate. Take Firefox:
I could go on all day with Firefox, but dumbing down of the browser by removing features and options has turned it into a nightmare to use. The same is very much true of Windows 10 which is an absolute train wreck. I've found myself increasingly moving away from commercial software produced by UX designers to FOSS produced by programmers simply because I want software that works.
The thing is, it's not just technical users who hate what UX designers are doing to software, and casual users I speak to also hate the constant UI changes, the hiding of features and the removal of options. Now here we have some worthless 'intellectuals' being given a Nobel Prize for telling people to fuck up their software.
It's little wonder we're moving to a world where computes are becoming less sophisticated and turning into machines for running 'apps' that you can only get from a curated store that bans anything remotely useful. With the direction computing is headed, I think I'll just go and live in a cave.
In my experience, applications that have enough different features an complexity to really be a problem often support doing several different tasks. Often it can be made much more usable by designing a UI around the distinct jobs one can do using the software, a UI based on workflow. I'm not going to say wizards exactly, but UI flows designed for specific tasks the user wants to accomplish.
The UI often represents the underlying underlying data rather than the tasks. You know for sure that you have this kind of UI if it has different sections for different kinds of objects. Of these different kinds of objects map to different table in your database, you definitely have a data-centric UI instead of a task-centric one.
My server backup software originally had a data-centric UI. It was basically alot like managing hosting accounts. It had a page for servers - listing, adding, removing, and editing them. It had a page for DNS names - adding, removing, and editing them. There were a couple other pages like that, for manahaing the objects in the application. That worked great for me. Users didn't like it.
We added another UI that started with this page:
Add a new server
Restore file or server
Manage billing
Other tasks
Clicking "add a new server" took the user through the steps of adding a new server - including any domain names related to that server. Clicking "restore a file or server" took them through the steps to do that. At each step, the only saw the options relevant to that step.
The task-centric model is a great way to manage complexity. The data-centric UI can also be useful at times, but it's inherently more difficult to learn and use in many cases. Some applications warrant having both options. We kept both for the server backup system. Customers used the task-centric, wizard-like UI for common tasks. For less-common tasks, the data-centric UI was more flexible.
Yes, well... Is it a surprise when they've tossed all that we've learned about UI making?
Clickable objects are no longer clearly marked as such. Different kinds of content are no longer clearly distinguished from one another. Contectual information on mouse-over or right click or even F1 is hit and miss, but usually miss.
And be honest, how often do you go "What kind of moron from Bizarro Land would name this function that and put it there??!!".
Or lists... on one frame, it's exportable on the second it's sortable and on the third you can do multi-selection. But not one of them can do all three.
Not to forget that if whatever you are using happens to have multi-platform apps, GUIs or whatever, you can bet your ass they won't have been developed by the same team. So you not only need to handle each and every single app with a lot of TLC for them to even remotely do what you want, you'll have to learn to do it differently on your MacOS laptop, on your Android phone and on your Windows desktop. If you're especially lucky, the online interface will behave differently depending on the browser too.
And let's be exceptionally frank here, writing a good manual is an artform few have ever mastered. 90% of my use cases I find my answers on some message board online and certainly not in a manual.
OR, as it's the case with our current backup software, the manual is easily 1000 pages. Now, if I were tasked solely with pampering our backup software, you could argue that that is doable and you'd be right. But I also have to pamper the storage environment (with several products, of course), the Cisco UCS, SAN infrastructure and Vmware Virtualization as a cherry on top.
And in order to not kill motherfuckers daily, I strictly adhere to my 8 hour work days, except for emergencies and maintenance tasks that cannot be done on hours.
So imagine this new-fangled dohicky coming along expecting me to forego everything I thought I knew about gadgets and do it their way now because reasons. Yeaaah, no. Go fuck yourself, would you kindly?
I don't RTFM ever (only did to learn how a programming language works and the language needed to code in it).
GUIs are normally built foolproof (read the icon pop-up title and you'll know what it does). Puntually, I search for a very very specific question.
So, I don't RTFM and still I'm able to work with the programs.
I DO HATE over-featured apps. Seriously, I DON'T NEED an e-mail app that also searchs the web and can track my next flying. It's a f*cking E-MAIL APP.
If I wanted a SUISSE-KNIFE APP, I would have installed that. Then, WHY ON HELL I want my e-maill app to waste phone data (that I pay for) searching the web in the background, turn on my GPS (wasting battery life) even when I don't want it to, and give my personal data to flying companies (when I explicitly forbade it)?
I don't want stinky over-featured apps. Well, my bad, I HATE over-featured apps.
Yes, I am starting to become resentful of all of the technology forced upon me and I don't RTFM. I personally hate the whole so-called Internet of Things. I neither want nor need a smart TV and smart refrigerator. The whole IoT thing is like a solution searching for a problem.
If it's well designed, nobody.
The problem you often see, though, is that a simple, well designed, useful program will slowly, over time, "evolve" into a bloated mess full of "features" which you never use with a UI that makes it difficult to actually find what you're looking for.
As a bonus, if it's an "app", it will also get bogged down with advertisements to help pay for all these new "features" which nobody wanted.
Canon and Kyocera have to have some of the most egregious manuals out there. Canon in particular will start with a section (let's say how to input an IP address into a printer), but in addition to the few steps to do this, they will have 5-6 extraneous, and completely unnecessary sub-sections which point to something else but don't make it clear if you need to follow those steps.
Or worse, they'll point you to another section somewhere else in the manual, even though you're at the part where logically, that part comes next.
It is quite obvious the people making manuals don't work with the software/hardware but rely on the engineers to tell them what to write. And engineers don't know what to write because to them it all makes sense since they work with the software/hardware.
As an aside, my credit union's telephone banking has become essentially unusable since they changed systems. Based on the hoops one now has to jump through, it is quite clear the software developers have never used a phone tree. Without exaggeration, every option pressed leads to a voice telling you, "Okay, let's do X" or "Wait while I do X".
This explains why manuals are so poorly done. The people don't have a clue what they're doing.
Reminds me of an old joke: What did the cannibal do after he dumped his girlfriend?
Wipe his ass.
Wizards are restrictive hand holding... but probably fine for simple things or dangerous things...
What you are looking for is MODES; which it sounds like you kind of found.
Easier to do on a webpage since each "page" lends itself to being it's own mode and the metaphor is there but well hidden. In an app, you don't see them that often these days they've largely been forgotten but also many apps are too simple to be forced into that situation. Plus the trend is now to copy old children's software. Some high end software lets you reconfigure the UI and save presets to switch between; which becomes another variation of modes (but one which most users never use effectively or lacks enough customization to be worth it.)
Democracy Now! - uncensored, anti-establishment news
Several points, mostly directed at developers:
1) With online documentation, the manual can (and should!) be kept 100% up to date with the software. Further, if the documentation for a feature is generated at the same time the feature is added, and modified as things that affect that feature are added, this isn't all that difficult a task. There's no excuse for poor documentation.
2) Software that changes in such a way that it doesn't do what it did before the same way, or even at all, rendering previous learning by the customer useless, is bad — extremely bad — design.
3) Software that has few features most often tends to address the needs of only a few. This person needs this, but the next person needs that. This serves both as justification for having many features, and for adding more as people make their needs known to the developer. The trick of making sure this works is twofold: try to make sure that one feature does not get in the way of another, so that only the features needed by the customer must be learned, and make sure that all features are easily discoverable both in the software and in the documentation.
4) With good software and good documentation, tech support is a matter of reading the inquiry, and either directing the questioner to the appropriate portion of the documentation, or adding what is needed to the documentation and then directing the questioner to the appropriate portion of the documentation. User questions are a gold mine for documentation improvement and validation. This process also means you can do technical support fast, and you only have to answer specific questions once if you do it well the first time. This is critical both with regard to keeping both the documentation and also the technical support itself from eating resources more than they absolutely have to.
5) If you want your users to RTFM, then you'd better make very sure you have an efficient, clean mechanism to WTFM that you're comfortable with. I guarantee you if you try it in raw HTML/CSS, you'll be bogged down in the details rather than producing good docs. I couldn't find a solution adequate to my needs, so I wrote one, which I make freely available for any other person who needs to write lots and lots of detailed online docs. It's very powerful, and turns writing docs into a smooth, easy process — after an investment of time learning it. And of course, it's well documented. Ever since I created it, my documentation writing process has become much faster and smoother, and my technical support load has decreased significantly. Developers need tools like this; without something like it, you either aren't going to have good docs, or you're going to have to invest a lot more time and money than you otherwise would have to. Or your docs will suck. That actually seems to be the most common end result. It's no wonder that RTFM isn't the first thing users tend to do.
6) Users appreciate reliable, powerful software that doesn't make them re-learn features, user interface configurations, underlying concepts, and make them wait long periods — or forever — for bug fixes, yet benefits from regular updates. It is not "many features" that aggravate most users. It is over-complex interdependence of features and the need to re-trench because someone decided to change how critical portions of the software actually work, where the feature is found, and so forth. Users invest significant time learning how to do what they want to do. Screwing with that investment is a very bad idea. You can sort of get away with it if what you're making is the only choice they have, but IMHO, it's a very, very bad idea to piss off your users, to make them do what amounts to the same work over (and over
I've fallen off your lawn, and I can't get up.
"being forced to consult manuals also appears to cause negative emotional experiences" makes me smile. I write quite a bit of documentation at my job, and often love to drop a new product on the help desk with no training except "it's all on the Wiki"...which no ones reads either.
Absolutely agreed. Many years ago, I had built enough web UOs which tied to a database back end, thay i went ahead and built framework and template system to automate generating the data-centric one. With just a few customization rules added to the configuration table, I could have a decent view of the software's internal model competed within a couple hours. (Good generic CSS also helped with this.)
After creating the data-centric UI I a couple hours, we could then build the task-centric side for common workflows.
it wasn't built right.
Take cars, for example. They are highly complex machines. Yes, there's a manual. But when you go rent a car, do you first read the manual? No! Why would you? The controls are easy enough to use that you can figure them out. You only need the manual if you really need to take it apart and fix something.
Software and gadgets shouldn't be any different.