Slashdot Mirror


Popup Study Confirms Most Users Are Idiots

danieltdp writes "Testing students at a University, psychologists made many of them click on a dialog box that in effect said: 'You are about to install some malware. Malware is bad. By clicking yes you are failing the Windows Darwin Test.' Nearly half of them said all they cared about was getting rid of these dialogs."

25 of 568 comments (clear)

  1. Summary is WRONG by AKAImBatman · · Score: 5, Informative

    "You are about to submit a bad summary. The summary is bad. By clicking yes you are failing at Slashdot Darwin Test."

    "Testing students at a University, psychologists made many of them click on a dialog box that in effect said: 'You are about to install some malware. Malware is bad. By clicking yes you are failing the Windows Darwin Test.'

    Doh!

    For those of you just joining us, the article says nothing of the sort. The article actually says that they created fake "Application Error" dialogs with various numbers of "fake" aspects. e.g. The cursor turning to a hand over the "Ok" button, reverse colored text, browser borders, etc. Basically, stuff that should have made it obvious that these were malware windows. Nearly half of those tested "accepted" the dialogs to get them out of the way. Some of them simply minimized them for later.

    The text referred to in the summary is an image created by Ars Technica with the caption, "Even this warning might not have helped".

    1. Re:Summary is WRONG by mollymoo · · Score: 5, Insightful

      And more interestingly, the study says that most users are in fact *not* idiots, but that a distressingly high percentage (almost half) are.

      The attitude that users who do something wrong are idiots is a large part of why computers, operating systems and applications are generally pretty shit. They're made by and for geeks, not normal people. If 1% of your users do the wrong thing they may well be idiots. If 50% of your users are doing the wrong thing, you are the idiot for designing your software so badly half the population can't use it.

      (I mean "you" in the general sense, not the parent specifically)

      --
      Chernobyl 'not a wildlife haven' - BBC News
    2. Re:Summary is WRONG by Nutria · · Score: 5, Insightful

      Computers are not for everybody!

      Amen, brother.

      --
      "I don't know, therefore Aliens" Wafflebox1
  2. The actual text by KingSkippus · · Score: 5, Informative

    The actual text was "The instruction at '0x77f41d24 referenced memory at '0x595c2a4c.' The memory could not be 'read.' Click OK to terminate program." You're right, this is not "basically" (or even remotely close to) the text in Ars's little joke screenshot or what was posted in the summary.

    1. Re:The actual text by ari_j · · Score: 5, Informative

      The legitimate error messages of that form often do, indeed, surround "read" with quotation marks.

    2. Re:The actual text by Anonymous Coward · · Score: 5, Informative

      That's typical for these error messages in Windows. The error message is legit, this is something that a regular Windows user might see (I don't want to use the word "commonly", but it's relatively common as far as Windows error messages go). From look at the error message it looks to me like it's a basic Windows error message where the OS fills in the quoted strings (source address, target address, IO operation). All of them are double-quoted. The actual error in Windows would be printed exactly like this:

      The instruction at "0x77f41d24" referenced memory at "0x595c2a4c". The memory could not be "read". Click OK to terminate program.

      Even though I assume that's a template for several error scenarios, I've never seen one during my own usage that didn't specify "read". The actual text is a regular Windows error though, the display of the text was what was supposed to alert users (browser status bar, borders, close/minimize buttons, colors, etc). So it's not the error message that was supposed to be suspicious, just the context that it's shown in.

  3. or it could have been by itamblyn · · Score: 5, Interesting

    They didn't care if malware got installed on the researchers computers. Most university owned machines that are publicly accessible (e.g. in the library) get ghosted frequently. It doesn't matter what you do to them - tomorrow they will have a fresh install anyway.

    1. Re:or it could have been by Hatta · · Score: 5, Insightful

      This was my thought too. Study participants were asked to give their opinion on a web site. If they close the offending window, they'd be unable to give their opinion on that website. If they just clicked through, they stand a chance of getting to the web site, and whatever happens to that terminal is none of their business. So these 'idiot' users were just following instructions.

      --
      Give me Classic Slashdot or give me death!
  4. More power to them by Anonymous Coward · · Score: 5, Insightful

    Quit bugging me. Much more work needs to be done to eliminate "Are you sure?" requests. Working undo is always better than asking the user and making him regret the answer seconds later.

  5. Even more importantly... by hellfire · · Score: 5, Informative

    The bottom of the article has the actual conclusion that the article was trying to make:

    Follow-up questions revealed that the students seemed to find any dialog box a distraction from their assigned task; nearly half said that all they cared about was getting rid of these dialogs. The results suggest that a familiarity with Windows dialogs have bred a degree of contempt and that users simply don't care what the boxes say anymore.

    The authors suggest that user training might help more people recognize the risks involved with fake popups and the diagnostic signs of genuine Windows dialogs, but the fact that the students didn't appear to spend any more time evaluating the fake dialogs raises questions as to whether education is enough.

    --

    "All great wisdom is contained in .signature files"

    1. Re:Even more importantly... by truthsearch · · Score: 5, Insightful

      Education is definitely not enough because people just don't care. They want to do what they want to do and the computer should magically understand that and play along. There's little respect for the complexity of general purpose computers and any possible learning curve needed to use them properly.

      My wife has occasionally complained that her computer was acting "strange". After hearing the symptoms I've often asked, "Did any messages appear?". "Yes." "Well what did it say?" "I don't know. I just clicked OK." She simply doesn't care enough to deal with an issue when she's trying to browse a web site or send an email.

      My favorite was the time she complained my laptop must be broken because it turned itself off. I got nervous thinking it was broken. I asked if a message had popped up before it turned off. She said no, then thought about it and remembered something popped up a few minutes earlier. She couldn't remember what it said. I told her it said to plug it in or it would turn itself off. Her response: "Oops".

    2. Re:Even more importantly... by nine-times · · Score: 5, Interesting

      Story time:

      Early in my career, I worked with a helpdesk tech who was hired more or less because he had certifications out the ying yang. So one day, he comes to me and he says, "I'm having a problem with this computer. It just won't work and I can't figure out why."

      So I went with him back to the workbench and said, "Ok, show me what the problem is."

      He booted up the machine and logged in. Everything looked fine. He navigated through the start menu, found the shortcut for Microsoft Word, and clicks on it. It takes a second before anything happens, and then a little window pops up with what looks like an error message. The tech immediately hits ok, and then sits there for another minute before turning to me and saying, "See. Word won't start."

      I said, "Ok, well what did that error message say?"

      He responds, "wha?"

      I ask him to try running it again, he does, and when the error message comes up again, he again immediately hits the OK button. I say, "That! That error message. What did it say?" and he comes back again, "Huh?"

      I get him to run it a third time, and ask him to take his hands off the mouse and put them in his lap until I tell him he can touch the mouse again. The third time, the error message pops up again and says, "Error: missing msvcrt.dll." (just making that up, but it was missing some DLL) I copy the DLL over from another machine and it works again.

      True story. I'm not sure if there's a lesson in there somewhere, but it seemed like a relevant story.

    3. Re:Even more importantly... by MobileTatsu-NJG · · Score: 5, Funny

      And you decided to spend the rest of your life with this woman, and mingle your genes with hers, and have her raise your children????

      $5 says your wife asks the same question when you leave the toilet seat up.

      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

  6. The fuunt thing is by geekoid · · Score: 5, Informative

    the people writing the dialog boxes assume clicking no just shuts down the dialog box.
    You could easily have events fire on the No as you do on the yes.
    It takes a little work, but it is doable.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  7. Wrong conclusion by Xzzy · · Score: 5, Insightful

    I don't think this says as much about the users as it does the usability of our computers.

    Computers are commodity items now, the days where nerds interested in technical details were the primary demographic are long gone. People just want to do their job and move on with life, they don't care about memory registers or malware they just want to not be interrupted.

    It really illustrates how dialog boxes as a warning system are a flawed mechanic, we got this fancy computer with a fancy operating system, why can't it figure out the right thing to do when an application tries to access memory it's not supposed to?

    Guess my point is if we put as much effort into error handling and/or malware detection as we do our whiz-bang graphics, it might not even be a problem anymore.

  8. Study confirms most popups are idiotic by EmbeddedJanitor · · Score: 5, Insightful
    Clearly popups don't work in an effective way, yet programmers continue to use them for the wrong purposes.

    It isn't just Windows either. Apps in Gnome, KDE and OpenOffice also open up stupid dialogs.

    It is unreasonable to consider training users to be driven by popups. What would make more sense is for programmers to design their pop up use better so that it is more meaningful for the user.

    --
    Engineering is the art of compromise.
    1. Re:Study confirms most popups are idiotic by Free+the+Cowards · · Score: 5, Interesting

      Programmers continue to use them because they effectively move responsibility. Yes, they fail, but when they fail it's suddenly the user's fault, so the programmer is happy with the result.

      Of course this is bad UI and the failure is ultimately that of the programmer, but this is not how it's perceived now, so programmers will continue to use them even if they know full well that they don't do the job.

      --
      If you mod me Overrated, you are admitting that you have no penis.
    2. Re:Study confirms most popups are idiotic by Spy+der+Mann · · Score: 5, Funny

      Clearly popups don't work in an effective way, yet programmers continue to use them for the wrong purposes.... What would make more sense is for programmers to design their pop up use better so that it is more meaningful for the user.

      You have 1024 infections on your computer!
      Press REPAIR to fix these problems.

      A friend of mine came for help because he couldn't open his drive C: I told him he probably had a virus. He said that he even used an antivirus program. Which one? Here's his answer:

      One that said "Your computer is infected!"

  9. Re:Newsflash! by orclevegam · · Score: 5, Funny

    That's because the bogons they emit react destructively with our cluons. I believe this is the process by which otherwise promising programmers become middle management potential. Prolonged exposure to PHBs and lusers causes cluon destruction and eventual bogon poisoning. It is truly a vicious cycle.

    --
    Curiosity was framed, Ignorance killed the cat.
  10. Jumping to incorrect conclusions by PJ1216 · · Score: 5, Insightful

    I see a lot of people jumping to conclusions about how this is the fault of programmers for using the dialog box too much, etc, etc, etc. I call BS. If you write software for people who are computer illiterate (which happens a lot in my field. i write software for veterinarians), they'll click on anything and do everything, no matter the consequences. A simple "undo" isn't enough. They need to understand what they just did. If a popup don't pop up and say "you're about to delete something" they won't even know they deleted it until its too late (closing program, etc). You can't keep an infinite list of "undos" either. So, you're left to assume one of two things. 1) The person has read instructions, understands what they're doing, and understands they're responsible for breaking it OR 2) They haven't read any instructions, will click on what they think makes sense and when they break it, they call support, bitch and moan, taking up valuable time. Maybe in a bigger company, thats acceptable, however, *I* do both the programming AND support as we're a company of about 5 people. I can't be dealing with people who are idiots. I challenge anyone to make something thats completely foolproof without popups AND thats still aesthetically pleasing to look at AND easy to use.

    Maybe people should just realize they're using delicate instruments and should treat them as such. These aren't toys, but systems that cost hundreds, sometimes thousands of dollars to build. Its not the programmers' fault. Its the user's. If the user refuses to educate himself to not be a fool, there's really no way to try and make something foolproof.

  11. People aren't idiots, people are people. by Chuck+Chunder · · Score: 5, Insightful

    If the tools aren't working well for people then the design of the tool is wrong.

    If you build a ATM (cash dispenser) that spits out the money before it returns the card then you'll find that a not insignificant number of people leave the machine without retrieving their card. In their brains the task they are doing (getting money) is complete so they walk away.

    Thus cash machines return the card first and then give you your money.

    You have to design things to work the way real people work. Calling people idiots is just a cop out.

    --
    Boffoonery - downloadable Comedy Benefit for Bletchley Park
  12. Microsoft has trained people to click "OK". by argent · · Score: 5, Insightful

    Microsoft has trained people to click "OK", "Open", "Run", "Install", "Continue", or whatever button (wherever it is) that gets you past the idiot box.

    Apple had until recently avoided this mistake. NOT (as some people have said) by making the buttons more meaningful, but by simply NOT trying to use warning dialogs in place of good design.

    For example, Mac OS doesn't ask you if you want to move a file to the trash, and it doesn't ask you if you want to empty the trash, because these are common actions, and the dialog box becomes something you reflexively accept.

    Recently, as I say, Apple has started to deviate from the path of virtue. I've caught my Mac in bed with promiscuous dialogs on many occasions.

    But by comparison with Windows (particularly Vista)... my Mac's still pretty much a dialog virgin. Really.

  13. Re:NOT: (was Re:Summary is WRONG) by dark-nl · · Score: 5, Funny
    I'm used to the commenters not reading the articles. That's life on the net, and with all those comments to read and reply to, who has time for the articles?

    I've even gotten used to the slashdot editors not reading the articles. After all, there are a lot of submissions and it's not like it's their job. The queue is long, the day is short, etc etc. I understand all that.

    But when I realized that even the submitters don't read the articles they summarize... that is when I cried. Something broke inside me.

    Even that was a couple of years ago, though. I'm all better now, and life is wonderful now that things don't have to make sense anymore. I feel so free!

  14. Re:NOT: (was Re:Summary is WRONG) by 1u3hr · · Score: 5, Insightful

    Also one must consider the situation. The students were placed in front of a screen and given a task. If it were me I wouldn't be to concerned about error messages if I could just click them away, finish the job and collect my $5 or whatever. If it was my own PC, or one I used every day for work, I would indeed take much more care. But a machine used by many people is probably going to get fucked up in very short order regardless of what I personally do, so why bother.

  15. Re:NOT: (was Re:Summary is WRONG) by clockwise_music · · Score: 5, Insightful

    Mod parent up - I couldn't agree more. Users are not idiots. Users just don't care about reading dialog boxes because a lot of the time the message isn't useful or helpful.

    Here's a suggestion for everyone. Whenever you display an error message, don't just display the error message. The user (normally) doesn't particularly care what went wrong. They just want to know how to fix it.

    Eg, I was trying to buy an AudioBook on iTunes the other day, when it said to me "Users in Australia cannot purchase tracks on the UK site". Now it didn't tell me "well, go to the Australian site, and here's a link to go to it" or say "would you like to go to the Australian site?". It just gave me a dumb error message. It took me ten minutes to find the link to the Australian site (scroll down to the bottom of the front page, dur. Seems so obvious now).

    Dammit, be helpful to your users. Don't just display the error message. Display what to do about it. Even "please try again later" is better than nothing.