Slashdot Mirror


Predicting Human Errors From Brain Activity

Hugh Pickens writes "Researchers report that brain activity can be used to predict the likelihood of someone making an error about six seconds in advance, with gradual changes starting as much as 30 seconds ahead of time. The team used an imaging machine to scan the brains of a group of volunteers who performed a task in the presence of distracting information. When performing correctly the volunteers' brains showed increased levels of activity in those parts associated with cognitive effort, as would be expected. However, these areas gradually became less active before errors were made and at the same time another set of regions in the brain became more active. These regions are part of a so-called "default mode network" and show increased use when people are resting or asleep [PDF]. While imaging machines are far too big and complex to be used in workplaces to monitor the brain activity of people engaged in important tasks, the team hopes to correlate errors to changes in electrical activity in the brain with electroencephalography (EEG), using electrodes placed on the scalp. If EEG features can be found that correspond to the change in brain activity, then a hat that gives warning of an imminent mistake might one day become reality. We've previously discussed similar studies of brain activity."

35 of 123 comments (clear)

  1. I don't believe it by BadAnalogyGuy · · Score: 5, Insightful

    I've seen some stupid research in my time, but actually believing you can predict errors in advance is like saying you can predict which leaf will fall off of a tree in the next 6 seconds.

    1. Re:I don't believe it by Narpak · · Score: 2, Insightful

      The point as I understand it is that the machine notes when there is a drop in activity in the part of the brain responsible for whatever action you are preforming. A drop in brain activity increases the Likelihood of an error, but it does not say exactly when or how; just that the subject is no longer fully focused on the task and therefor errors will occur.

    2. Re:I don't believe it by FooAtWFU · · Score: 3, Insightful
      I don't know. This research is more like predicting whether leaves will fall in six seconds... when it can tell a big breeze is six seconds away.

      From TFS, it sounds like people are getting distracted and bored doing stupid mind-numbing tasks and when they do so, they make errors. As such, they have invented a bulky and expensive way to tell when you're drifting off (and that is fairly well correlated with making errors.)

      --
      The World Wide Web is dying. Soon, we shall have only the Internet.
    3. Re:I don't believe it by evanbd · · Score: 2, Insightful

      Exactly. The problem with getting bored / distracted isn't so much that you make errors, but that you don't usually notice until after you start making mistakes -- but the distraction is already clearly present, and I see no reason it shouldn't be detectable.

    4. Re:I don't believe it by venicebeach · · Score: 2, Informative

      Basically this particular task (the "flankers task") is so easy that people only make errors when they stop paying attention. You see something like SSSHHSSS or HHHSSHHH and you have to respond to the central letters while filtering out the outside letters. So what is essentially happening is they are measuring when people's attention wanes and errors happen to be reliably associated with this.

      Keep in mind that in this study errors are not actually predicted before they happen in real time. That's virtually impossible with fMRI. What's happening is that after the subject completes the task, the experimenters find data which comes from before the button press and reliably predicts subsequent errors. This happens in post-processing, so the experimenters do not actually know what is going to happen before it happens.

    5. Re:I don't believe it by oodaloop · · Score: 2, Insightful

      We've already shown that people typically DECIDE something like a second prior to when they THINK they decide. Matching up brain activity to verbal responses as to when a subject said he/she made a decision reveals the brain activity associated with making said decision occurs BEFORE they were consciously aware of it.

      If some specific mental machinery leading up to that were to be shown to lead to errors, it seems plausible that errors could be predicted.

      --
      Tic-Tac-Toe, Global Thermonuclear War, and relationships all have the same winning move.
  2. I agree by BadAnalogyGuy · · Score: 5, Funny

    The parent post makes a very good point. I agree with him wholeheartedly. You may be able to predict actions, but how can you predict whether an action will be an error?

    Mod parent up!

    1. Re:I agree by i+kan+reed · · Score: 5, Funny

      Like the error of forgetting to click "Post Anonymously" when making a post agreeing with yourself.

    2. Re:I agree by GeffDE · · Score: 5, Interesting

      Parent makes sense intuitively, but there are parts of the brain that are very sensitive to conflict; the anterior cingulate cortex (ACC) is one of these.

      If you have ever take part of a Stroop test, your ACC has been activated. In a Stroop test, the word for a color is printed in a different color i.e. the word green is shown in the color red. A participant is asked to say either the word or the color. As the speed of doing these discriminations increases, so do errors; interestingly, cognizance of errors is nearly instantaneous, however. You know that you made an error, even before the neural circuitry committed to speaking the words has finished forming the words.

      The ACC becomes more active in Stroop tests because Stroop tests cause conflicts in two neural circuits. The ACC arbitrates these circuits. Therefore, an increase in ACC activity (which will happen in advance of the error occurring) correlates with an increase in likelihood of mistakes...more in-depth research and some algorithms (I haven't RTFA) means that an error can be predicted, but of course, not with 100% success.

      --
      It has been a nervous year, with people beginning to feel like Christian Scientists with appendicitis.
    3. Re:I agree by Anonymous Coward · · Score: 2, Informative

      I hate pdfs, so here is a screencap of the brain imaging picture from the pdf:

      http://img105.imageshack.us/img105/1130/brainimagingwz8.jpg

    4. Re:I agree by FooAtWFU · · Score: 3, Funny

      Therefore, an increase in ACC activity (which will happen in advance of the error occurring) correlates with an increase in likelihood of mistakes. I get distracted and make mistakes when I'm watching basketball games too.
      --
      The World Wide Web is dying. Soon, we shall have only the Internet.
    5. Re:I agree by TheRealMindChild · · Score: 3, Insightful

      As someone who has taken too many of these tests, the problem ends up being your mind gets bored with the whole exercise withing minutes... these test take hours. After about 10 minutes at MOST, your brain starts to wander. You can NOT focus on the test no matter how much mental effort you put into these. It simulates situations like driving a car where actions and attention become so repetitive that there is an autopilot mode that kicks in. Bit in the same regard it can't be applied logically to situations like being in a boxing ring, because in those circumstances your brain is constantly adjusting to vectors that can't possibly be predicted, therefor always being up to paying attention at the task at hand.

      --

      "When life gives you lemons, don't make lemonade. Make life take the lemons back!" -- Cave Johnson
    6. Re:I agree by GeffDE · · Score: 2, Interesting

      But there are some subset of errors that are known to be errors when they are performed. Your analysis is for a certain type of error that, realistically, can't be predicted. So why bother. Here's the usage scenario for this type of "error" prediction...

      You are using a computer, and you are presented with a dialog to either delete a file or cancel the dialog. You do not want to delete the file, but you click the delete button anyway. In your brain, before your finger clicks the mouse button (because the neural and muscular circuits responsible for setting that in motion take some time), you know you made an error, but you are already committed to the action and cannot stop it. A machine monitoring your brain will know you do not mean the input you are providing and will therefore disregard it, saving your file.

      If you want to be ornery about something, be ornery with the vagueness of the headline...but then again, the headline is just about as vague and sensational as all /. (and even regular news) headlines.

      --
      It has been a nervous year, with people beginning to feel like Christian Scientists with appendicitis.
  3. Put electrodes on your scalp to detect errors? by tg2k · · Score: 4, Funny
    Given what it's supposed to tell about people, let me be the first to dub this device "the asshat".

    And I certainly hope it never hits the market.

    1. Re:Put electrodes on your scalp to detect errors? by Harmonious+Botch · · Score: 2, Funny

      I want one when talking to women.

    2. Re:Put electrodes on your scalp to detect errors? by Ox0065 · · Score: 2, Funny

      or maybe the con-dome

      --
      thx e
  4. If you're falling asleep... by Etherwalk · · Score: 2, Insightful

    If you're falling asleep on the road, you're more likely to make the error of driving to one side. Similarly, if you're getting distracted by a stray thought, your concentration can suffer and are more likely to make errors in your primary task. You may not predict the exact error, but you can reasonably forecast an increased probability of error.

    Why else would car insurance rates rise when you get into an accident? Um... you know, aside from evil insurance companies?

  5. an idea... by theheadlessrabbit · · Score: 4, Funny

    Will they ever be able to make a hat that lets slashdot users know if they will be modded '+1 funny' vs '-1 flamebait?' 6 seconds before clicking 'submit?'

    --
    -I only code in BASIC.-
    1. Re:an idea... by dfm3 · · Score: 2, Funny

      Yes. In fact, I knew that this comment would be modded up, so I just had to post it. *crosses fingers*

  6. Errors? by E.+T.+Moonshade · · Score: 2, Insightful

    My question is this: Will the knowledge that an error will occur cause the person in question to be even -more- likely to cause an error? Belief can be a dangerous thing in this case:
    "You're gonna make an error."
    *user has minor panic, nervousness, etc*
    "See? You errored. You suck."

    Makes me wonder if it would self-perpetuate if it were a self-monitored system rather than an externally monitored one - and once externally monitored, would the reaction time be sufficent to prevent the error? Sounds like some slick science on paper, but it seems like it'd fail in practical use.

    --
    "In caelum, illuc est libertas."
    1. Re:Errors? by amRadioHed · · Score: 3, Informative

      The device actually predicts when you are not concentrating on your work, and that is what people would be told if they ever were to use such a thing in production. I think the notice that you are losing concentration would probably be enough to get you concentrating again on your work. Especially if the workers were penalized for time spent not concentrating.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    2. Re:Errors? by Bill+Dog · · Score: 2, Insightful

      But it would be hard to concentrate if I was constantly worrying about losing concentration and being startled at any moment by a machine yelling "CONCENTRATE!!!!!!!!!!" at me.

      --
      Attention zealots and haters: 00100 00100
  7. But can it predict by Anonymous Coward · · Score: 2, Informative

    when the editors will err and post a dupe?

  8. thats a Bad Analogy, Guy! by infonography · · Score: 3, Funny

    oh wait.

    --
    Sorry about the writing. Robot fingers, you know? Cliff Steele in DOOM PATROL #23
  9. That's good news! by ArcherB · · Score: 2, Insightful

    While imaging machines are far too big and complex to be used in workplaces to monitor the brain activity of people engaged in important tasks... Thank God!
    --
    There is no "I disagree" mod for a reason. Flamebait, Troll, and Overrated are not substitutes.
  10. W7 by powermacx · · Score: 3, Funny

    "You are about to make a mistake. Cancel or Allow?"

  11. Re:Seems obvious to me by amRadioHed · · Score: 2, Informative

    It sounds to me that the key finding is that they can detect when a person is distracted by monitoring their brain waves. A much more interesting finding than that distracted people make errors.

    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  12. Genius, he has it by OMNIpotusCOM · · Score: 3, Funny

    No no, you see, he was proving that you can't predict mistakes before they happen. If someone could, why would they allow him to agree with himself? He's... taking one for the team, if you will.

  13. The "error detection" hat may be misinterpreted. by Ungrounded+Lightning · · Score: 3, Interesting

    The descriptions of "the error-detecting hat" look like the intent is to train the brain to stay alert and not make errors - or to refocus it when it wanders. (DING DING DING! HEY! WAKE UP! PAY ATTENTION!) The hat may be useful, but that use of the feedback may be the wrong approach.

    The signature they're describing corresponds, not just to a lack of alertness, but specifically a lack of alertness because the brain is going into a resting state. Seems to me that might be because all this decision-making has made the working regions of the brain tired and the brain is trying to clear them out so they'll operate properly again. So the problem is not the lack of alertness, but the attempt to continue to make decisions during the resting cycle.

    Given that, a better use of the feedback might be to tell the wearer that it's time to stop making important decisions and take a break, rather than trying to overuse a "mental muscle" that's exhausted - and perhaps train him to recognize the mental state himself so he can then dispense with the hat.

    The "break times" in working days were set up when studies showed that taking breaks, despite the "work time lost", resulted in more and better work in the work time remaining. This looks like a way to optimize the process, rather than running breaks on a clock.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  14. Over-Reaching a Bit by Nemus · · Score: 2, Interesting

    I have to agree with other people who've posted that this is over-reaching a little bit. This is nothing more than a correllational study: all they can say is that these systems, in this particular series of trials, showed increased activity shortly before an error took place.

    The main problem as I see it is that since they can't determine causaltiy, and only conducted this experiment with a small sample population, and with a specific task, is it could have been the task itself causing the particular regions to become active after a certain period of time. I just gave the article a quick look through, but I'd be curious to see if the errors came in distinct, set intervals. It could be simply the nature of the task that caused the activity. Furthermore, what about left handed participants? What about age groups outside of the twenties (which are a particular cohort, and can be expected to have similiar results/activity as such)? It seems like they failed to counterbalance either their participants or their trials in any meaningful way.

    Also, I'm not familiar with this journal or whatever it is, but I've never seen one where the methods section came last, which is a little strange. That's almost always the first thing I go to after the abstract.

    --
    Mod Points: Helping you keep your opinion to yourself.
  15. Walking by Iamthecheese · · Score: 2, Interesting

    There are activities that can be handed off to the unconscious mind. If you are doing something so often that it seems like you could do it in your sleep, well, there's no reason not to hand it off to a subprocess and think about more important stuff.

    I think they are detecting abortive hand-off attempts: A training process for a different part of the brain than one's conscious mind. More complex motions or actions require more training. I think what we need isn't more concentration, but more error tolerance.

    --
    If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
  16. The Head of the Microsoft Vista development group by monoqlith · · Score: 2, Funny

    was wearing an in-house version of this hat before he decided to release Vista. Unfortunately, the hat was running Vista.

  17. I Can Do This, Too, Sometimes by Pooua · · Score: 2, Interesting

    I've noticed that before I make certain mistakes, or completely forget what I was doing, I will experience a spike in confusion. Sometimes, the ramp up the spike is slow, taking most of an hour; other times, it comes on me suddenly, taking only a minute. I feel confused and doing simple tasks are difficult. Then, it passes. Often, I will have completely forgotten what it was I was attempting to do, until much later when something reminds me.

    --
    Taking stuff apart since 1969 (TM)
  18. Re:uh oh by billcopc · · Score: 2, Informative

    I can make an EEG monitor that IS a baseball cap. By carefully measuring the angle of the visor relative to the wearer's head, as well as a few environmental factors such as precipitation, temperature and altitude, I can identify half-bred imbeciles with shocking accuracy.

    I can also tell with 100% certainty that a person wearing a ballcap will make a mistake. That mistake is asking me to fix their computer.

    --
    -Billco, Fnarg.com
  19. EEG, Prediciting and Probability by DynaSoar · · Score: 2, Informative

    "Prediction" is not accurate because that implies an absolute. The activity correlates with an increased probability of making a mistake. The study relies on statistics throughout, from the analysis of the fMRI data on, and so can only deal in probabilities.

    An Israeli team found that an increase in degree of synchronization of midline frontal theta EEG varied inversely with the probability of making a mistake. Such theta synchronization occurs over spans of 10 to 30 seconds. They also found that when a response occurs during the rising or falling slope of the synchronized theta (as opposed to near a peak), the person was more likely to make a mistake. The latter probably is the source of the evoked potential called the Error Related Negativity; it is the brain preparing to notice the error. The former seems to indicate a lagging in attention, which is when errors are most likely to occur. The two are related, meaning the brain "knows" when it is starting to droop and is more likely to make a mistake, and tells itself to get ready to notice a mistake if it happens.

    --
    "I may be synthetic, but I'm not stupid." -- Bishop 341-B