Slashdot Mirror


Teen Plays Videogame With Brain Signals

SkyFire360 writes "A team of ECoG (ElectroCorticography) researchers from Washington University in St. Louis successfully wired a young man's brain up to a computer and began reading the neurological firings in his brain. After analyzing the action potentials created when a neuron fires, they were able to get two-dimensional control of a cursor. Taking the research one step further, they decided to connect an old Atari 2600 to the signal processing computer to see if the young man could control the videogame system."

45 of 204 comments (clear)

  1. Funny. by AKAImBatman · · Score: 5, Interesting

    Space Invaders on an Atari 2600? Played with Mind Control?!? Very funny, guys.

    I suppose the researchers thought it would be hi-friggin'-larious to make the Atari Mindlink a reality. That way they really COULD play games with their mind! (Insert *snickers* and *gaffaws* here.) Considering that the original was a sham (you were really moving your brow to control the game), I'm not sure they really want to be associated with such "technology".

    On the other hand, I suppose they deserve some serious Geek Cred for making such an obscure reference with this experiment. Most people wouldn't "get it" anyway, and would only see the neat research going on. :P

  2. Sadly by SuperKendall · · Score: 3, Funny

    Sadly the first game hooked directly to his brain was Yars Revenge, and now the poor lad just goes around headbutting walls.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re:Sadly by Rob+T+Firefly · · Score: 3, Funny

      It could have been worse, they could have given him the old "E.T. the Extra-Terrestrial" game.

    2. Re:Sadly by Soygen · · Score: 2, Funny

      You could hardly control ET with a joystick, let alone with your brain.

    3. Re:Sadly by Paperweight · · Score: 2, Funny

      What happens when he plays one of those literally impossible NES games and in his frustration tries to break the controller in half?

    4. Re:Sadly by Rob+T+Firefly · · Score: 4, Funny
      After succumbing to severe brain damage, his body would be dumped in the New Mexico desert, flattened by a steamroller, and covered in concrete.
      Actually, he'd continuously try to get up out of the pit, but he'd keep falling back in immediately upon reaching the top.
  3. Uh oh... by BMonger · · Score: 4, Funny

    Can you make a Beowulf cluster of... teens?

    1. Re:Uh oh... by kfg · · Score: 4, Funny

      Can you make a Beowulf cluster of... teens?

      Just go to a mall and observe.

      KFG

    2. Re:Uh oh... by AdamThor · · Score: 3, Funny

      Beowulf cluster of teens would work poorly.

      1/IQ(tot) = 1/IQ(t1) + 1/IQ(t2) + 1/IQ(t3) ...

      --
      -- "Oh. This guy again."
    3. Re:Uh oh... by Kuj0317 · · Score: 4, Funny

      Unfortunately, the networking overhead causes the computation power of the group to be significantly less than that of any given individual.



      I am old. And bitter.


    4. Re:Uh oh... by kfg · · Score: 3, Funny

      Unfortunately, the networking overhead causes the computation power of the group to be significantly less than that of any given individual.

      And the output is psuedorandom - at best.

      KFG

  4. Im posting... by cmburns69 · · Score: 5, Funny

    I'm posting this with my mind. I hope I dont get modded down. Oh crap, I can't silence my inner monologue! Oh crap! crap! crap... *carrier lost*

    --
    Online Starcraft RPG? At
    Dietary fiber is like asynchronous IO-- Non-blocking!
  5. So what. by PrinceAshitaka · · Score: 2, Interesting

    I saw this ten plus years ago on PBS. It was a professor somewhere could control hos sail boat with this. This is nothing new. Call me when they can do more than binary control. That would be interesting.

    --
    quis custodiet ipsos custodes
    1. Re:So what. by omeomi · · Score: 3, Informative

      The same sort of thing is already being used for ADHD and depression therapy, as well:

      http://technology.timesonline.co.uk/article/0,,204 09-2379616,00.html

    2. Re:So what. by escherblacksmith · · Score: 2, Interesting

      The difference is the dude in the sailboat had trained his brain to generate a specific waveform through positive feedback which was then modified to handle left-right movement on the wheel on the sailboat. This is taking direct neuron firings from just above the brain, not outside the skull. Then training a computer to figure out what is controlling what. And they ended up with a 2-d test movement that worked as well. This is quite a bit different for the future of controls of systems outside of the normal nerve set. Like say the exampled prosthetic arm. Odds are, like most science, it is related to early research.

    3. Re:So what. by SkyFire360 · · Score: 5, Informative
      Hi. I'm SkyFire360, I wrote that program. I'm the guy in the blue shirt.

      Though we're the first lab to use the ECoG technology, even our resolution is too poor to accurately control things in more than two dimensions. A breakdown of the different resolutions of Brain-Computer-Interfacing is here. The problem with EEG is that the skull acts as a signal damper that disperses and blurs the electromagnetic waves created by the neurons. Though we can still detect the waves created, it becomes increasingly more difficult to discern what area of the brain created these waves, much less what neuron(s) did.

      A breakdown of the different types of BCI currently being developed and researched:
      • EEG - Electro-Encephalograph - Biggest advantage is that anyone can use it, as it can be worn like a helmet or a headband. Though because it is non-invasive, it has extremely poor resolution
      • ECoG - Electro-Cortocography - Though it needs to be implanted inside the skull, it produces fairly good resolution. Also, because it only sits on top of the brain as opposed to inside gray matter, it has much less of a chance to form scar-tissue (though still greater than zero). Tough to get more than one dimension of control.
      • Single Receptor - A microscopic electrode is placed directly in contact with a specific neuron or group of neurons. This allows researchers to directly measure the potential of one neuron firing. Of course, this requires the electrode to be implanted. This form of BCI is also very prone to scar-tissue buildup, causing the signal to become weaker and possibly lost as the body reacts to a foreign object in the brain.
      • Light Reactive Imaging - Still very theoretical - A laser is trained on a single neuron and its reflectance is picked up by a separate sensor. When the neuron fires, the laser light pattern and wavelengths that are reflected change slightly. This allows researchers to monitor a single neuron while leaving the tissue "untouched", negating the issue of scar-tissue buildup. However, this technology is not able to penetrate the skull yet, as would be needed for external/non-invasive BCI
      More information about BCI and ECoG can be found in a presentation from a WashU professor... actually, he's the guy standing behind the computer. Check pages 9-11 for some good slides

      Though keep an eye out for us at BMES... we just found coding for direction and velocity, and it is scalar. :D Oh yeah, anyone have any questions?
    4. Re:So what. by Anonymous Coward · · Score: 2, Informative

      I agree, this article is really old news. I worked on an undergraduate project two years ago as a freshman at the Johns Hopkins Biomedical Engineering department that aimed to use EEG signals as a form of non-invasive computer input device (EEG Keyboard). At that time, we had already seen a lot of demonstrations where games were played using implanted electrodes. They were far more impressive than this game.

      By the way, using EEG's is definitely possible. We managed to get usable signals from only 8 (full EEG setups usually have 256, 512, etc) EEG channels by using independent component analysis and principal component analysis to filter out the skull's dampening effect and the much stronger electrical signals that come from muscle movement (e.g. blinking). This allowed the user to type characters displayed on screen. Oh yea, I had to wear a tinfoil hat to help eliminate E-M interference and alien brain control waves from contaminating the data stream.

      Now, playing a game like this is much easier than typing. We adapted our program to allow users to play pong WITHOUT getting an electrode implanted in the brain by measuring singals from the motor imagery part of the brain, which is much simpler than the ERP's and VEP's we were dealing with for the keyboard. I assume they also used the motor imagery part of the brain. That's why you see the guy moving his fingers (he's not supposed to).

      The idea is, your imagine yourself moving a body part. The algorithm picks this up and moves the cursor. Now, your brain notices the correlation between the imagined movement and the movement on screen, and through brain plasticity, learns to associate the movement with some pattern of neurons firing. The signals actually INCREASE in strength as the user becomes more experienced with the device. In the end, you can control the cursor almost like it's a phantom limb.

    5. Re:So what. by RobertB-DC · · Score: 2

      Just for reference, the parent posted the same thing in the previous discussion of neural-interface gaming. But I think he can be allowed the cut 'n paste in this case... give him more time to design the next generation of motorized wheelchair controllers so I can terrorize the kids in the yard in my old age.

      --
      Stressed? Me? Of course not. Stress is what a rubber band feels before it breaks, silly.
  6. Did they figure it out, or did he? by Gotung · · Score: 5, Interesting

    Stories like this always make me wonder whether the people involved actually decoded the signals firing off in that guy's brain. I thinks it's more likely he learned to create the signals they were looking for.

    1. Re:Did they figure it out, or did he? by superpenguin · · Score: 2, Informative

      TFA describes a bit of a learning curve for the kid, so I'd say you're right. But the point is that the interface is feasible. I imagine anyone getting a new robotic limb would have to learn to use it, just like you have to learn to use your own limbs. The neat thing is that he was able to learn to create these signals very quickly with some degree of fine control. THe human brain is actually a very adaptable thing, even for older folks, as evidenced by the psychologist (I think) who had special glasses that flipped everything upside-down and after a few days was able to function quite normally. So as long as the interface works, it should be entirely possible for most people to learn to use it with relative ease.

    2. Re:Did they figure it out, or did he? by kfg · · Score: 5, Insightful

      Of course. How do you think you learned to manipulate objects with your hands? It's called "biofeedback."

      KFG

    3. Re:Did they figure it out, or did he? by CaffeineAddict2001 · · Score: 2, Insightful

      It was way simpler than that.

      They isolated which section of his brian was activated when he moved his tounge and hand. It sounds like the same sections fire when you just think about performing the actions.

      I bet the reason they used the tounge and hand rather then left hand\right hand is because they don't have the resolution on the grid to be able to differentiate the two.

      What I worry about is the long term effects of purposely sending "interrupt" signals to your body parts. Has this ever been studied before?

    4. Re:Did they figure it out, or did he? by Doctor+Memory · · Score: 5, Funny
      What I worry about is the long term effects of purposely sending "interrupt" signals to your body parts. Has this ever been studied before?
      Google for "blue balls"...
      --
      Just junk food for thought...
    5. Re:Did they figure it out, or did he? by SkyFire360 · · Score: 2, Informative

      Hi!

      We used the program BCI2000 for this task. This program allows us to sample 16 specific electrodes at a rate of 1200 hz, attaining frequencies up to 600hz. By reading data from calibration tests, we can then select the best electrodes that have the highest r^2 value for use with controlling it. I believe we're currently using a form of ICA for the signal analisys and we may move to something mroe complicated in the near future, but I'm the programmer on the team and not the electrical engineer. :)

  7. Dang. by Anonymous Coward · · Score: 5, Funny

    That means the Nintendo Wii is out-of-date already. *sigh*

    1. Re:Dang. by Shadowlore · · Score: 2, Funny

      Next Nintendo will be mind controlled and called the Mii

      --
      My Suburban burns less gasoline than your Prius.
  8. Uh... isn't that ONE dimensional control? by popo · · Score: 2, Insightful

    Last time I checked, space invaders was 1 dimensional movement not two.

    --
    ------ The best brain training is now totally free : )
    1. Re:Uh... isn't that ONE dimensional control? by MankyD · · Score: 3, Informative

      One dimensional in a purely mathematical sense, yes. However, to the mind, moving left and moving right are two separate actions. In that sense, you might be able to get away with calling it 2D (not to mention the fact that they also added the ability to fire - a 3rd action.)

      --
      -dave
      http://millionnumbers.com/ - own the number of your dreams
  9. not even close to the same but ... by jbeaupre · · Score: 4, Interesting

    Not close to the same but a few years ago I bought a used Zenith TV with built in Pong. Great deal, but it didn't have the controllers. Rather than build them right, my brother and I stuck stereo wire into the controller ports and held the bare wire ends in our hands. By carefully squeezing and releasing we could alter the resistance through our bodies (ok, it was altering the contact resistance mostly). We didn't have much problem playing but the method was so sensitive that we had to sit completely motionless without talking. We looked like a couple of zombies playing Pong with our minds. Too bad the TV fried itself in 3 weeks.

    --
    The world is made by those who show up for the job.
    1. Re:not even close to the same but ... by StarfishOne · · Score: 2, Funny

      I am honored to meet the inventor of the Pong Polygraph test. :)

  10. Re:Ps2 by TubeSteak · · Score: 3, Interesting
    Wasn't the PS2 supposed to do this?
    I know that PS2s have been hooked into neuro-feedback systems designed to do this.

    "Smart BrainGames"
    http://news.zdnet.com/2100-1040_22-5940181.html

    It's for AD(H)D kids & the example I remember was Burnout. Your brain waves controlled the accelerator. When you lost focus, you started slowing down (losing) when your brain waves were doing what the doctors wanted, you kept going full speed.

    Your Brain + PS2 = behavioral therapy
    --
    [Fuck Beta]
    o0t!
  11. Invasive technique by skorch · · Score: 2, Interesting

    I'm not too sure but the article seems to say that this method still requires invasive (i.e. surgical) techniques to extract the brain signals used to interface with the system. It did suggest that using EEG as a non-invasive alternative for getting those same signals, but I don't think they elaborated on why they didn't use it (I don't know much about either technique, so if someone more informed could enlighten me). I'm just wondering if there is a possibility of a cost-effective "thinking-cap" of some sort in the future that could provide the proper signals for gaming or other electronic activities, to avoid invasive brain plugs ala Matrix or Ghost in the Shell style interfaces.

    I'm just speculating about the possibilities and have no real knowledge of the practicality or viability for either of these techniques in the near future. For people looking to opperate prosthetic limbs and such, a permanent surgical plug of sorts seems like a fine solution, but for people who don't want to have to upgrade that plug each time the technology advances, a non-invasive system seems like a more ideal solution.

  12. Re:Epilepsy? by Daemonstar · · Score: 2, Informative
    the boy who had the grids implanted so that neurologists and neurosurgeons can find the area in the brain serving as the focus for an epileptic seizure, with hopes of removing it to avoid future seizures
    Because that's the whole reason why he has "grids" inside of his head. No "grids", no "mind control", apparently. :)
    --
    I don't reply to Anonymous posts; if you have something to say to me, identify yourself or I won't reply.
  13. I can already use brain signals to play games... by cobrajs · · Score: 3, Funny

    With this new system I developed, I can play games with brain signals! I send a brain signal to my finger to press the correct key, and presto! The avatar moves!

  14. Uh oh.. the mi-go are here. by Channard · · Score: 2, Funny

    I guess we'll hear teens talking on X-Box Live about their bitchin' new brain cylinders next.

  15. O'Reily E-Meter hacks by rHBa · · Score: 2, Funny

    Blast away those thetans by wiring your E-Meter into space invaders.

  16. Nostalgia (read: man, I feel old) by joeslugg · · Score: 2, Funny

    I had to snicker at how TFA had to invest a few paragraphs to fully describe Space Invaders for those young-uns who may not even have heard of it. A screenshot may have helped.

    Oh, btw - "Atari" was a home video game system. It's on Wikipedia. No, really - go look it up...

  17. Re:I bet that made you all happy by couchslug · · Score: 2, Funny

    The distributed storage model seems to be working fine, and is more fault-tolerant.
    Thanks for your concern!

    --
    "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
  18. I played pong with my mind by Rah'Dick · · Score: 2, Interesting

    Some months ago, a friend and me participated in an experiment conducted by the TU Graz - we were wired, took some calibration tests and were finally able to play Pong against each other - only with wired caps on our heads. It sort of worked, but was difficult to control without a proper training period.It worked by comparing our brain waves while thinking of moving our left or right arm and mapping the characteristic output to left-right commands. Sometimes it would work quite well but a lot of times the panel just would move utterly weird. I believe that this can work well, depending on how much you're used to it - we only had like one hour of training.

  19. Re:at last by Kozar_The_Malignant · · Score: 2, Funny

    Depends... For Liesure Suit Larry, it is inserted... never mind.

    --
    Some mornings it's hardly worth chewing through the restraints to get out of bed.
  20. Re:Connection? by SkyFire360 · · Score: 2, Informative

    Anyone who's doing BME research runs into ethical issues, and our lab is no exception. Ethically we cannot implant electrodes into a perfectly healthy human in vitro. The risks of risks far outweigh the benefits. However if we can help epileptic patients while doing research, we can aid in the healing of the patient while getting data at the same time.

  21. Re:Two dimensional? by MacJedi · · Score: 3, Interesting
    Makes me wonder, is there any DYI "mind control" kit out there so that you can process your brain signals to experiment with on a computer?
    Yup.
    --
    2^5
  22. minor point of accuracy by weisen · · Score: 2, Informative

    This is not measuring the action potential caused by the firing of a single neuron, as the writeup seems to indicate. This is measuring the aggregate signal from tens of thousands of neurons. The typical recording grid is a flexible material (silicone?) with a grid of circular electrodes about 5mm in diameter. The surgeon can place the grid on the cortical surface or cut off a strip and push it into a sulcus. Clearly not a single-cell recording.

  23. Not a good solution. by raehl · · Score: 2, Informative

    The computing power of a Beowulf Cluster of teens, where T is the power of one teen and n is the number of teens in the network, is T^(1/n).

    Even worse, if you connect your cluster to the internet, the effective computing power becomes T^(1/n)/B, where B is the bandwidth of the connection.

    There is a special exception to this, however, that takes into account the Mischief Coefficient. For any problem, P, with a fractional mischief component of M, the expected power becomes T^(1/(1-M)n).

    As we can see, for any problem with a Mischief Component of 1, the power of the cluster becomes infinite. In fact, using my Beowulf Cluster of Teens, I was able to determine that the more teens you have, the more infinite their power gets. For example, according to my BCoT, if you have 100 teens, your cluster would be 10 times more infinitely powerful than an infinitely powerful cluster of only 10 teens.

  24. Neurofeedback. by Aumshantih · · Score: 2, Interesting

    Namaste. I've been working as the systems administrator at the Neurodevelopment Center in Providence, RI. We're a psychological clinic focusing on using EEG-controlled neurofeedback to treat a whole bunch of psychiatric disorders, mostly things on the autistic spectrum and various forms of ADHD. The technology is still very new, and probably not quite as effective as one could hope, but we still get very good results - around 70% of our clients show significant improvement. Brain-Machine interfaces will thoroughly revolutionize the way think about psychiatry. Of course, the big pharmaceutical companies have a vested interest in maintaining the status quo, so expect to here a lot from detractors and skeptics in the years to come.