Slashdot Mirror


Quadcopter Guided By Thought — Accurately

ananyo writes "A toy quadcopter can be steered through an obstacle course by thought alone. The aircraft's pilot operates it remotely using a cap of electrodes to detect brainwaves that are translated into commands. Ultimately, the developers of the mind-controlled copter hope to adapt their technology for directing artificial robotic limbs and other medical devices." From the paper (PDF) abstract: "... we report a novel experiment of BCI controlling a robotic quadcopter in three-dimensional (3D) physical space using noninvasive scalp electroencephalogram (EEG) in human subjects. We then quantify the performance of this system using metrics suitable for asynchronous BCI. Lastly, we examine the impact that the operation of a real world device has on subjects’ control in comparison to a 2D virtual cursor task. Approach. ... Individual subjects were able to accurately acquire up to 90.5% of all valid targets presented while traveling at an average straight-line speed of 0.69 m s^(1)." This also appears to be the first time a Brain-Computer Interface was used to operate a flying device in 3D space. Also, there are several additional videos showing people operating the quadcopter.

79 comments

  1. Did they have to think in German? by xtal · · Score: 3, Funny

    -nt-

    --
    ..don't panic
    1. Re:Did they have to think in German? by Hypotensive · · Score: 3, Funny
    2. Re:Did they have to think in German? by alexhs · · Score: 1

      German. But you can switch to Japanese if you prefer.

      --
      I have discovered a truly marvelous proof of killer sig, which this margin is too narrow to contain.
    3. Re:Did they have to think in German? by GodfatherofSoul · · Score: 1

      My vote for the original Firefox.

      --
      I swear to God...I swear to God! That is NOT how you treat your human!
    4. Re:Did they have to think in German? by arielCo · · Score: 1

      Anfang des Nervenanschlusses, bestätigt. Strüdel ... bratwurst ...

      --
      This post contains no rudeness or derision of any kind. All arguments are friendly. Terms and exclusions may apply.
  2. The future lament of pilots by cold+fjord · · Score: 3, Funny

    Do what I say, not what I think!! (At least not that particular thought.)

    --
    much of left-wing thought is a kind of playing with fire by people who don't even know that fire is hot - George Orwell
    1. Re:The future lament of pilots by Motard · · Score: 4, Funny

      Squirrel!!! *crash*

  3. Do you have to think in russian? by Anonymous Coward · · Score: 1

    http://www.imdb.com/title/tt0083943 :)

    1. Re:Do you have to think in russian? by click2005 · · Score: 1

      You laugh but I'd love to see a TV show of teams fighting each other with these in a laser tag arena.

      --
      I am a free slashdotter. I will not be modded, blogged, DRM'd, patented, podcasted or RFID'd. My life is my own.
  4. SO COOL by GameboyRMH · · Score: 1

    Really gotta get myself an EEG headset sometime...I wonder what other signals it could be tuned to pick up? What happens if you think about moving a nonexistant limb, would anything happen? That could free up your hands and feet and let you control other things with your mind.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
    1. Re:SO COOL by Aguazul2 · · Score: 5, Informative

      Really gotta get myself an EEG headset sometime...I wonder what other signals it could be tuned to pick up?

      Okay, then get ready for lots of goo. You need conductive paste for any kind of serious work. Also, there is the small matter of your skull getting in the way of the signals -- like listening to a symphony through ear protectors.

      (I was involved in the OpenEEG project for a time -- dreams of an efficient BCI (brain-computer interface) to beat my keyboard as an input device were soon shattered.)

    2. Re:SO COOL by fractoid · · Score: 2

      The one they were using looked pretty funky, I wonder what the difference in performance is between that one and the cheapie toy ones you can get commercially? The Emotiv Epoc is $300 and apparently (with some hackery) can get you the EEG outputs that you usually have to buy the $700 one for.

      I can't help wondering where exactly this is on the scale between actually picking up specific thoughts (or at least muscle intentions) and just using some global clock signal (like that one that detected the change in theta waves or whatnot when you opened/closed your eyes).

      --
      Rampant carbon sequestration destroyed the Dinosaurs' tropical paradise. I'm here to help repair the damage.
    3. Re:SO COOL by GameboyRMH · · Score: 1

      Aw man I was really hoping the paste problem had been overcome :-(

      Still I'd consider something more invasive if it were useful and futureproof enough.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    4. Re:SO COOL by cffrost · · Score: 2

      Really gotta get myself an EEG headset sometime...I wonder what other signals it could be tuned to pick up?

      Okay, then get ready for lots of goo. [...]

      Up to here I thought we were about to start talking about EEG-controlled fuckbots. :o(

      --
      Thank you, Edward Snowden.

      "Arguments from authority are worthless." —Carl Sagan
    5. Re:SO COOL by Anonymous Coward · · Score: 0

      I can't help wondering where exactly this is on the scale between actually picking up specific thoughts (or at least muscle intentions) and just using some global clock signal (like that one that detected the change in theta waves or whatnot when you opened/closed your eyes).

      Basically what you do is train the software to react to certain patterns of neural activity which you produce intentionally. You could, for example, punch yourself in the left eye and tell the computer you want the resulting pattern to indicate "fly left", then you could have someone kick you in the balls and that pattern mean "fly up", and so on.
      It's not actually reading thoughts or directly reacting to them, although you could theoretically train the system to simulate that.

    6. Re:SO COOL by Blaskowicz · · Score: 1

      Thinking about moving an nonexistent limb is something that would happen naturally.. if that limb was cut off. If you really want a "third hand" controlled by motor nerve impulse (which is probably quite different that an EEG, and which is what I understand by "think about a limb") it would require extensive and long training, I think, like people learning to walk again. Or you would have to do this at a very young age and it would be nearly impossible with an adult brain (dunno).

    7. Re:SO COOL by t4ng* · · Score: 2

      These guys are a bit late to the party. The military is already providing thought controlled artificial limbs that are far more complex than a quad-copter.

    8. Re:SO COOL by Em+Adespoton · · Score: 1

      Agreed; easier to link the signal to something else you can control in thought that doesn't distract too much; sub-vocalization of specific words would probably do the trick (although you couldn't talk while doing that) or linking it to imagining yourself floating, falling rising, going left, etc (which would be an extremely weak signal for an EEG to relay in any meaningful way).

  5. Better idea... by Anonymous Coward · · Score: 3, Interesting

    Screw the drone, hook him up to Quake 3 and lets see him pull off some sweet strafejumps...that'll be a better benchmark :D

    Also i'm thinking that perhaps they should focus more on feedback. If visual feedback is the only thing he gets, especially with the delay, it'll take him a lot longer than if he had say, rumblepack belts attached to him which gave feedback on direction, tilt, speed etc.

  6. Straight Up! by Anonymous Coward · · Score: 0

    That is fucking fantastic!

    And the videos are a year old.

  7. A natural progression by jellomizer · · Score: 1

    I can see this as a natural progression.
    First we have direct brain control for very basic, then it gets more detailed. Finally we can get to less invasive methods of monitoring the brain activity.
    Once we get that good, I could see getting more details for more finer type of movements. After we get a good map of the movement sectors of the brain, we may want to scan other sections such a vision we we can record what we see, or hearing. Perhaps we could scan our language processing areas and make real time interpreting software. Or allow us to send complex commands by though.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    1. Re:A natural progression by wagnerrp · · Score: 5, Informative

      You're thinking about this the wrong way. Most of these systems are like training your brain how to walk again after a serious trauma. You just hook up electrodes to a patch of cortex and come up with some unique brain pattern that you will use as a trigger for a certain task. You program the computer to respond to that pattern, providing a feedback response. Using the feedback, you train your brain to more accurately produce that pattern, while you simultaneously tune the computer to pick up on the evolving pattern. These are not the kinds of things you just plug in and go, they take considerable time and effort to make work for each individual.

    2. Re:A natural progression by theIsovist · · Score: 1

      The fact that you have to learn how to produce these patterns makes me wonder what would happen if you "attached" these to a very young infant. From what I have read, their brains are wiring themselves based off of responses to their actions. I wonder if the thought controlled robot could become an extension of their own body if they are introduced to it at a very young age. I imagine it's harder to learn to control these actions once your brain has a basic understanding of what does what, hence the learning curve.

    3. Re:A natural progression by MozeeToby · · Score: 1

      From what I have read, their brains are wiring themselves based off of responses to their actions.

      So is yours. This idea that infants are unique in the way they learn doesn't do the adult brain justice. My daughter has been teaching herself English via total immersion for 2 years (with of course, help from mom and dad and everyone else around her) I could match her progress in some other language in a matter of weeks (thanks largely to the enormously complex framework that my mind already contains).

      The point is, you have a lot of tools at your disposal that the infant doesn't. You know what your goal is, you want to the quad copter to move up, for example. You will get excited and gratified when it happens, which helps the feedback look get established. Infants, on the other hand, spend lots of time just doing stuff, and watching what happens. They are building relationships between thought and action but they are doing it in a very haphazard way.

    4. Re:A natural progression by JTsyo · · Score: 1

      Trouble with that is that the infant wouldn't know to try to use it. So you would have to just pick arbitrary commands for the computer to watch for. The infant might never think them or even if he does, he might not realize the link. Think of it as recording a marco, you need to do it the first time before you can use it.

    5. Re:A natural progression by dinfinity · · Score: 1

      Yes. As is visible in the video, the amount of control the user actually has is deplorable.
      The whole obstacle course looks nice, but the copter is never actually shown to do anything in it for more than 0.5s. And that is with a thoroughly trained system.

    6. Re:A natural progression by andydouble07 · · Score: 1

      Thankfully my brain hasn't yet learned to walk, that sounds like it could cause some serious problems.

  8. The Hand by fredrated · · Score: 1

    Personally I think the hand is still the best tool we have to do physical manipulation. That is what it was designed for and it is excellent. Since we don't use our 'minds' to move objects normally, I think the hand, or a hand-guided tool, will always be the best.

    1. Re:The Hand by Anonymous Coward · · Score: 0

      I can relay complex, nuanced thoughts via my mouth a lot faster than I can with my hands. And I am a fairly decent typist.

      You may be correct, but I would like to think that a sophisticated system used by a person trained frequently and at an early age would be superior to hand guided movement.

    2. Re:The Hand by ElectricTurtle · · Score: 2

      Luckily there are people who are not as narrow-minded as you to move us forward.

      1) Not everybody has hands or control over them. Technology like this will be priceless for amputees and people with muscular or other degenerative diseases.

      2) This is a first generation technology, as systems like this are refined, they can potentially exceed the range of our physical control through cutting response time and scaling up the "granularity" of control while eliminating "interference" (e.g. the involuntary shaking of muscles).

      --
      I support the Slashcott and will not be reading or commenting from 2/10/14 to 2/17/14. Beta is steaming pile of dog shit
    3. Re:The Hand by Anonymous Coward · · Score: 0

      > 2) This is a first generation technology, as systems like this are refined, they can potentially exceed the range of our physical control through cutting response time and scaling up the "granularity" of control while eliminating "interference" (e.g. the involuntary shaking of muscles).

      Not with skin electrodes, and not without sensor electrodes laced into the nervous system at a very high resolution. The closest approach to anything like that was David Edell's work at MIT, and for that approach, you have to transect the nerve and let neurons grow back through the semiconductor array. This is *not* recommended for direct brain interfaces!!!!

      Skin electrodes pick up ridiculous amounts of electrical noise, no matter where you put them. Digital processing *does not help*, because the signal is so noisy in the first place and the very act of digital sampling for any modern A/D converter throws away critical edge detection information. So no, adding computers does not fix the problem.

    4. Re:The Hand by Anonymous Coward · · Score: 0

      > We don't use our 'minds' to move objects ???

      Our 'mind' (why the quotes?) sends the movement information to the hand. Since there are no neurons in the hand, I'm pretty sure the mind has to break down the desired result into a series of complicated commands designed for each muscle group and adjust them with the returning feedback until the desired result is achieved. It would be MUCH easier for your brain to just send the desired result command to an intelligent, mechanical appendage that would take care of achieving the desired result within its own feedback loop.

      Think beyond two hands. What about four extra arms, all intelligently independent, yet obeying your commands without you having to pay attention to the detailed breakdowns? Much easier than having to control all of them. What could possibly go wrong?

    5. Re:The Hand by Anonymous Coward · · Score: 0

      Personally I think the hand is still the best tool we have to do physical manipulation. That is what it was designed for and it is excellent. Since we don't use our 'minds' to move objects normally, I think the hand, or a hand-guided tool, will always be the best.

      Your hand wasn't designed for anything, it evolved. And it moves because your mind told it to. The point is that there is no such thing as a "hand guided" tool, because your hand isn't guiding anything it's your brain doing the guiding.

    6. Re:The Hand by wagnerrp · · Score: 1

      You know, you use your "mind" to control your hands, right?

    7. Re:The Hand by Anonymous Coward · · Score: 0
      1) How about we get off our asses and figure out BIOLOGY?! A salamander can regrow its limbs, why can't we?

      2) First generation? I've seen stunts like these for 20 years in various electronics hobbyists magazines.

    8. Re:The Hand by GodfatherofSoul · · Score: 1

      Ten thousand years ago, I bet you would've been that caveman skeptic crapping all over Grog's new fandangled "wheel."

      --
      I swear to God...I swear to God! That is NOT how you treat your human!
    9. Re:The Hand by Anonymous Coward · · Score: 0

      Since there are no neurons in the hand,

      You may want to consider retaking junior high biology.

    10. Re:The Hand by Somebody+Is+Using+My · · Score: 2

      Ten thousand years ago, I bet you would've been that caveman skeptic crapping all over Grog's new fandangled "wheel."

      Grog wheel no good! Look, it go 'round and 'round; it start here and then come back here! How that work? Thog no want go 'round; Thog want go places! Grog wheel stupid.

      And what good Grog wheel? Thog want go somewhere, Thog walk. Thog want go somewhere faster, Thog run!

      Grog say wheel help carry heavy thing, but Grog wheel made of stone; Grog wheel /is/ heavy! Thog need wheel just to carry wheel, ha-ha!

      Grog wheel stupid; Thog no need and no want. Almost as bad as Mog fire-thing. Who want all that smoke and burnt meat?

  9. Cool by DeathToBill · · Score: 1

    Now to hook this up to my flying car...

    --
    Slashdot - News for Nerds, Stuff that Matters, in ISO-8859-1 Has just realised that beta makes this signature redundant
  10. What if... by Anonymous Coward · · Score: 0

    Go and scare him!

  11. America fuck yeah! by Anonymous Coward · · Score: 0

    Rest of world, are you even trying?

  12. A cat version please by temcat · · Score: 1

    All this is fine, but can they make a version controllable by cat's thought?

    1. Re:A cat version please by kurt555gs · · Score: 1

      Cats will then control the world. Be careful what you wish for.

      --
      * Carthago Delenda Est *
    2. Re:A cat version please by Anonymous Coward · · Score: 0

      I think I have already. They both just lie there and both have an irregular tendency of making an interesting muffled grinding noise without going anywhere.

    3. Re:A cat version please by meowgoesthecat · · Score: 1

      That sounds excellent.

      --
      Meow
    4. Re:A cat version please by tgd · · Score: 1

      All this is fine, but can they make a version controllable by cat's thought?

      I saw the subject of your post and thought you were looking for one you can use to control a cat.

      At 4am, that is something I'd find very useful.

    5. Re:A cat version please by StuartHankins · · Score: 1

      Oh! We're all going to die when that happens...

    6. Re:A cat version please by Somebody+Is+Using+My · · Score: 2

      All this is fine, but can they make a version controllable by cat's thought?

      Shouldn't be too hard; they can modify the already-existing thought-control mechanism* used by felines to control their bipedal drones.

      Cat glances meaningfully at food bowl. "Hungry"
      Human gets up and puts food in bowl.
      Cat rolls over on back and thinks "Rub"
      Human stops what he is doing and dutifully scrubs the inviting tummy.

      * may not be compatible with all drones.

  13. Half second phase delay by Anonymous Coward · · Score: 1

    The roughly 500 msec phase delay from having to average the very noisy electrical signals detectable on the skin into a valid, usable motor controller was the failing point of the Boston Arm, and seems to be the problem of this system as well. It's just not going to be as quick as something that's tied directly to the physical neural structure and signal processing built into normal nerve-muscle interfaces, which are specific, complex, adaptive, and generated in a physical 3-D structure with its own processing capabilites.

    But it's fun to play with my-electric or other skin sensor based systems.

  14. What happens by Anonymous Coward · · Score: 0

    So what happens when a beautiful woman walks in and his thoughts jump to "BOOBS"?

    1. Re:What happens by Anonymous Coward · · Score: 0

      So what happens when a beautiful woman walks in and his thoughts jump to "BOOBS"?

      Nothing. These don't read your thoughts, they pick up on general patterns of electrical activity. The only way thinking "BOOBS" will do anything is if you train the system to react to the specific neural pattern generated when you think "BOOBS". And they aren't that precise, not by a long shot.

      Captcha: Boners

  15. Parrot automatic correction by loufoque · · Score: 1

    As can be seen, the drone used is a Parrot.
    The Parrot has pretty insane automatic correction so that it always stays stable and make smooth turns.

    Try moving like that while controlling the drone directly.

  16. They forgot one thing by Anonymous Coward · · Score: 0

    You should temporarily paralyze the muscles when testing. Otherwise you end up building control via invisible micromuscle movements of the scalp muscles and muscles in the jaw, chins, et cetera. You have to make sure only the mind moves!

  17. Quad? by pla · · Score: 1

    Now make it available to "pilot" quadruplegic people.

    The military already has basic mech-suits. Combine it with a functional BCI, and we've effectively made one of the most horrific of human injuries a mere nuisance.

    That said, as an able-bodied person, I'll still gladly take a few BCI-enabled toys - When can I get one of these?

    1. Re:Quad? by dkleinsc · · Score: 1

      I'm just imagining what this might do for say, MC Hawking - I mean, you think that guy is badass now, we could turn him into Iron Man.

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    2. Re:Quad? by K.+S.+Kyosuke · · Score: 1

      ...we could turn him into Iron Man.

      So could a lost wax metal cast, mind you.

      --
      Ezekiel 23:20
    3. Re:Quad? by Anonymous Coward · · Score: 0

      I imagine make it available to "pilot" my dick into your ass.

    4. Re:Quad? by Anonymous Coward · · Score: 0

      That would require you to have one, fellow Anonymous Coward.

  18. Go University of Minnesota! by Anonymous Coward · · Score: 0

    Amazing work. If I was still a student, I'd start looking up the references in the paper - which, BTW is available here. It reminds me of how simple steps in signal processing can have such an amazing aggregate effect when applied.

  19. if out, why not in? by Connie_Lingus · · Score: 0

    you know, electrode caps really scare the crap outta me, because its not hard to see how a device used to read your brain signals could be modified to INSERT them too. as governments and take-over-the-world types learn more and more about how the brain works, wouldnt it be a great plan to use brain-caps to control peoples actions and turn them into the true mind-numbed robots that pop culture like to report on so..

    it would an interesting career to experiment with sending signals INTO the brain...for the kids, of course...

    --
    never bring a twinkie to a food fight.
    1. Re:if out, why not in? by wagnerrp · · Score: 1

      because its not hard to see how a device used to read your brain signals could be modified to INSERT them too

      Yes. Yes, it really is. This isn't the computer reading your mind, so much as it is your mind learning how to talk to the computer. There is a steep learning curve as your mind rewires itself to be able to produce the kinds of signals the EEG is set up to trigger off of. There is no way this could operate in reverse with our current level of technology and understanding.

  20. Brain cancer? by nrjperera · · Score: 1

    Wow this is impressive. Just what I needed for Christmas, a brain cancer. lol

  21. Tim Maughan - Street Iron by Anonymous Coward · · Score: 0

    Reminds me of the mechanic from Tim Maughan's short story "Street Iron" in his Paintwork collection, where young Cuban techies play a mech-warrior style game using the real world as their environment and control the mechs purely through mind control.

    Good stuff.

  22. Here's what I'm thinking... by mholve · · Score: 0

    Snatching pizzas out of thin air!

    http://www.nbcnews.com/technology/dominos-domicopter-drone-can-deliver-two-large-pepperonis-6C10182466

  23. 1960s called by tristes_tigres · · Score: 1

    They want their "Biofeedback" fad back.

    Though it could have been newsworthy, if they used Raspberry Pi in 3D-printed box to implement the control algorithms.

  24. Or maybe it's already been done... by t4ng* · · Score: 3, Informative

    The Modular Prosthetic Limb, developed by the Johns Hopkins University Applied Physics Laboratory with funding from the Defense Advanced Research Projects Agency provides 26 degrees of motion, including independent movement of each finger, in a package that weighs about nine pounds and has the dexterity of a natural limb. In 2012, a patient at the University of Pittsburgh Medical Center successfully demonstrated that the arm could be controlled by the user’s thoughts. Several patients, including a decorated Afghanistan war hero, are helping researchers further develop the prosthesis. In 2013, the MPL will continue to be tested and refined in a clinical trial at the California Institute of Technology.

    1. Re:Or maybe it's already been done... by t4ng* · · Score: 1

      Not my words... copied from an article.

    2. Re:Or maybe it's already been done... by Anonymous Coward · · Score: 0

      The problem with ALL prosthetic limb research is that we see a ton of very nice and very expensive prototypes, but nobody moves onto production models - which is why 60% of people who are missing an arm don't bother with a prosthetic, and of those who do, the majority use a design developed by the army back in the 60s.

  25. Ooops by LeadSongDog · · Score: 1

    "If thoughts could ^H^H^H^H^H^H^H^H^H^H^H^H^H^H^HWhen thoughts can kill" this may not be seen as such a great idea.

    --
    Oh, I'm sorry sir, I thought you were referring to me, Mr. Wensleydale.
  26. I don't get it by stackOVFL · · Score: 1

    Except for the obvious disabled folks can more stuff, why is thought control better then just using you thumbs on a joystick? Seems to me it's much harder to put on a scull cap, try to think of just one thing for a long time and so on verses picking up a controller and flying the thing. Or, do we intend to have an army amputees piloting drones in the future?

  27. Silver Lining by ThatsNotPudding · · Score: 1

    Far fewer idiotic public appearances by polititians and celebs - at least not without covering ack-ack.

  28. Remote control by thewils · · Score: 1

    The person doing the controlling and the robot don't need to be in the same location...it could be that a robot could effect repairs in space controlled by a person on the ground by thought, or a surgeon could similarly control a robot to work on battlefield casualties.

    --
    Once I was a four stone apology. Now I am two separate gorillas.
  29. Can I.. by Anonymous Coward · · Score: 0

    ..use this to browse pr0n hands-free?

  30. Squirrels beware ... by fahrbot-bot · · Score: 1

    ... I'm going to hook this up to my dog.

    --
    It must have been something you assimilated. . . .
  31. The proper URL for the paper (PDF) by jjacek · · Score: 1

    The paper (PDF, 1.7MB)

    1. Re:The proper URL for the paper (PDF) by Anonymous Coward · · Score: 0

      I was able to get to the article via this page. If the above link doesn't work.

  32. Today it's quadcopters... by readingaccount · · Score: 1

    ... tomorrow it's Iron Man suits.

    The future looks bright! And also a bit shiny.