Slashdot Mirror

← Back to Stories (view on slashdot.org)

Japanese Scientists Claim To Reconstruct Images From Brain Data

Posted by timothy on from the shutter-to-think dept.

In a world first, a research group in Kyoto Japan has succeeded in processing and displaying optically received images directly from the human brain. Here's the Japanese press release for good measure. One step closer to broadcasting your dreams? The research is due to be published today in the US scientific journal Neuron

55 of 276 comments (clear)

  1. Predictably by AltGrendel · · Score: 5, Funny

    It was a male subject and the image was Hentai.

    --
    The simple truth is that interstellar distances will not fit into the human imagination

    - Douglas Adams

    1. Re:Predictably by philspear · · Score: 2, Funny

      You mean "The subject was an underpaid, overworked grad student/postdoc, and the image was 'NEURON' in a blatant example of pandering to a specific high-impact journal to increase the likelyhood of acceptance."

    2. Re:Predictably by linhares · · Score: 2, Informative

      Funny comment, but just bad science on the paper. The brain's signals are, in all probability, address space decoders, and the very idea that one could see images in anything higher than V1 is as loony as thinking that the moon is a large cheese. These kinds of imbecile attempts to fame will continue, but decades before we can read the porn in your brain we will be able to build some (very) intelligent shit.

  2. Dreaming Is A Private Thing by mcgrew · · Score: 3, Interesting

    The group of researchers at Advanced Telecommunications Research Institute International, including Yukiyasu Kamitani and Yoichi Miyawaki, from its NeuroInformatics Department, said about 100 million images can be read, adding that dreams as well as mental images are likely to be visualized in the future in the same manner.

    And once again Isaac Asimov predicted this.

    --
    Free Martian Whores!
    1. Re:Dreaming Is A Private Thing by geekoid · · Score: 4, Insightful

      No he did not.
      He wrote a story about something like this. People ahve thought about doing this for years.
      There is a difference in predicting something, and writing a story.

      He also wrote about a bunch of stuff that never happens, and won't likely happen.
      I like the mans work, but come on if he gets put any higher on a pedestal he'll be able to touch the moon.

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    2. Re:Dreaming Is A Private Thing by matthewsmalley · · Score: 3, Funny

      Maybe that's how we'll get a space elevator?

    3. Re:Dreaming Is A Private Thing by mcgrew · · Score: 2, Informative

      I'm still waiting for Sally; that story was set in the year 2120. I'm still waiting for R. Daneel as well.

      As to writing about stuff that never happened, THIS never happened - until now. The "hyperdrive" (what Roddenberry renamed "warp drive") was never invented - yet. Roddenberry and his writers were prescient, too. I remember a world without cell phones, flat screen talking computers, self-opening doors, and space shuttles (I remember a world without space travel at all).

      I merely mention Asimov because I thought of that story when I read TFA. He wasn't the only sci-fi author to predict advances, but he's the only one I can think of that predicted this one.

      The one thing I can think of that his crystal balls got wrong was Multivac, yet with its "terminals in every home and business" it was the closest of any pre-internet science fiction story I ever read to predicting the internet.

      --
      Free Martian Whores!
    4. Re:Dreaming Is A Private Thing by gnick · · Score: 3, Funny

      He can probably already touch the moon. Don't you know your Vonegut?

      Isaac's in heaven now.

      I assume that Asimov got to tag the moon on his way by. Best speech opening ever.

      --
      He's getting rather old, but he's a good mouse.
    5. Re:Dreaming Is A Private Thing by jollyreaper · · Score: 5, Funny

      As to writing about stuff that never happened, THIS never happened - until now. The "hyperdrive" (what Roddenberry renamed "warp drive") was never invented - yet. Roddenberry and his writers were prescient, too. I remember a world without cell phones, flat screen talking computers, self-opening doors, and space shuttles (I remember a world without space travel at all).

      Wow. Your UID should have a minus sign in front of it.

      --
      Kwisatz Haderach
      Sell the spice to CHOAM
      This Mahdi took Shaddam's Throne
    6. Re:Dreaming Is A Private Thing by gnick · · Score: 5, Funny

      Sorry - If you don't recognize the quote and have no context, it's not funny at all.

      Vonnegut (misspelled in my post above) became honorary president of the American Humanist Association after Isaac Asimov, their former president, passed on. As such, he had the somewhat awkward honor of addressing the Association at their first meeting after losing their president and had to come up with some way to say goodbye to Isaac and start his speech. (If you're unfamiliar with Humanism, it's an entirely human-based religion/philosophy. Its members are largely atheist or agnostic and practice strict scientific skepticism while shunning religious superstitions or unsupported beliefs - Heaven/Hell included. The idea that Asimov, as president of the AHA, would have any literal belief in Heaven would be ludicrous.)

      According to Vonnegut, opening his speech with

      Isaac's in heaven now.

      not only did a great job of breaking the ice in a very awkward situation, but set the entire ball-room laughing out loud.

      --
      He's getting rather old, but he's a good mouse.
    7. Re:Dreaming Is A Private Thing by mcgrew · · Score: 3, Informative

      I looked it up on wikipedia and found that A Logic Named Joe is posted on the internet, with a link from wikipedia.

      The tank is a big buildin' full of all the facts in creation an' all the recorded telecasts that ever was made--an' it's hooked in with all the other tanks all over the country--an' everything you wanna know or see or hear, you punch for it an' you get it. Very convenient. Also it does math for you, an' keeps books, an' acts as consultin' chemist, physicist, astronomer, an' tea-leaf reader, with a "Advice to the Lovelorn" thrown in. The only thing it won't do is tell you exactly what your wife meant when she said, "Oh, you think so, do you?" in that peculiar kinda voice. Logics don't work good on women. Only on things that make sense.

      It appears that Leinster beat Asimov to the punch; it's possible, being a science fiction fan before he was a science fiction writer, that Asimov even read "Joe". Wikipedia puts "Joe" at 1946, but Multivac in 1955.

      --
      Free Martian Whores!
  3. Quick.. by skgrey · · Score: 2, Funny

    Quick, everyone picture Scarlett Johansson naked.. ..I need some new pictures for my collection

  4. No more lack of artistic skills for me by Ifandbut · · Score: 5, Interesting

    I have lots of cool images in my head for comics and wallpaper, however I lack the artistic talent to bring those images from my mind to paper/photoshop. Maybe soon I will be able to compensate for my lack of artistic ability.

    1. Re:No more lack of artistic skills for me by fastest+fascist · · Score: 4, Interesting

      Maybe, although I personally find, as someone who has spent a considerable amount of time developing technical skill at drawing and painting, that the process of learning to draw has also considerably altered my aesthetic sensibilities. Drawing is ultimately not that much about knowing how to move your hand just right. In fact, it seems to me it is largely about forgetting about the hand, and concentrating on the form of what you are drawing instead... In any case, I doubt a direct mind-to-picture system would in itself be enough to make anyone an artist. Maybe to reproduce what a person sees in front of them, but to be able to make a picture without exact reference, you're still going to need to know very precisely what you want each detail to look like. I think even with this kind of tech there'd still be a pretty intense learning process involved.

    2. Re:No more lack of artistic skills for me by Yvanhoe · · Score: 2, Interesting
      From the first line of TFA :

      a research group in Kyoto Prefecture has succeeded in processing and displaying optically received images directly from the human brain.

      Images you acquire optically follow a very different path from dreams or "mind pictures". The former aren't really detailled pictures, they are visual concepts that cannot be cast into a bitmap without interpretation. If we were to talk about the last dream you have made of a human, I could convince you that their hairs were of one or either color using suggestion techniques.

      --
      The Wise adapts himself to the world. The Fool adapts the world to himself. Therefore, all progress depends on the Fool.
    3. Re:No more lack of artistic skills for me by lahvak · · Score: 3, Interesting

      I have a memory from my childhood that I can almost recall at will, at almost any time. When I was 6, my father took me on a week long canoeing trip. I remember standing on a road, looking through some trees down to the river onto some cool rapids which we were about to go down. I can see in my mind what seems to be a perfect picture: the side of the road, the wooded slope covered with dry leaves, trees, and the river. It seems that I could just sit down a draw the scene from my memory. The funny thing is, every time I try to focus on some detail, for example when try to identify the trees, or look at a number on a mile-post next to the road, or something like that, the whole picture completely disappears, and I have hard time recalling it again. The details are simply not there at all.

      Now if I were to draw the scene, I would undoubtedly substitute some sort of simplified shapes, or maybe just a pattern of shades of green, for the leaves. But you could look at the details of the drawing and see how it was done. You probably would be unable to identify the trees by their leaves, the drawing would not contain that much details, but you would be able to see the way the image is rendered on paper. I cannot do that with the mental image. I believe that in my mind I am able to render the overall image without actually rendering the details at all, not even as some sort of impressionist jumble of colors and shades. If that's the case, transferring this image onto paper would require filling in all the details in some way, which, IMHO, is exactly the hard part of drawing or painting.

      --
      AccountKiller
  5. Kinda neat, not that exciting though by Improv · · Score: 3, Interesting

    The visual cortex is one of the more understood areas of the brain, and decoding V1/V2 is low-hanging fruit. To the extent that memory and dreams back-project to these areas, perhaps recording parts of these experiences would be possible.

    Making this practical and inexpensive would be quite a practical breakthrough though - imagine being able to imagine something and import it into GIMP from a headband. Doing this through MRI would be impractical unless someone would be able to keep the image stable in their head for long enough for a high resolution scan of the area (and bear the ~$700/hour cost of MRI).

    --
    For every problem, there is at least one solution that is simple, neat, and wrong.
    1. Re:Kinda neat, not that exciting though by oroborous · · Score: 2, Insightful

      That's true, but advances in Optical Imaging might overcome the current imaging limitations. But sci-fi aside, at least getting the decoding algorithms perfected will answer a ton of basic science questions about network dynamics in primary sensory and motor areas.

    2. Re:Kinda neat, not that exciting though by Futile+Rhetoric · · Score: 5, Insightful

      Can we "keep images in our heads" at all? When I try to, it is more of a feeling than an image, and it's a fragmentary one at that. Wouldn't it make sense if our imagination worked a lot like our vision, i.e. we can only focus on small bits of the visual field at once, and so would only be able to imagine those pieces and attributes of an image pertinent to our needs or wants?

      I'm free-balling here, mind. I can't seem to put coherent, complete images in my head, but others very well might.

    3. Re:Kinda neat, not that exciting though by geekoid · · Score: 5, Funny

      And imagine spending the next week try to figure out GIMP to be able to do anything with it~

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    4. Re:Kinda neat, not that exciting though by fastest+fascist · · Score: 4, Interesting

      I'd mod you up if I could. It doesn't seem to me that when I imagine something in my head, there is actually a picture being made somewhere in my brain. It's an impression, a sense of shapes, something very fluid and ephemeral. I can, in a way, turn around three-dimensional objects "in my head", but the experience is far from looking at a video of an object turning. A simple dumb read of that kind of thing would probably be very difficult, although a person could perhaps train themselves to solidify their ideas into image form via a neural interface, much as they can ordinarily do with pen and paper, for example.

    5. Re:Kinda neat, not that exciting though by Pedrito · · Score: 3, Informative

      [i]The visual cortex is one of the more understood areas of the brain, and decoding V1/V2 is low-hanging fruit.[/i]

      Low-hanging fruit? I agree, it's fairly well understood, but given the pre-processing that happens in the retinal ganglion cells, and the kind of data that actually ends up getting to V1 (after being relayed from the LGN), I'm surprised an actual image can be reconstructed from the information. After all, the RGCs tend to pass on things like movement, edges, contrast and color, but it's not even remotely pixel by pixel type data, which is precisely the informaiton that gets passed on to V1.

      Since it's coming from an fMRI, there's no way the image can be very detailed. I suspect it will be very low resolution.

    6. Re:Kinda neat, not that exciting though by ceoyoyo · · Score: 2, Informative

      The images they used were very high contrast (black and white) and quite simple - squares, lines, crosses, etc. It's not really surprising you can reconstruct that sort of data from the visual cortex. Still, very cool. The paper is worth a look.

      I'll be really impressed when someone reconstructs a recognizable non-synthetic image. Oh, and how colour is represented.

    7. Re:Kinda neat, not that exciting though by jhoger · · Score: 2, Insightful

      Having a device like this, you might be able to learn how to hold an image in your head. If it could give you instant feedback, perhaps you can learn it like any other skill.

      So the existence of the device, over time, could change the answer to your question.

  6. No pictures? by pwnies · · Score: 3, Insightful

    Honestly? Come on now. Saying you can retrieve images from the mind, then not showing said pictures is the same as claiming you've achieved cold fusion without showing any energy for it.

    I think this is the first time I can scientifically say, "Pics or it didn't happen."

    1. Re:No pictures? by Peeet · · Score: 5, Informative

      It's right there on the Japanese press release page, you can see at the bottom of the image at the top left of the article, they have the before and after of the word "neuron". Here, I'll make it even easier for ya: http://www2.asahi.com/kansai/news/image/OSK200812100099.jpg

  7. Pixels by ChienAndalu · · Score: 2, Funny

    In the recent experiment, the research group asked two people to look at 440 different still images one by one on a 100-pixel screen. Each of the images comprised random gray sections and flashing sections.

    100 pixels? Sounds like they were watching japanese porn...

    1. Re:Pixels by Smauler · · Score: 2, Funny

      Random gray sections and flashing sections? Definitely Japanese porn.

  8. This is NOT new by oroborous · · Score: 4, Informative

    A Berkeley group has already reported this in Nature using similar methods: http://www.nature.com/nature/journal/v452/n7185/abs/nature06713.html)

  9. World first? I think not! by Colin+Smith · · Score: 4, Funny

    THEY have been able to do this for decades! Where is your tinfoil hat now? Ha!

    --
    Deleted
  10. This is so cool! by CreatorOfSmallTruths · · Score: 3, Interesting

    This , if true , will have HUGE implications - we'll be able to see what people THINK. I don't know if you actually grasp the monument dimensions of this. Checking for terrorism, knowing if you are really loved, truth telling machines, like the internet, something like this can level the plain field for a long long time...

    1. Re:This is so cool! by BlargIAmDead · · Score: 2, Funny

      I can see this as being terrible. I mean really, imagine going through an airport and all you have to do is NOT think terrorist thoughts...I don't know about you but I can see many many Ghostbusters moments occurring.

      "Okay nobody think of anything!"
      "Your destruction has been chosen!"
      "Who though of something?! I didn't!"
      *Giant marshmallow blobs appear*

    2. Re:This is so cool! by Omestes · · Score: 5, Insightful

      This , if true , will have HUGE implications - we'll be able to see what people THINK.

      Data in V1/V2 does not constitute cognition, those areas constitute pretty much a visual map of data gathered by the eye (roughly). Its doubtful that imagined visuals are even represented in these areas. This, in other words, doesn't provide any insight into thoughts, just what people see.

      I admit, though, that this is awesome. If we can read it, we theoretically could write to it, which would allow for direct neural interfaces.

      --
      A patriot must always be ready to defend his country against his government. -edward abbey
    3. Re:This is so cool! by T+Murphy · · Score: 2, Interesting

      Seeing people's thoughts would be amazing when it comes to Savants and other people who think in ways we cannot otherwise understand- such people have often reported numbers having unique sensory perceptions attached to them. This technology would be able to teach us a lot about the potential of the human mind.

      --
      My webcomic
  11. I still wonder by bigattichouse · · Score: 4, Interesting

    Years ago I was a sign language interpreter (ASL), and after a few years realized that I was thinking in ASL and "visually" instead of the usual auditory monologue... I always wondered if you use a completely different part of the brain to process the language - or if it just gets translated into language concepts before processing... I wonder how long before "telepathic" audio is available.

    --
    meh
  12. For the last time... by philspear · · Score: 4, Informative

    People read blurby summaries, which don't include the results, the full reasoning, methods, etc, and then act as if it's the fault of the researchers. It's absurd, that's neither the paper nor the direct work of the researchers, it's some non-scientist working for a news source. Read the actual paper, TFA in these cases are rarely any better than TFS.

    http://download.cell.com/neuron/pdf/PIIS0896627308009586.pdf

    There's the PDF. It does have the very pixelated images. I haven't had time to read through it.

    As always, don't complain to me if you don't happen to have a subscription, and not having a subscription is no reason to act as if the results aren't real.

  13. Not impressed by IronChef · · Score: 4, Funny

    Dr. Walter Bishop (Cambridge) was doing this in the '70s.

  14. Feedback Loop? by drpentode · · Score: 5, Interesting

    Would looking at the image your brain is generating at the same time you are generating it create a feedback loop much like holding a microphone too close to a speaker?

    1. Re:Feedback Loop? by noidentity · · Score: 2, Funny

      Would looking at the image your brain is generating at the same time you are generating it create a feedback loop much like holding a microphone too close to a speaker?

      IIIIIIIII tried tried tried ttttttttthhhhhhhhhaaaaaaaaaatttttt once once once once...............bbbbbbaaaaaaaaaadddddddddd iiiiiiiiiidddddddeeeeeeeeaaaaaaa.

    2. Re:Feedback Loop? by bridgeco · · Score: 4, Funny

      Would looking at the image your brain is generating at the same time you are generating it create a feedback loop much like holding a microphone too close to a speaker?

      Malkovich Malkovich Malkovich Malkovich Malkovich?

      --
      Groucho not Karl.
  15. Nope, dreams would just be noise by Dr.+Manhattan · · Score: 4, Informative
    From what I can gather, they're pulling in rather low-level data - essentially 'listening in' on the very lowest level of pattern-recognition that's applied to the data coming in from the optic nerve. That's certainly interesting, but a whole lot more processing happens at higher levels before you 'see' anything. (C.f. people who lose sight early on due to eye problems, and have sight restored later - their brains can't do much with the information at first.)

    Dreams appear to be based on the 'noise' coming in, but a lot of interpretation is applied (and without imposed constraints of consistency or logic). A common game/prank involves people asking yes/no questions about an alleged dream, but the answers they get are based on some simple scheme like "yes if the last word in the question they ask ends in a consonant". Surprisingly detailed 'stories' get constructed... by the person asking the questions. (Here's what appears to be an online version.) Actual dreams seem to be built in an analogous way, with the subconscious 'asking questions' of the senses (which are just feeding in 'static') and weaving an experience out of them.

    I'd guess that 'eavesdropping' on dreams via this means would only get the kind of swirling colors and such you 'see' when you close your eyes.

    --
    PHEM - party like it's 1997-2003!
  16. Re:Beginning of the end for me by geekoid · · Score: 2, Funny

    In all likely, you will find out your not nearly the perv you though you are.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  17. Re:Pics or it didn't happen by philspear · · Score: 4, Informative

    Maybe this image will not require a subscription, although I suspect it will.

    http://www.sciencedirect.com/cache/MiamiImageURL/B6WSS-4V4113M-P-7/0?wchp=dGLbVtz-zSkzk

    On the off chance it does, keep in mind this is not the full article. Critiques along the lines of "this doesn't prove anything," or "They should have done X" are premature if you haven't read the full (journal) article. If you thought of it, they probably covered that in the article you're not willing to pay for.

  18. TLJ by CannonballHead · · Score: 3, Insightful

    Reminds me of Dreamfall: The Longest Journey.

  19. Yes, it is by philspear · · Score: 4, Informative

    Didn't read the full article, but from the abstract

    We show that these receptive-field models make it possible to identify, from a large set of completely novel natural images, which specific image was seen by an observer...

    Our results suggest that it may soon be possible to reconstruct a picture of a person's visual experience from measurements of brain activity alone.

    The article you linked to seems to only be able to tell which object a person saw from their fMRI. I believe it required established measurements too, IE "this part of the brain lights up when they see a face. In blind studies, that part of the brain lit up, so they must have seen a face."

    Whether it required a calibration for each individual or not, no image reconstruction was done: it's not the same thing at all.

  20. Yet Another Unnew Result by DynaSoar · · Score: 4, Informative

    The primary visual cortex (V1) has already been shown to be retinotopic. What's being seen can be mapped directly from the cortex. It's crude and low-res, but it works.

    20 years ago a researcher working with Karl Pribram at Radford University was able to detect signals from small cellular assemblies of the visual cortex that represented a particular shape being viewed without mapping the entire shape from V1.

    In both these, the images were received directly from the brain. In both they were digitally processed and presented. In all three what was retrieved was not an image, but was a pattern of neural electrical activity that they had already determined represented a particular visual field. They could not (in keeping with the /. tendency to represent reality with fiction) for instance, retrieve the third frame of a series of images that had been briefly presesnted. They would have had to show the image for some time that record EEG from the appropriate areas for long enough that they could get a good correlation when showing it a second time.

    --
    "I may be synthetic, but I'm not stupid." -- Bishop 341-B
  21. Does it get lonely up in your crystal tower? by ovu · · Score: 5, Insightful

    "The current accomplishment is low hanging fruit and therefore uninteresting. Surprising, really, that they found funding for such an unnecessary demonstration at all! By commercializing this technology, it would become sufficiently interesting to deserve my royal approval."

    Belittling humanity's incremental advancement as if you're a third party, how's that working out for you?

    I think it's tremendously exciting. Thanks for the buzzkill though, it reminds me to get off the computer and interact with people of my choosing.

  22. Emacs Macro! by 140Mandak262Jamuna · · Score: 2, Insightful

    I think code must faster than I can type. Soon I will be able to just wear a sensor filled helmet and think code and this machine would convert it to an emacs macro and fill in the source. Yay!

    --
    sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
    1. Re:Emacs Macro! by astrodoom · · Score: 2, Insightful

      Only if you actually SEE perfect code in your brain. Personally when I'm coding, I'm thinking much more of a process than a picture. We're still no-where near that with just mental picture projection. What I really look forward to is being able to project memories that can't be fully remembered. I want to see what a partial memory looks like. Generally when I have difficulty remembering, it's difficult to construct a mental image, so I wonder what results when thought processes like that are going on.

  23. Some great potential here by Drakkenmensch · · Score: 3, Insightful
    If scientists can understand perfectly how the brain translates images into neural signals, it opens up the possibility to build full cybernetic eye replacements, even if the nerve tissue is damaged and non-functional. The medical applications are mind-boggling.

    Also, I'm reminded of the interrogation device from the movie Barb Wire, the one that pulls out images from your brain whether you want it to or not...

  24. Re:Beginning of the end for me by TheLostSamurai · · Score: 2, Funny

    Which is more perverted, the disgusting thoughts that I actually have in my head, or the fact that I want to record them so I can watch them again later?

    Either way you're right, considering the thoughts I have, I definitely don't want to see what everyone else is thinking about.

    --
    I am Jack's complete lack of surprise.
  25. Law Enforcement Sketch Drawing by dlevitan · · Score: 2, Insightful

    I think this would be amazing for law enforcement sketches. Instead of having to ask a witness what the person looked like, they could just copy it out of their visual cortex. No, it wouldn't be perfect, and it wouldn't be acceptable in court as proof someone was there (since you can just imagine your worst enemy in the place of the actual person), but it would help with sketches for wanted posters and the like. Especially if it was cheap and easy.

  26. The Opposite by Clandestine_Blaze · · Score: 4, Interesting

    I wonder if the process can be reversed, and images can be fed into the brain to create a dream sequence? Will people who really hate their reality use this as an escape and never try to wake up again?

    Cool story!

    --
    Best "String" Ever!
  27. Brainshots? by erroneus · · Score: 2, Funny

    I haven't read the article yet. Does it include any brainshots? (Please, no JFK jokes...)

  28. Nightmare recursion by pRtkL+xLr8r · · Score: 2, Interesting

    I have a feeling that if someone were record one of their nightmares and then watch it when awake, the conscious brain wouldn't be able to cope with what the subconscious brain can. Watching it would give you nightmares. And the cycle begins...