Supercomputer Simulates Human Visual System
An anonymous reader writes "What cool things can be done with the 100,000+ cores of the first petaflop supercomputer, the Roadrunner, that were impossible to do before? Because our brain is massively parallel, with a relatively small amount of communication over long distances, and is made of unreliable, imprecise components, it's quite easy to simulate large chunks of it on supercomputers. The Roadrunner has been up only for about a week, and researchers from Los Alamos National Lab are already reporting inaugural simulations of the human visual system, aiming to produce a machine that can see and interpret as well as a human. After examining the results, the researchers 'believe they can study in real time the entire human visual cortex.' How long until we can simulate the entire brain?"
Impessive.
"So long and thanks for all the fish."
If it can help me find my socks...
Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
Just the way I'm wired I guess, but I've always been somewhat handicapped when it comes to remembering and recognizing faces. I've been told I could never become a politician because of this (no great loss I suppose).
How long until I can plug a computer chip into the back of my head to rectify this?
If libertarians are so opposed to effective government, why don't they all move to Somalia?
Perhaps the goal should be to make the visual system BETTER than ours?
But can it run linux?
Who the hell left colored drop lights laying all over the server room!?
-Rick
"Most people in the U.S. wouldn't know they live in a tyrannical state if it walked up and grabbed their junk." - MyFirs
And when this simulation claims to be conscious, what do we make of that?
IBM takes credit right?
This is actually pretty neat. Imagine having to lug around IBM's Roadrunner on your back in order to see!
But with (most) sarcasm aside, the applications for this could be useful. In the distant day when supercomputers become the size of a penny, this could replace people's vision, or even possibly add eyes in the back of one's head. (Although, I'm not sure I would welcome something "imprecise" which may be grone to plitches.)
Also, Skynet has to see somehow, right?
I thought that supermodels stimulate the human visual system.
That's nothing. I'm already running a port of Linux in my brain, and cross-compiling for it on a program I wrote called VMbrain, which is able to run the same code as my brain.
McCain/Palin '08. Now THAT's hope and change!
Visual object recognition systems have been a thorn in the side of robotics since the beginning. The other annoynace of battery power will likely be solved by the nanowire battery - therefore leaving 'sight' as the real final technological step for our lovely robots.
Extrapolating further, a human-quality object recognition system will yield results which we cannot currently imagine (let's avoid some big-brother robot talk for a second, however).
For example; I was looking at some old WWII photographs of troops getting on boat - thousands of faces in these very high-quality photographs. To myself, I thought,'Self. If all historical photographs could be placed in view of a recognition system, perhaps it could be found, interestingly, where certain ancestors of ours did appear.'
Throw in a dash of human-style creativity and reasoning and I'm certain some truly nifty revelations are to be found in our mountains of visual documentation currently lamenting in countless vast archives.
Read my Very Short "Stories"
get 60fps in Crysis?
It's nice to see progress is being made. It's scary how accurate Ray Kurzwiel's predictions seem to be, he said that by early 2010 we'll have simulated a human brain. (he's a technological analyst and author of "The Singularity is Near"). Todays desktops are faster then the super computers of the 90's. I can't wait till I'm able to get a laptop smarter then me in every way (queue joke about how stupid I am), that'll be a cool time to live in. Seems it's only a matter of decades away. Probably 20 years.
After examining the results, the researchers 'believe they can study in real time the entire human visual cortex.'
I'll believe it when I'll see it. With my own eyes that is.
How long until we can simulate the entire brain?
How does 'never' sound? But more seriously you'd need to have an intricate understanding of its inner workings, besides the fact that it involves creating a strong AI which feasibility even in the distant future falls within the realm of wild speculation.
You just got troll'd!
'How long until we can simulate the entire brain?"
Lord knows we've got a planetful of nitwits to help out somehow. Just build a massive mesh network and several of these and we could raise the World IQ by a couple of points, at least!
Yeah, I'm bored.
And we should call it Skeyenet.
Knowledge is power. Knowledge shared is power lost.
We are ignoring for the moment how the neural network simulators work, how they communicate amongst themselves, how they are partitioned, what sensor inputs they receive, how they are trained (that's a tough one), etc. This will turn out to be extraordinarily difficult unless some very clever people mimic nature in very clever ways.
Well, at least the hardware is there.
...are we scared yet?
Why not just setup another 'distributed' project where we all donate cycles and simulate the brain?
Should be enough of us out here i would think.
---- Booth was a patriot ----
...and then of course I have this terrible pain in the (diodes/insert name of groovy new technology) all down my left hand side.
Now twitter's enemies are using sock puppets too. I'm convinced it's all one guy. One set of sock puppets pretends to hate him, the other sock puppets support him, it's all just a pathetic ruse to get attention.
Just remember, if you see someone dissing on twitter, that is still twitter, trying to drum up more attention. Ignore him and maybe he'll get bored and go away.
And that's all I'll say on the matter because I don't want to get any closer to this one man cluster fuck.
does it go "Beep-Beep?"
Unless it naturally focuses on boobies when a woman enters the room then it was made by aliens.
Having to work for a living is the root of all evil.
What are you doing Dave?..... Dave?
running on linux awesome.
From TFA it's not very clear what this simulation achieved. It was code that already existed and as far as I understand it, it was used to validate some simulation models of low-level biological vision.
However his simulation did not necessarily achieve computer vision in the usual sense, i.e: shape recognition, image segmentation, 3D vision, etc. This is the more cognitive aspect of the visual processus, which at present requires a much higher level of understanding of the vision process that we do not posess.
FYI the whole brain has already been simulated, see the work of Dr izhikevich. It took several months to simulate about 1 second of brain activity.
However this experiment did not simulate thought, just vast amounts of simulated neurons firing together. The simulated brain exhibited large-scale electrical behaviours of the type seen in EEG plots, but this is about it.
This experiment sounds very similar. I'm not all that excited yet.
I read TFA, and it doesn't really talk too much about exactly what the simulation achieves or could be used for. They talk of 'danger recognition' - surely that's not possible without a simulation of the rest of the brain as well? To make the logical connections between what the eyes see and what the implication is in terms of 'danger'? And they mention cars that could drive themselves. Can someone in the know explain if this is really a big deal - or just a really really great picture matching program?
First I want to say that this whole level of brain modeling is really cool. However, there are, of course, different levels of "interpretation" I don't think that this computer will be able to achieve a human level of interpretation simply by modeling the visual cortex.
Even "interpretation" at the second level above (which it seems the "roadrunner" might be able to model) require a lot more, for humans, than just the visual cortex.
In other words if we were to call into existence a floating occipital lobe connected to a couple of eyes that had never been attached to the rest of a brain we would never be able to achieve recognition/categorization let alone interpretation. If I'm wrong maybe some of you hardcore neuroscience type can help me out?
See as human may or may not be easy... but interpret as human could be a bit more complicated. Could recognize patterns, detect movements, and more things that we take as normal without thinking too much on them, ok, but things are a bit more complex than that. As the brain is not so fast processing visual info, somewhat we anticipate the future in our perceptions. That is the base of most optical illusions.
Could be useful to simulate such things, based on our limitations? Will that computer be fooled by "normal" optical illusions? In some sense, i think that yes, will be useful. If it dont perceive the world the same as us, high level communication with humans could be harder or have a lot of misunderstanding.
Been done for a very long time. See Politician.
Back in times of yore, when the Beach Boys were young, and Get Smart was a TV show, they used to say that a computer powerful enough to simulate the human brain would require all the electricity generated by Niagara Falls to power it, and all the water going over the Falls to cool it. So far, as our understanding of the brain's complexity grows, that estimate still remains.
When our name is on the back of your car, we're behind you all the way!
I wonder if their system would be able to interpret captchas successfully?
Per the summary, then why does it take 100,000+ cores and the worlds first petaflop supercomputer to do it?
I think if you input porn into this system, it will either hang or melt like a Slashdotted server.
I can't wait till my wife AND my computer can call me a dumbass simultaneously
Machine consciousness is not something that will likely happen in our lifetime. We don't even know exactly what it is in humans, much less a machine. Neuroscience is further ahead on consciousness issues than computer science, and even they haven't turned up a great deal yet. Computer scientists and physicists haven't got a clue about this, and sometimes their drivel about consciousness and human cognition is just embarrassing to them.
There is more to science than physics!
www.iomalfunction.blogspot.com
Based on reasonable extrapolations of the rate of hardware advance, we won't be able to simulate a human brain in real time until sometime in the 2020's.
However, that is based on the previously incorrect assumption that neurons are the only kind of brain matter that is important. Now it is clear that glial cells play an important role in coordinating cognition. There are 10 times as many glial cells as there are neurons. That sets our simulation back a few years.
I think Ray Kurzwiel is way, way, too optimistic regarding the rate of progress.
It's funny that if you claim a mountain is impossible to climb they'll name it after you. But try going up that same mountain in ten minutes. Will they rename it after you? No way...
It's true that we don't know how the human brain works, yet, because we don't have all the needed tools to study it today. A caveman would never be able to understand the workings of a watch, you cannot study a watch stone tools. But each time a supercomputer beats a record we get a better tool to study the inner workings of the human brain.
library
After examining the results, the researchers 'believe they can study in real time the entire human visual cortex.' How long until we can simulate the entire brain?"
There are researches who believe that humans use their whole brain to "see." If that is true, the claims of these researchers are highly premature with respect to vision. Everything from stored patterns to extrapolation is used to determine what we see. Even familiarity is used in perception - that is why there is this urban myth that "foreign" people look the same. If one were to ask those foreigners, they will say all indigenous people are totally different.
why are we talking about simulating a brain?
sure, it will be a super-fantastic milestone in the world of computing.
but a brain is not perfect, its flawed.
How else to explain why they have not already been Slashdotted?
I admit I didn't RTFA - but that sort of report cropping up in different places is really quite misleading in principle. While it may be true that the processing power exists to simulate networks on the scale of small parts of the brain in real time, the biological data to work on simply _does not exist_. The situation is somewhat better for the retina than for other parts of the nervous system, but seriously: Nobody knows the topology of neural networks in our brain to the level of detail required for simulations that would somehow reflect the real world situation. Think about it: A neuron is small, just several micrometers in diameter and it can form appendages of several centimeters (within the brain) in length that can connect it to several thousands of other neurons. The technology to map that kind of structure simply does not exist. It _is_ being developed, but there is nowhere near to enough data to justify calling the programs these computers run "simulations of the human brain".
Can it identify the correct number of cats on a rapidshare captcha?
How long, you ask?
Until they can emulate the quantum/holographic methods the brain employs. Keep in mind, there are some worlds-in-worlds within the physical components. Just like how metal siding can form a complete circuit around the house, the nerves of the brain form multiple networks (chemical, electrical, interference patterns, etc)
Job? I don't have time to get a job! Who will sit around and bitch about being broke and unemployed then?
I'm a PhD student in Neuroscience. Don't get too excited. This is merely just a piece of the visual cortex. How long until we can simulate the entire brain in real time? That's not likely for a long, long time, but not because we won't have the computing power (we'll have that in about 10 years), but because we won't have the entire brain mapped to simulate. In order to accurately simulate the entire brain we first have to understand each part's connections, how they work, and how they interact with the rest of the brain. Sadly, our knowledge of the brain is so primitive that I don't see us totally mapping the brain for at least another 100 years. Sound ridiculous? Ask anyone in academia in neuroscience, and they'll tell you that even tenured theories are being thrown out regularly when evidence to the contrary proves it wrong. There are even some who think we'll never fully understand the brain due to the fact that the best way to study it is in live humans and scientists are severely limited in that study by human rights laws.
it will be 3-6 years.
VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
The singularity cometh as has been foreseen by the profets! Prepare for mass evacuation to mars as our petaflop toting a.i. robotic overlords will soon take over the planet. Hold on to your towel and don't panic!
Based on the results of PetaVision's inaugural trials, Los Alamos researchers believe they can study in real time the entire human visual cortex--arguably a human being's most important sensory apparatus.
What the hell does that mean???
I'm guessing it just means that this peta-beast has the oomph to run their model in real-time. They seem to want you to assume that the model actually achieves something human-like and/or never-done-by-a-computer-before, but seeing as they don't actually come out and make that claim, I think it really means it just ran their model (which may be a steaming pile of dingo droppings) DAMN FAST. Yawn.
All this "rapture of the nerds" stuff about simulating human brains and computers becoming generally intelligent is nonsense because everybody knows computers are stupid, computers don't have souls, don't have emotions, aren't grounded, have syntax and no semantics; everybody knows it hasn't happened yet so it will never happen, is extremely difficult so will never happen, is unimaginable to me so won't happen, would mean the end of the human race so shouldn't happen, etc.; and of course, it is religious nonsense by maladjusted scifi nerds who live in their mom's basements, etc.
This isnt too useful since the "driving force" behind our brain function, consciousness, seems to be ignored.
Seriously, all this "news" about more powerful computers is completely meaningless if we cant do anything with it. In this case we are talking simulation of human brain function.
You might as well take this Roadrunner computer and leave it barren with no OS, just have it sit there. Sure it *could* do a lot... but its missing that one key component.
singularity?
I'm currently reading Ray Kurzweil's 'The Singularity is Near.' It's so good to read these stories. We are well on our way to simulating the human brain.
In the interest of full disclosure, let me first say that I am one of the co-authors of the model that was executed on the Roadrunner, though I had nothing to do with the actual implementation that was executed (this was done by professional computer scientists, and I am a computational neuroscientist).
Let me clarify what was done, and what will be done in the future.
We simulated about 1 billion neurons communicating with each other and coupled according to theoretically derived arguments, which are broadly supported by experiments, but are a coarse approximation to them. The reason is that we are interested in principles of the neural computation, which will enable us to construct special purpose dedicated hardware for vision in the future. We are not necessarily interested in curing neurological diseases, hence we don't want to reproduce all physiological details in this simulation, but only those that, in our view, are essential to performing the visual computation. This is why we have no glia and other similar things in the model: while important in long-term changes of neuronal properties, they communicate chemically and, therefore, are too slow to help in recognition of an object in ~200 milliseconds.
The simulation was a proof of principle only. We simulated only the V1 area of the brain, and only those neurons in it that detect edges and contours in the images. But the size of V1 we simulated was much larger than in real life, so that we had only a bit smaller total number of neurons than the entire visual system in a human has. Hence we can reliably argue that we will be able to simulate the full visual cortex, almost in real time. This is what will be done in the next year or so.
When we talk about human cognitive power, we only mean the ability to look at images, segment them into objects, and recognize these objects. We are not talking about consciousness, free will, and thinking, etc. -- only visual cognition. This is also why we want to match a human, rather than to beat him: in such visual tasks, humans almost never make any errors (at least, when the images are not ambiguous), while the best computer vision programs make an error in 1 in 10 casesor so (just imagine what your life would be if you didn't see every tenth car on the road). Based mostly on theoretical arguments characterizing neuronal connectivity, and neglecting many important biological details, we may never be able to match a human (or maybe we will -- who knows? this is why it's called research). But we have good reasons to believe that these petascale simulations with biologically inspired, if not fully biological, neurons will decrease error rates by hundreds or thousands. This is also why we are content with simulating the visual system only: some theories suggest that image segmentation and object identification happens in the IT area of the visual cortex (which we plan to simulate). While the rest of the brain certainly influences its visual parts, it seems that the visual system, from the retina to IT, is sufficiently independent of the rest of the brain, so that visual cognitive tasks may be modeled by modeling the visual cortex alone.
Finally, let me add that we got some interesting scientific results from these petascale simulations and the accompanying simulations and analysis on smaller machines. But we need to verify what we found and substantially expand it before we report the results; this will have to wait till the fall, when the RR computer will be available to us again. For now, the fact that we can simulate the system the size of the visual cortex is of interest by itself.
Heh... what if they finally simulate a human brain and... he's just a normal guy. "Design a better computer for us B.O.B." "Uhhh... I don't even like computers." Or what if it turns out to be stupid? Make it 100x faster and it's just STUPID FAST. :)
Cwm, fjord-bank glyphs vext quiz
The system simulates a cortical "column" (as if you punched a cylindrical column in the cortex) - just a fraction of the full human visual cortex. So it's a long way from simulating the human visual system.
In the interest of full disclosure, let me first say that I am one of the co-authors of the model that was executed on the Roadrunner, though I had nothing to do with the actual implementation that was executed (this was done by professional computer scientists, and I am a computational neuroscientist).
Let me clarify what was done, and what will be done in the future.
We simulated about 1 billion neurons communicating with each other and coupled according to theoretically derived arguments, which are broadly supported by experiments, but are a coarse approximation to them. The reason is that we are interested in principles of the neural computation, which will enable us to construct special purpose dedicated hardware for vision in the future. We are not necessarily interested in curing neurological diseases, hence we don't want to reproduce all physiological details in this simulation, but only those that, in our view, are essential to performing the visual computation. This is why we have no glia and other similar things in the model: while important in long-term changes of neuronal properties, they communicate chemically and, therefore, are too slow to help in recognition of an object in ~200 milliseconds.
The simulation was a proof of principle only. We simulated only the V1 area of the brain, and only those neurons in it that detect edges and contours in the images. But the size of V1 we simulated was much larger than in real life, so that we had only a bit smaller total number of neurons than the entire visual system in a human has. Hence we can reliably argue that we will be able to simulate the full visual cortex, almost in real time. This is what will be done in the next year or so.
When we talk about human cognitive power, we only mean the ability to look at images, segment them into objects, and recognize these objects. We are not talking about consciousness, free will, and thinking, etc. -- only visual cognition. This is also why we want to match a human, rather than to beat him: in such visual tasks, humans almost never make any errors (at least, when the images are not ambiguous), while the best computer vision programs make an error in 1 in 10 casesor so (just imagine what your life would be if you didn't see every tenth car on the road). Based mostly on theoretical arguments characterizing neuronal connectivity, and neglecting many important biological details, we may never be able to match a human (or maybe we will -- who knows? this is why it's called research). But we have good reasons to believe that these petascale simulations with biologically inspired, if not fully biological, neurons will decrease error rates by hundreds or thousands. This is also why we are content with simulating the visual system only: some theories suggest that image segmentation and object identification happens in the IT area of the visual cortex (which we plan to simulate). While the rest of the brain certainly influences its visual parts, it seems that the visual system, from the retina to IT, is sufficiently independent of the rest of the brain, so that visual cognitive tasks may be modeled by modeling the visual cortex alone.
Finally, let me add that we got some interesting scientific results from these petascale simulations and the accompanying simulations and analysis on smaller machines. But we need to verify what we found and substantially expand it before we report the results; this will have to wait till the fall, when the RR computer will be available to us again. For now, the fact that we can simulate the system the size of the visual cortex is of interest by itself.
That's all, folks!
It is entirely possible that intelligence is a self organizing property of our brain. if we could accurately simulate the human brain, it is possible, (probable is another story)that a strong AI could develop on its own.
Please!
Brains are not just massively parallel, they are also fully analog (NOT digital), and nonlinear to boot. Not to mention that they contain many billions, not a mere few hundred thousand, of elements. The processing power of the brain is many orders of magnitude over what this machine, or anything near its size and complexity, can ever hope to do.
AND, not only is the brain a much LARGER thing to simulate than they have any hope of coming close to very soon (in numbers of neurons and sheer processing power), the fact is that actual AI research in recent decades has been virtually stagnant. No major breakthroughs, no major advances, not even any outstanding results... for DECADES! If anything, it has gone in reverse: massive research and investments in things like neural nets appear to have been just as massively a waste of our time.
We are not much closer to building anything really "intelligent" than we were half a century ago. Nor do I do not believe the same amount of sheer processing power, when that is achievable, is the only necessary ingredient.
/. overlords insist comment goes here
If you can read this... 01110101 01110010 00100000 01100001 00100000 01100111 01100101 01100101 01101011
Between the rods and cones of the retina and the optic nerve are four layers/types of retinal processing cells. Unlike most neurons these operate entirely on inhibitory processing (rather than 85% excitatory and 15% inhibitory) and entirely on slow voltage gradient (rather than store up charge to a threshold and then fire a burst). How this accomplishes visual processing is a mystery to those of us to who understand real meatware processing. It is not likely a bunch of high powered supercomputer geeks even know this is how the visual system operates much less how to simulate it.
They way well use their XYZflops to develop a visual processing system of some sort, but it will NOT be a simulation of something that those who understand it far better than they understand it hardly at all.
If and when they get to actually trying to match the human visual system in operation (though by different processing) they'll have to figure out of to get their system to consistently guess with fairly good accuracy what it's going to be seeing 0.1 to 0.3 seconds in the future. Proof of that long suspected technique was just forthcoming in the last week or so.
There is nothing at all "intelligent" about this. It is all automated processing. Level of "intelligence" has nothing to to with visual proceses' efficacy. Anytime anyone inserts the "I" word into anything regarding computers, particulary when comparing with the human brain, they need to define their terms. Almost certainly those of us who have struggled for years with the insufficient and contradictory proposed definitions of "intelligence" in the human mind will be more than happy to fill them in on why their definitions have already been proven to be failures in humans, and why anything derived from those will not apply to system designed to provide human-looking output via entirely different means of processing.
"I may be synthetic, but I'm not stupid." -- Bishop 341-B
What really impresses me is the fact that the most powerful supercomputer in the world can only simulate a part of my brain, just goes to show the incredible level of processing we subconsciously perform on mundane everyday tasks, like wasting time on slashdot.
prepare the survey weasels.
Can the system play global thermonuclear war?
"The Roadrunner has been up only for about a week, and researchers from Los Alamos National Lab are already reporting inaugural simulations of the human visual system, aiming to produce a machine that can see and interpret as well as a human."
Nonsense. I'm all for working out the algorithms of the senses. The more world input robotics can have the better it will perform tasks. It's hard and necessary foundational work toward building the core of an artificial gestalt. But nowhere in the article did my Firefox find the word "interpret". If Roadrunner was "interpreting" the visual data "as well as a human" then I guess it _was_ an artificial human for that brief time, right?
See how easily the blind slide from "see" to "interpret" can be made? Exactly the point Hofstadter was making in the interview posted yesterday.
Well, I'm not much of a neuro-anything, however it seems quite simple to me: 1. Get hold of some babies. As fresh as possible. 2. Scoop out baby brain (you might need a few tries at this, hence the spare babies). 3. freeze, slice into superthin babybrain wafers, scan and layer in your chosen superubermegaputer (SUMP). 5. sell remaining baby parts to help pay the 1st installment on your SUMP. 6. Anyone with a SUMP interested? I have an ice-cream scoop...
MODS: please moderate 4D6963 as the troll that he is in this thread, as he admitted in the parent post.