Slashdot Mirror
Stanford Bioengineers Develop 'Neurocore' Chips 9,000 Times Faster Than a PC
kelk1 sends this article from the Stanford News Service:
"Stanford bioengineers have developed faster, more energy-efficient microchips based on the human brain – 9,000 times faster and using significantly less power than a typical PC (abstract). Kwabena Boahen and his team have developed Neurogrid, a circuit board consisting of 16 custom-designed 'Neurocore' chips. Together these 16 chips can simulate 1 million neurons and billions of synaptic connections. The team designed these chips with power efficiency in mind. Their strategy was to enable certain synapses to share hardware circuits. ... But much work lies ahead. Each of the current million-neuron Neurogrid circuit boards cost about $40,000. (...) Neurogrid is based on 16 Neurocores, each of which supports 65,536 neurons. Those chips were made using 15-year-old fabrication technologies. By switching to modern manufacturing processes and fabricating the chips in large volumes, he could cut a Neurocore's cost 100-fold – suggesting a million-neuron board for $400 a copy."
Are you ready?
If they can use modern fabs, then we will have a simulate brain in a decade.
The Kruger Dunning explains most post on
we're not nearly as frustrating as people, meat sack
.
The Kruger Dunning explains most post on
Is my CPU going to struggle with depression and anxiety now?
Good old clueless tech journalists, followed by slashdot editors just copy pasting.
The chips aren't 9000 times faster than a typical PC for general tasks. Specifically, they can simulate neurons 9000 times faster than a PC can simulate neurons. Pretty typical of any ASIC with a limited set of a highly specialised functions.
The article is misleading - they are not 9000 times faster than a PC for general tasks. The chips can simulate neurons 9000 times faster than a PC can simulate neurons, but there's no mention of how fast those simulated neurons can solve a problem for you.
Cray Cray.
Never answer an anonymous letter. - Yogi Berra
I doubt it. Well, at least not as soon as you might imagine. "Together these 16 chips can simulate 1 million neurons and billions of synaptic connections"
Total number of neurons in cerebral cortex =
--10 billion (from G.M. Shepherd, The Synaptic Organization of the Brain, 1998, p. 6).
--20 billion (Biophysics of Computation. Information Processing in Single Neurons, New York: Oxford Univ. Press, 1999, page 87).
Total number of synapses in cerebral cortex
-- 60 trillion (from G.M. Shepherd, The Synaptic Organization of the Brain, 1998, p. 6).
--150 trillion (Pakkenberg et al., 1997; 2003)
--240 trillion (Biophysics of Computation. Information Processing in Single Neurons, New York: Oxford Univ. Press, 1999, page 87).
So, lets call it 15 billion neurons and 150 trillion synapses, or tens of thousands of synapses per neuron, ten times as many as this chip provides. That's going to be a problem. To say nothing of the fact that I would be very surprised if it allows for billions of inter-chip synapses which would probably be necessary to model the non-local interconnections common in the brain within the 240,000 chip brain simulator. And that's just for the cerebral cortex. You've got the rest of the brain to simulate as well.
Then there's the glial cells, which outnumber neurons by 10-50:1, and which recent research suggests may be considerably more involved in neural activity than presumed by the traditional "life support and other infrastructure" understanding.
Could be great for modeling larger portions of a mouse brain though. Maybe even to start modeling the simpler parts of a human brain. And we do have to start somewhere. I suspect we're at least a few decades away from being able to begin to simulate an entire human brain, and probably many more decades away from getting the simulation accurate enough that it might begin to actually function properly. After all the number one benefit of these simulations is to fail spectacularly in interesting way in order to help neuroscientists figure out what questions they should be asking.
Meanwhile we need to ask ourselves - if we're creating this simulation based on the human brain, then what are the odds that some form of consciousness dwells within it? And what sort of torture are we subjecting it to as it's simulation collapses? And does the knowledge we gain justify that price?
--- Most topics have many sides worth arguing, allow me to take one opposite you.
Not that I'm knocking it. A GPU implements specific algorithms to great effect. But a GPU's algorithms are ones that are interesting for a specific application (drawing texture-mapped polygons), whereas an artificial neural network still needs another layer of programming to do something useful. In other words, a Word Processor implemented on this chip would not be 9000x faster than a Word Processor implemented on a CPU. A face recognition algorithm, on the other hand, might see a decent fraction of that 9000x, although it remains to be seen whether this chip would be a better fit for any particular application than a GPU (for example).
It isn't a typical ASIC; the chip is a custom fully asynchronous mixed digital+analog; the board uses 16 chips in a tree router for guaranteed deadlock prevention between the chips; and can simulate 1 million neurons powered only by one USB port.
The neurons are implemented with analog circuits to match the dynamics of real neurons, moving beyond a simple hodgkin-huxley model to include components like ion channels, which is first of its kind in an analog chip. It has a neat hexahedral resistor network that distributes the spike impulse across a neighborhood of neurons, a phenomena seen in many cortical brain areas; essentially an analog phenomena implemented efficiently in analog design.
Analog gives it fun biological-like properties, with things like temperature sensitivity that must be regulated with additional circuitry. Asynchronous design means outside of leakage from the chip, which is low with such a large fabrication process, very little energy is used at a neuron level if no stimuli is present. This is in contrast to a traditional CPU, which has a clock marching along lots of a chip to consume energy every clock cycle.
Outside of wireless/signaling stuff, this is probably the biggest mixed analog digital asynchronous chip in existence.
But otherwise yes, the editors sucked on this one.
I've always suspected you were a bot.
Required reading for internet skeptics
Neurons have incredibly complex behaviors, they are not simply threshold triggers as the simple CS model implies.
You're plainly ignorant. I don't have any threshold triggers in any of my neural networks. Cells have complex protein behaviors, so what? The cybernetic models can be Turing complete. This means that if I really wanted to waste CPU power instead of understanding the fundamental principals of cognition, I could build a neural network that emulated the molecular action of cellular proteins, and if our rate of computer advancements holds that machine intelligence would be able to emulate the molecules that make up human neuron proteins, and eventually an entire human head right down to the molecular level. Artificial neural networks can yield every bit as much complexity as anything else in nature. Did you forget that electrons are made of quantum particles or something? Now, we're shooting for determinism and thus applying quantifications in most cases, but in the future we'll harness things like eddy currents once our n.net model methodologies have nailed down and abstracted more of the key components that emerge of complex behaviors efficiently.
Neural networks in CS have little to do with the actual wiring and primarily chemical systems that are neurons.
Nor do the artificial neurons need to have anything to do with organic ones except very basic fundamental properties which produce the complexity of response and thus intelligence. I suppose next you'll be telling me that without putting a human brain in the boxen we won't be able to make personal computers do mathematics.
You are what I call an organic chauvinist. What's so damn special about the precise chemical functionality of organic brain operations? If the organic chemputers were such a grand and complex design in need of exact duplication to achieve any degree of similar intelligence, then why are dumb computing machines even able to revolutionize computation? How are digital cameras doing facial recognition with far less computation power than human brains require? It's true that organic neurons have more internal state and some of the details of the process by which neurons operate are still undiscovered; However, we don't need to achieve the exact nuanced behavior of human neurons or even the same human brain neuron capacity scale or even its same connectivity types in order to produce intelligent behaviors. There are some general principals at work that any complex system will exhibit in order to achieve a given behavior, and those are worth emulating in an optimized fashion. Nature has converged upon solutions randomly using trial and error and going with the first working attempt the entropy gives her whether it is optimal or not. Replicating every detail of said accidental functionality exactly is not essential any more than it is essential for creatures to have 4 legs in order to walk.
It's already been proven that complexity yields intelligence. The more neurons the smarter the entity. In fact, we have been determining the minimal degree of complexity required to solve various problems, and nearly universally we can solve the same problems with far less complexity than the equivalent solution in nature, since organisms weren't intelligently designed. There is no binary dichotomy: An interaction does not reach some threshold and then magically becomes intelligent. Instead, there is an intelligence gradient: All systems exhibit some degree of "intelligence" AKA processing power, and the amount scales with complexity. Even a run of dominoes has some small degree of intelligence. Human brains have a lot of neurons doing stuff that isn't even required to produce sentience (thermal regulation, breath control, motor skills, etc). In fact, you can take whatever estimate your cognitive neuroscience prof claims the human brain has as a yardstick for the complexity requirement of sentience and