Slashdot Mirror


A Skeptical Reaction To IBM's Cat Brain Simulation Claims

kreyszig writes "The recent story of a cat brain simulation from IBM had me wondering if this was really possible as described. Now a senior researcher in the same field has publicly denounced IBM's claims." More optimisticaly, dontmakemethink points out an "astounding article about new 'Neurogrid' computer chips which offer brain-like computing with extremely low power consumption. In a simulation of 55 million neurons on a traditional supercomputer, 320,000 watts of power was required, while a 1-million neuron Neurogrid chip array is expected to consume less than one watt."

19 of 198 comments (clear)

  1. Does anyone really know what a cat thinks? by cyberspittle · · Score: 5, Funny

    Think about it. Think about it like a cat.

    1. Re:Does anyone really know what a cat thinks? by Jesus_666 · · Score: 4, Funny

      Okay.

      Give me food. Now.

      --
      USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
    2. Re:Does anyone really know what a cat thinks? by Jesus_666 · · Score: 4, Funny

      Where's my food? I asked for food more than one minute ago and there's nothing here yet. I am outraged.

      --
      USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
    3. Re:Does anyone really know what a cat thinks? by Jesus_666 · · Score: 4, Funny

      I still see a distinct lack of you-provided food around here. Make it snappy, can opener slave!

      --
      USE HOT GRITS WITH STATUE OF NATALIE PORTMAN (NAKED AND PETRIFIED)
    4. Re:Does anyone really know what a cat thinks? by jhoegl · · Score: 5, Funny

      Hey... whats that moving dot on the wall? Why is it there? I must have it! Great! I captured it! Wait, whats this? It escaped me, inconceivable!!! What luck, it stopped right by my paw, Ill will capture it again! NNNNOOOOOOO!!!! Look, look there, its something moving under my feet. I must pounce it to figure out what it is! Weird, I pounced it and its still moving. Ill pounce it again! Ah, there it stopped moving, Ill sniff it now. Wait, its moving again... Curse you!

  2. nonlinear by Garble+Snarky · · Score: 5, Insightful

    Wouldn't power consumption grow more than linearly with neuron count? I would think the number of connections is the dominant factor - so the comparison of two data points of power consumption vs neuron count is meaningless.

  3. All those neurons using less than 1 watt? by drainbramage · · Score: 5, Funny

    All those neurons using less than 1 watt?
    I know some people like that.

    --
    No brain, no pain.
    1. Re:All those neurons using less than 1 watt? by dontmakemethink · · Score: 4, Interesting

      Actually if you read TFA, the long-pondered question of why humans only use 1-15% of their brain is largely a matter of power consumption, and the reason for the abundance of dormant neurons is for greater potential diversity of thought.

      "While accounting for just 2 percent of our body weight, the human brain devours 20 percent of the calories that we eat."

      "The brain achieves optimal energy efficiency by firing no more than 1 to 15 percent—and often just 1 percent—of its neurons at a time."

      That seems to indicate that a human brain would burn more calories than the rest of the body if it were "always on".

      Being a hypoglycemia sufferer, I can attest to the severe limitations of brain activity when deprived of sugar. Before being diagnosed I underwent tunnel vision and black-outs, not to mention the typical mood swings, shakiness, cold sensations, etc.

      Never has my nickname been more appropriate...

      --

      War as we knew it was obsolete
      Nothing could beat complete denial
      - Emily Haines
  4. long ways to go yet by Anonymous Coward · · Score: 5, Insightful

    From the original FA: "The simulation, which runs 100 times slower than an actual cat's brain, is more about watching how thoughts are formed in the brain and how the roughly 1 billion neurons and 10 trillion synapses in a cat's brain work together."

    So the most bad-ass computer simulation, assuming it worked, which this guy is saying it probably didn't, was still 100 times slower than a real cat's brain. A real cat's brain also fits inside a tiny furry space the size of a baseball... and it runs on a once-daily small bowl of cat food. We have a long ways to go.

    1. Re:long ways to go yet by Anonymous Coward · · Score: 5, Informative

      More than this, their simulated neurons aren't anywhere close to the real thing. A real neuron, an individual cell, has tremendous computing power due to the distribution of a bunch of different ion channel types (active conductances) in a highly complex dendritic tree. Simulating a few seconds of just ONE neuron accurately can take several minutes to several hours of supercomputer time. I know this because I do it for a living.

    2. Re:long ways to go yet by toppavak · · Score: 5, Informative

      He's not arguing that it didn't work, he's arguing that they essentially ran a simulation of a large Artificial Neural Network, a relatively trivial task as long as you have a big enough computer behind it. ANNs are essentially points that connect to each other and learn by assigning weights to these various connections- this is essentially the simplest possible way to simulate the behavior of a neuron. The argument is being made that to claim an ANN, regardless of its size, approaches the capabilities of any mammalian brain is simply wrong, and that a true attempt to create such a simulation would need to factor in the stochasticity of ion channels, branchings in neurons and various other biological phenomena that have a tremendous impact on how our brains work.

      Without reading more details on the original work, I'm inclined to say that he has a very valid point if they were indeed only running a large ANN model.

    3. Re:long ways to go yet by Neil+Hodges · · Score: 4, Funny

      ...I know this because I do it for a living.

      Don't each of our brains do this for a living, too?

    4. Re:long ways to go yet by Rod+Frey · · Score: 4, Insightful

      Isn't there value in moving to a higher level of abstraction than a single neuron though? Or simplifying the basic elements for the sake of a tractable broader model?

      Simulating a single atom, for example, is reasonably complex: it would be impossible with current computational resources to simulate the electromagnetic properties of a metal if we required accurate simulations of individual atoms. Yet despite ignoring what we know about the atomic models, the higher-level models are very predictive.

      Not that we have such predictive, higher-level models for the brain. That's what some researchers are searching for: I'm just suggesting that those models hopefully won't require accurate simulation of individual neurons. That seems to be the pattern in other domains.

  5. Brute force neurons... by xtracto · · Score: 4, Insightful

    So according to this guy rant letter, the "cat-brain simulation" was nothing more than the simulation of a ANN wiht X number of neurons with X equal to the average number of neurons in a cat.

    However, it seems the /complexity/ of the simulated neurons is not remotely similar to that of the neurons of a real cat.

    With that view, yes it seems less breakthrough. The experiment reminds me of AI researchers that thought that we could get intelligent machines using a brute-force kind of approach; this by adding /enough/ knowledge-rules, /enough/ processing power, etc...

    --
    Ubuntu is an African word meaning 'I can't configure Debian'
  6. Skeptical? by golden+age+villain · · Score: 5, Interesting

    This IBM announcement was just ridiculous. To cite only one argument, the brain does not consist only of neurons. It contains at least as many other cells which are also involved in signal processing. Mohda would be laughed at in any neuroscience conference and he certainly doesn't help the cause of theoreticians in the neuroscience field by making such stupid announcements. Eugene Izhikevich who designed the neuron model being used for these simulations had a PNAS paper not too long ago modeling the entire human brain and he did not claim that he successfully modeled the human brain. Plus no one has any clue how the brain computes really so making a claim about the formation of thoughts is just nonsense.

  7. Re:Except by eldavojohn · · Score: 4, Informative

    Except that individual neurons have tens of thousands of possible connections to other neurons, and continually morph and change those connections. That's impossible to do on a rigid piece of hardware.

    I'm no expert and I've just been reading the second link's project site on Stanford's page but your assertion to continually morph and change those connections seems to be mitigated by this strategy:

    Neurogrid simulates six billion synaptic connections by using local analog communication, another choice motivated by cortical studies. Cortical axons synapse profusely in a local area, course along for a while, then do it again. Thus, nearby neurons receive inputs from largely the same axons, as expected from the map-like organization of cortical areas. Local wires running between neighboring silicon neurons emulate these patches, invoking postsynaptic potentials within a programmable radius. Using a patch radius of 6 lets us increase the number of synaptic connections a hundredfold—from 600 million to six billion—without increasing digital communication.

    If they connect most (if not all) possible connections that the morphing/changing synaptic channels can take, then they use a sort of addressing technique and RAM strategy to continually morph and change:

    Instead of hardwiring the silicon neurons together, as Mead did in his silicon retina, we softwired them by assigning unique addresses. Every time a spike occurs, the chip outputs that neuron’s address. This address points to a memory location (RAM) that holds the synaptic target’s address, or to multiple memory locations if the neuron has multiple synaptic targets. When this address is fed back into the chip, a post-synaptic potential is triggered at the target. An extremely efficient technique, as the same post-synaptic circuit serves all the synapses that neuron receives—virtual synapses! Encoding, translating, and decoding an address happens fast enough to route several million spikes per second, allowing a million connections to be made among a thousand silicon neurons. These softwires may be rerouted simply by overwriting the RAM’s look-up table, making it possible to specify any desired synaptic connectivity.

    Although their page is really hard for a lay person like myself to get through, it's very informative. Having read it, I'm considerably more optimistic about the future of biological tissues and nervous systems being translated to hardware. At least people are starting back at the simple components and adding new twists.

    --
    My work here is dung.
  8. Markram's for real by bellwould · · Score: 5, Informative

    My research recently took me to some of Markram's work - the guy is brilliant and REALISTIC. His research goals are simple and attainable and any claims of success he has are *well* within the real world. He's incrementally worked his way up from a few neurons - the way a *real* scientist works; and to him, the simplest "brain simulation" of any sort is definitely possible, but far off in the future.

  9. Re:Brain Power by Yvan256 · · Score: 4, Insightful

    In a simulation of 55 million neurons on a traditional supercomputer, 320,000 watts of power was required, while a 1-million neuron Neurogrid chip array is expected to consume less than one watt.

    320kW / 55 = 5.818kW per million of neuro with a traditional supercomputer.
    One watt per million of neuro with a Neurogrid chip array.

    So if a cat's brain is 1 BILLION neurons, that would require 5818.182kW with a supercomputer and 1kW with the Neurogrid chip array.

    A reduction of 5817.182kW.

  10. Re:Almaden's Dharmendra Modha: You got pwned! by yt.rabb+at+gmail · · Score: 5, Funny

    The only thing missing from that email was his momma. Hey Mohda, Your momma's research methodology is so flawed, that she puts the hypothesis to be proven as an assumption. Biatch.