IBM Simulates a Cat-Like Brain: AI or Shadow Minds for Humans?

IBM's new cat brain simulation is both more -- and less -- than it seems.

I CAN HAS SINGULARITY?

A real-time computer-simulated cat brain? Could IBM have come up with a project more likely to trigger Internet excitement?

For the handful of you who missed the news, IBM's Almaden Research Center announced this week that it had produced a "cortical simulation" of the scale and complexity of a cat brain. This simulation ran on one of IBM's "Blue Gene" supercomputers, in this case at the Lawrence Livermore National Laboratory (LLNL). (An aside: LLNL is best known as the center for ongoing research into advanced nuclear weapons and related projects; if the lab is now turning its attention to brain simulations, I don't know whether to be happy that it's moving away from weapons or worried that it will try to weaponize AI.)

Worries about the Robopocalypse may be only partially tongue-in-cheek, but it's worth taking a moment to examine what exactly has happened here. This is what the IBM press release says about the simulation:

Scientists, at IBM Research - Almaden, in collaboration with colleagues from Lawrence Berkeley National Lab, have performed the first near real-time cortical simulation of the brain that exceeds the scale of a cat cortex and contains 1 billion spiking neurons and 10 trillion individual learning synapses.

This isn't a simulation of a cat brain, it's a simulation of a brain structure that has the scale and connection complexity of a cat brain. It doesn't include the actual structures of a cat brain, nor its actual connections; the various experiments in the project filled the memory of the cortical simulation with a bunch of data, and let the system create its own signals and connections. Put simply, it's not an artificial (feline) intelligence, it's a platform upon which an A(F)I could conceivably be built.

Long-time readers may be having a deja vu moment here, and for good reason. The same team responsible for the cat-scale brain sim created a mouse-scale brain sim a few years ago. One of the researchers, Dharmendra Modha, runs a blog on cognitive computing, and has posted a PDF of the research paper on this project. If you want the hard-core science, not just a press release, have fun.

brain bluegene

Ultimately, this is a very interesting development, both for the obvious reasons (an artificial cat brain!) and because of its associated "Blue Matter" project, which uses supercomputers and magnetic resonance to non-invasively map out brain structures and connections. The cortical sim is intended, in large part, to serve as a test-bed for the maps gleaned by the Blue Matter analysis. The combination could mean taking a reading of a brain and running the shadow mind in a box.

Science fiction writers will have a field day with this, especially if they develop a way to "write" neural connections, and not just read them. Brain back-ups? Shadow minds in a box, used to extract secret knowledge? Hypercats, with brains operating at a thousand times normal speed? The mind reels.

But the reality is that in many ways the IBM team has done the easy part, and still has a far greater challenge ahead of them. As I said in response to the mouse sim announcement in 2007, the brain isn't simply a haphazard mass of neural junctions; a functional structure simulation may well prove to be a far greater task than simply getting the neural connection sim working. Don't expect to be able to upload your cat's brain into your Roomba any time soon.

Images:

I CAN HAS SINGULARITY? by Jamais Cascio, Creative Commons Licensed
Brain meets BlueGene from "The Cat Is Out of the Bag: Cortical Simulations with 109 Neurons, 1013 Synapses" by Rajagopal Ananthanarayanan, Steven K. Esser, Horst D. Simon, and Dharmendra S. Modha.

Add New Comment

2 Comments

  • Henry Markram

    IBM's claim is a HOAX.

    This is a mega public relations stunt - a clear case of scientific deception of the public. These simulations do not even come close to the complexity of an ant, let alone that of a cat. IBM allows Mohda to mislead the public into believing that they have simulated a brain with the complexity of a cat - sheer nonsense.

    Here are the scientific reasons why it is a hoax:

    How complex is their model?
    They claim to have simulated over a billion neurons interacting. Their so called "neurons" are the tiniest of points you can imagine, a microscopic dot. Over 98% of the volume of a neuron is branches (like a tree). They just cut off all the branches and roots and took a point in the middle of the trunk to represent a entire neuron. In real life, each segment of the branches of a neuron contains dozens of ion channels that powerfully controls the information processing in a neuron. They have none of that. Neurons contain 10's of thousands of proteins that form a network with 10's of millions of interactions. These interactions are incredibly complex and will require solving millions of differential equations. They have none of that. Neurons contain around 20'000 genes that produce products called mRNA, which builds the proteins. The way neurons build proteins and transport them to all the corners of the neuron where they are needed is an even more complex process which also controls what a neuron is, its memories and how it will process information. They have none of that. They use an alpha function (up fast down slow) to simulate a synaptic event. This is a completely inaccurate representation of a synapse. There are at least 6 types of synapses that are highly non-linear in their transmission (i.e. that transform inputs and not only transmit inputs). In fact you would need a 10's of thousands of differential equations to simulate one synapse. Synapses are also extremely complex molecular machines that would themselves require thousands of differential equations to simulate just one. They simulated none of this. There are complex differential equations that must be solved to simulate the ionic flow in the branches, to simulate the ion channels biophysics, the protein-protein interactions, as well as the complete biochemical and genetic machinery as well as the synaptic transmission between neurons. 100's of thousands of more differential equations. They have none of this. These "points" they simulated and the synapses that they use for communication are literally millions of times simpler than a real cat brain. So they have not even simulated a cat's brain at one millionth of its complexity.

    Is it nonetheless the biggest simulation ever run?
    No. These people simulated 1.6 billion points interacting. They used a formulation to model the summing up and threshold spiking of the "points" called the Izhikevik Formulation. Prof Eugene Izhikevik himself already in 2005 has run a simulation with 100 billion such points interacting just for the fun of it: (over 60 times larger simulation) :
    http://www.izhikevich.org/huma....
    The simulations ran on a cluster of desktop PCs every graduate student could have built. This is no technical achievement. That model exhibited oscillations, but that always happens so even simulating 100 Billion such points interacting is light years away from a brain.

    Is the simulator they built a big step?
    Not even close. There are numerous proprietary and peer-reviewed neurosimulators (e.g., NCS, pNEURON, SPLIT, NEST) out there that can handle very large parallel models that are essentially only bound by the available memory. The bigger the machine you have available, the more neurons you can simulate. All these simulators apply optimizations for the particular platform in order to make optimal use of the available hardware. Without any comparison to existing simulators, their publication is a non-peer reviewed claim.

    Did they learn anything about the brain?
    They got very excited because they saw oscillations. Oscillations are an obligatory artifact that one always gets when many points interact. These findings that they claim on the neuroscience side may excite engineers, but not neuroscientists.

    Why did they get the Gordon Bell Prize?
    They submitted a non-peer reviewed paper to the Gordon Bell Committee and were awarded the prize almost instantly after they made their press release. They seem to have been very successful in influencing the committee with their claim, which technically is not peer-reviewed by the respective community and is neuroscientifically outrageous.

    But is there any innovation here?
    The only innovation here is that IBM has built a large supercomputer - which is irrelevant to the press release.

    Why did IBM let Mohda make such a deceptive claim to the public?
    I don't know. Perhaps this is a publicity stunt to promote their supercompter. The supercomputer industry is suffering from the financial crisis and they probably are desperate to boost their sales. It is so disappointing to see this truly great company allow the deception of the public on such a grand scale.

    But have you not said you can simulate the Human brain in 10 years?
    I am a biologist and neuroscientist that has studied the brain for 30 years. I know how complex it is. I believe that with the right resources and the right strategy it is possible. We have so far only simulated a small part of the brain at the cellular level of a rodent and I have always been clear about that.

    Would other neuroscientists agree with you?
    There is no neuroscientist on earth that would agree that they came even close to simulating the cat's brain - or any brain.

    But did Mohda not collaborate with neuroscientists?
    I would be very surprised if any neuroscientists that he may have had in his DARPA consortium realized he was going to make such an outrages claim. I can imaging that it is remotely possible that the San Fransisco neuroscientists knew he was going to make such a stupid claim.

    But did you not collaborate with IBM?
    I was collaborating with IBM on the Blue Brain Project at the very beginning because they had the best available technology to faithfully allow us to integrate the diversity and complexity found in brain tissue into a model. This for me is a major endeavor to advance our insights into the brain and drug development. Two years ago, when the same Dharmendra Mhoda claimed the “mouse-scale simulations”, I cut all neuroscience collaboration with IBM because this is an unethical claim and it deceives the public.

    Aren't you afraid they will sue you for saying that they have deceived the public?
    We'll there is right and wrong and what they have done is not only wrong, but outrageous. They deceived you and millions of other people.

    Henry Markram
    Blue Brain Project