Slashdot Mirror


Jeff Hawkins' Cortex Sim Platform Available

UnreasonableMan writes "Jeff Hawkins is best known for founding Palm Computing and Handspring, but for the last eighteen months he's been working on his third company, Numenta. In his 2005 book, On Intelligence, Hawkins laid out a theoretical framework describing how the neocortex processes sensory inputs and provides outputs back to the body. Numenta's goal is to build a software model of the human brain capable of face recognition, object identification, driving, and other tasks currently best undertaken by humans. For an overview see Hawkins' 2005 presentation at UC Berkeley. It includes a demonstration of an early version of the software that can recognize handwritten letters and distinguish between stick figure dogs and cats. White papers are available at Numenta's website. Numenta wisely decided to build a community of developers rather than trying to make everything proprietary. Yesterday they released the first version of their free development platform and the source code for their algorithms to anyone who wants to download it."

6 of 126 comments (clear)

  1. Right... by Bugpowda · · Score: 5, Insightful

    I'm still a bit confused as to how he is so confident that this is how the neocortex works given that this is still one of the 23 unsolved problems in system neuroscience. But hey, he made a lot of money off Palm, that gives him way more street cred than people who have been working on this problem for their whole lives.

    1. Re:Right... by Walt+Dismal · · Score: 5, Interesting

      I've been working for some time on technology with hierarchical NN architecture like Hawkin's HTM, but mine in part involves SIPO FIFOs with attached neural networks, and the output of the NNs go to the next layer's SIPO+NNs, and so on up the chain. It's intended to extract meaning from symbol flow over time. Like speech primitives into language. Hawkins embeds temporal symbol handling in each HTM layer in a different way. Both of us are trying to emulate some of the processing the neocortex does, but I am less concerned with matching closely the brain and more concerned with outperforming the limitations of the brain. I believe there are classes of problems his architecture will solve, but can't handle others. There's lots of room for people to explore what his technology can do, and I expect it will work well for some things.

  2. High-Quality Video Link by overeduc8ed · · Score: 5, Informative

    High quality versions of Jeff Hawkin's talk at UC Berkeley are available here.

  3. Re:Barrier to entry by RyanFenton · · Score: 5, Insightful

    Don't be so afraid of complexity - Slashdotters make fun of themselves for diving into things uneducated (not reading the articles, not RTFM), but really, the only way to cope with such an informationaly complex landscape such as computing is to sometimes just be willing to go unprepared and be willing to make mistakes, and to ask stupid questions.

    Not so much dare to be stupid, but rather the Socratic, don't be afraid of exposing your own ignorance - don't lose your opportunity to learn by merely being embarrassed of people thinking you dumb while you take your first few steps in a new landscape.

    But do take notes and research the small topics you are uncertain of after your first adventure into to the topic. Perhaps you'll need to learn a bit about XML/XSL, perhaps you'll need to find out the anatomy of a nerve cell to understand some explanations. If nothing else though - get into it because it is a fun adventure and a lot of cool stuff to learn.

    Ryan Fenton

  4. Confidentiality agreement a killer by else58 · · Score: 5, Informative
    The download license looked fine until the Confidentiality paragraph. Does it really say that anything I learn from Numenta is confidential property of Numenta?

    Confidentiality. 1. Protection of Confidential Information. You agree that all code, inventions, algorithms, business concepts, workflow, ideas, and all other business, technical and financial information, including but not limited to the HTM Algorithms, HTM Algorithms Source Code, and HTM Technology, that you obtain or learn from Numenta in connection with this Agreement are the confidential property of Numenta (Confidential Information). Except as authorized herein, you will hold in confidence and not use, except as permitted or required in the Agreement, or disclose any Confidential Information and you will similarly bind your employees in writing. You will not be obligated under this Section 6 with respect to information that you can document: (i) is or has become readily publicly available without restriction through no fault of you or your employees or agents; or (ii) is received without restriction from a third party lawfully in possession of such information and lawfully empowered to disclose such information; or (iii) was rightfully in your possession without restriction prior to its disclosure by Numenta; or (iv) was independently developed by your employees or consultants without access to such Confidential Information.
  5. Cortex Sim == Bullsh*t by Anonymous Coward · · Score: 5, Interesting

    Hawkins is a rich guy, and no-one feels like telling him that his stuff is crap. He had a few smart people working for him at some point, but when they told him his ideas were half baked and not new, he just fired their asses.

    Here is what many people in machine learning and computer vision think about Hawkins stuff:
    - it's way, way behind what other people in vision and machine learning are doing. Several teams have biologically-inspired vision systems that can ACTUALLY LEARN TO RECOGNIZE 3D OBJECTS. Hawkins merely has a small hack that can recognize stick figures on 8x8 pixel binary images. Neural net people were doing much more impressive stuff 15 years ago.
    - Hawkins's ideas on how the brain learns are not new at all. Many scientists in machine learning, computer vision, and computational neuroscience have had general ideas similar to the ones described in Hawkins's book for a very long time. But scientists never talk about philosophical ideas without actual scientific evidence to support them. So instead of writing popular book with half-baked conceptual ideas, they actually build theories and algorithms, they build models, and they apply them to real data to see how they work. Then they write a scientific paper about the results, but they rarely talk about the philosophy behind the results.

    It's not unusual for someone to come up with an idea they think is brand new and will revolutionize the world. Then they try to turn those conceptual ideas into real science and practical technologies, and quickly realize that it's very hard (the things they thought of as mere details often turn out to be huge conceptual obstacles). Then, they realize that many people had the same ideas before, but encountered the same problems when trying to reduce them to practice (which is why you didn't hear about their/your ideas before). These people eventually scaled back their ambitions and started working on ideas that were considerably less revolutionary, but considerably more likely to result in research grants, scientific publications, VC funding, or revenues.

    Most people go through that "naive" phase (thinking they will revolutionize science) while they are grad students. A few of them become successful scientists. A tiny number of them actually manage to revolutionize science or create new trends. Hawkins quit grad school and never had a chance to go through that phase. Now that he is rich and famous, the only way he will understand the limits of his idea is by wasting lots of money (since he obviously doesn't care about such things as "peer review"). In fact, many reputable AI scientists have made wild claims about the future success of their latest new idea (Newell/Simon with the "general theorem prover", Rosenblatt with the "Perceptron", Papert who thought in the 50's that vision would be solved over the summer, Minsky with is "Society of Minds", etc......).

    No scientist will tell Hawkins all this, because it would serve no purpose (other than pissing him off). And there is a tiny (but non-zero) probability that his stuff will actually advance the field.

        - Anonymous Scientist