Slashdot Mirror
Cognitive Scientist David Rumelhart Dies At 68
dzou writes "David Rumelhart, a pioneer in building computer models of cognition and behavior, has died at the age of 68. Rumelhart conducted early research on artificial neural networks and helped develop the idea that cognition can be modeled through the interaction of many neuron-like units. In the 1980s, he was instrumental in developing neural networks that could learn to process information. At the time, although researchers understood how to train networks to solve linearly separable problems (like an AND gate), those networks could not solve linearly inseparable problems (like XOR), which would be crucial for modeling human cognitive processes. Rumelhart and his colleagues demonstrated that networks that solve these types of problems can be trained using the backpropagation learning algorithm. In turn, this has led to breakthroughs in areas like speech recognition and image processing, as well as models of human speech perception, language processing, vision, and higher-level cognition. Rumelhart suffered from Pick's disease in the last years of his life. An annual award in cognitive science, the David E. Rumelhart Prize, is given in his honor by the Glushko-Samuelson Foundation."
I think Dr Rumelhart should be remembered as a true founder of AI. While he wasn't there at the beginning (Dartmouth 1954), his work with McLelland, Hinton and Williams resurrected not just neural nets but in many ways the entire field of AI.
In 1969, Marvin Minsky and Seymour Papert published "Perceptrons" which emphasized the inadequacy of simple single layer NNs and effectively discouraged further funding of NNs, thereby directing the mainstream of AI research monies into symbols and logic for the next 20 years. But by the mid 1980s, it had become clear that AI was not living up to the promises of its leading lights to quickly produce a thinking machine. It was Dr Rumelhart (among others like Grossberg) who further investigated and developed NNs, integrating novel reinforcement techniques (e.g. backpropagation) and thus grounding the field of AI more mathematically, or as it was also known then, subsymbolically.
Since Dr Rumehart's work in the 1980s, subsymbolic AI has risen in importance as symbolic AI has fallen. Today, virtually all of AI research employs engineering techniques governed by increasingly sophisticated mathematical principles, and integrate feedback and learning, just as his work did. While I wouldn't claim Dr Rumelhart to be the father of modern AI, I would point out that the mathematics and machine learning central to his work correctly anticipated the current grounding of AI in both learning and numerical computation that reshaped and resurrected the field just as symbolic AI degenerated into the the "AI Winter" of the 1980s. Today's numerical AI researcher resembles subsymbolicists like Rumelhart significantly more than the renowned founders of AI, symbolicists all.