Slashdot Mirror
Opinion: Artificial Intelligence Hits the Barrier of Meaning (nytimes.com)
Machine learning algorithms don't yet understand things the way humans do -- with sometimes disastrous consequences. Melanie Mitchell, a professor of Computer Science at Portland State University, writes: As someone who has worked in A.I. for decades, I've witnessed the failure of similar predictions of imminent human-level A.I., and I'm certain these latest forecasts will fall short as well. The challenge of creating humanlike intelligence in machines remains greatly underestimated. Today's A.I. systems sorely lack the essence of human intelligence: understanding the situations we experience, being able to grasp their meaning. The mathematician and philosopher Gian-Carlo Rota famously asked, "I wonder whether or when A.I. will ever crash the barrier of meaning." To me, this is still the most important question.
The lack of humanlike understanding in machines is underscored by recent cracks that have appeared in the foundations of modern A.I. While today's programs are much more impressive than the systems we had 20 or 30 years ago, a series of research studies have shown that deep-learning systems can be unreliable in decidedly unhumanlike ways. I'll give a few examples. "The bareheaded man needed a hat" is transcribed by my phone's speech-recognition program as "The bear headed man needed a hat." Google Translate renders "I put the pig in the pen" into French as "Je mets le cochon dans le stylo" (mistranslating "pen" in the sense of a writing instrument). Programs that "read" documents and answer questions about them can easily be fooled into giving wrong answers when short, irrelevant snippets of text are appended to the document.
Similarly, programs that recognize faces and objects, lauded as a major triumph of deep learning, can fail dramatically when their input is modified even in modest ways by certain types of lighting, image filtering and other alterations that do not affect humans' recognition abilities in the slightest. One recent study showed that adding small amounts of "noise" to a face image can seriously harm the performance of state-of-the-art face-recognition programs. Another study, humorously called "The Elephant in the Room," showed that inserting a small image of an out-of-place object, such as an elephant, in the corner of a living-room image strangely caused deep-learning vision programs to suddenly misclassify other objects in the image.
The lack of humanlike understanding in machines is underscored by recent cracks that have appeared in the foundations of modern A.I. While today's programs are much more impressive than the systems we had 20 or 30 years ago, a series of research studies have shown that deep-learning systems can be unreliable in decidedly unhumanlike ways. I'll give a few examples. "The bareheaded man needed a hat" is transcribed by my phone's speech-recognition program as "The bear headed man needed a hat." Google Translate renders "I put the pig in the pen" into French as "Je mets le cochon dans le stylo" (mistranslating "pen" in the sense of a writing instrument). Programs that "read" documents and answer questions about them can easily be fooled into giving wrong answers when short, irrelevant snippets of text are appended to the document.
Similarly, programs that recognize faces and objects, lauded as a major triumph of deep learning, can fail dramatically when their input is modified even in modest ways by certain types of lighting, image filtering and other alterations that do not affect humans' recognition abilities in the slightest. One recent study showed that adding small amounts of "noise" to a face image can seriously harm the performance of state-of-the-art face-recognition programs. Another study, humorously called "The Elephant in the Room," showed that inserting a small image of an out-of-place object, such as an elephant, in the corner of a living-room image strangely caused deep-learning vision programs to suddenly misclassify other objects in the image.
I wonder if these AI vision systems that input millions of images are actually doing a deep learning, or are just canvassing pretty much every image possibility such that any possible live image is just a tiny automated delta calculation away from an answer.
This would explain why tweaking the input in the described ways would throw the AI into a tizzy -- the tweaked input isn't within a tiny delta of any of the millions of categorized images.
(-1: Post disagrees with my already-settled worldview) is not a valid mod option.
The Turing test has led us down a rocky road and we have a very long way to go. Artificial human-like intelligence IMHO is still a long way away. Most people make shoot from the hip assumptions about how the brain works and after doing some basic math about Moore's law assume super intelligence is right around the corner.
The brain is way more complicated than we know.
For example: there are two stable isotopes of lithium. Chemically they are identical, but they do not have the same effect on the brain. One is useful as a drug to treat mental illness and the other is not. This means there is something more subtle about how our brain works than interconnections and electrochemistry.
It is however a worthy challenge because the journey will teach us much about who we really are and how we work.
Greed is the root of all evil.
When human beings see something unexpected, we do a double take
Of course, you first need to see something unexpected. In the famous video of white/black people passing a ball, very few people noticed the gorilla. They never did a double take. https://www.youtube.com/watch?... This happens all the time in real life.