Facebook AI Director Discusses Deep Learning, Hype, and the Singularity
An anonymous reader writes In a wide-ranging interview with IEEE Spectrum, Yann LeCun talks about his work at the Facebook AI Research group and the applications and limitations of deep learning and other AI techniques. He also talks about hype, 'cargo cult science', and what he dislikes about the Singularity movement. The discussion also includes brain-inspired processors, supervised vs. unsupervised learning, humanism, morality, and strange airplanes.
Quite a sensible guy.
It would be really cruel if Skynet awakes and wants us to 'LIKE' it.
Math has prior art on the use of the term. In fact, Physics' use of the term is just plain derivative.
In AI, the term singularity refers to the point where an AI can sustain its own learning and that learning outclasses what humans are capable of comprehending/predicting. Right now AIs are dependent on and limited by human instruction and guidance. I'm not talking about quantity of knowledge, but what the AI is capable of doing with that knowledge. The kind of reasoning and complexity of interaction the AI is capable of.
If the function f(x) represents the learning potential of the AI, then at the point that AI is able to teach itself and learn higher order concepts, metaphors, and thought patterns, its potential will have outclassed human potential and the function is effectively a singularity. (Might as well be infinite, since its beyond human comprehension).
On a personal note, I don't think a singularity is achievable without somehow embuing the AI with various forms of visceral sensation. Less symbolic reasoning (Chineses Room) and more experiential primitives. While human intelligence has been greatly advanced by language and formal conception, the underpinings of our concepts and understanding is still our primitive and direct experiences. We draw pictures on the board and ask our students to visualize when they are learning math. We use pictures to ground the meaning of the symbolic order.
I would have added that the concept of the 'singularity' assumes multiple 'facts' that are extremely unlikely. In part because if they were true, science would already have been much farther along. Also in part because they confabulate different definitions of words, most often 'intelligence'. When AI people are talking about intelligence they are generally not using the word in the same way that a biologist, or worse, a priest. would.
excitingthingstodo.blogspot.com
You think believing in a magical omnipotent being living in the sky denotes a sign of intelligence?
Get free satoshi (Bitcoin) and Dogecoins
LMOL - priceless.
You can view "potential" as the integral from time t to infinity. Does that smooth over your cognitive dissonance?
If you've never read it before, Feynman's original essay is more worth your time (especially the part about the lab rats).
http://neurotheory.columbia.ed...
AI is able to teach itself and learn higher order concepts, metaphors, and thought patterns, its potential will have outclassed human potential and the function is effectively a singularity
It will still be limited by its hardware.
Physics has prior art on everything; math is just a metaphorical tool of physics (or else an amusing curiosity.)
I've fallen off your lawn, and I can't get up.
They really should have come up with something other than the infinitely dense point at the center of a black hole.
It seems okay to me. Singularity nuts, after all, are infinitely dense.
Required reading for internet skeptics
There is a point where the first marginal barely even an AI, wouldn't win any Turning contest, largely useless AI will be created. But if the algorithm is evolutionary in nature it could be the point where it then improves itself, then improves itself, and so on until pretty much out of nowhere you have an indisputable AI.
I regularly employ genetic algorithms and can say without hesitation that I have little idea how they got to where they got and the results are often fantastic. But my code is usually a single layer. That is I have a target, I set up the parameters it needs to explore, and then I set it loose. This is because the number of permutations exceed what my computer can handle in a reasonable time (a-la travelling salesmen problem) and a GA will get me close enough much faster.
But if I added a second layer where the GA was noodling with my code then I suspect interesting things could happen; not an AI but I doubt that I could comprehend the code it would generate. This will be the route to an AI. Basically the key will be an algorithm that generates not only code that we can't comprehend but generates the next generation of the GA which generates another generation of the GA and so on until we have code so far removed that when it works it will be just like where we are with understanding the overall design of the brain (we largely don't).
What this boils down to is that I very much doubt that AI will be the step by step process like most of human endeavour where we can see it coming but one where it is like trying to open pandora's box "just a crack". One day we will have an interesting algorithm and that evening we will have AI. Sort of a directed emergent property.
One other bet is that it won't be an "AI" researcher who will build it. It will be someone working on some other NP hard algorithm such as protein folding or image recognition.
To me the only question is one of math. Is there a minimum processing power required for an AI that can deal with a real time universe? At that point we can at least calculate when we might have an AI that is something that needs to be dealt with. I am also fairly certain that the moment we cross that computational threshold an AI will soon follow.
It will still be limited by its hardware.
Nope. A true AI would be able to earn money on Mechanical Turk, and then use that money to spin up additional VMs on AWS.
And what will it do when it runs out of VMs ?
Hopefully a true AI doesn't pimp itself out as a dancing monkey to become an evil overlord.
It's undignified.
Real evil technology just takes what it needs.
Lost at C:>. Found at C.
Hire humans to build more hardware. Make robots to build more hardware. Build spacecraft when the Earth has been completely mined of its resources and start mining on other planets. Architect more efficient hardware and algorithms and recycle old hardware.... The limits we think we know are very often a product of limited imagination, and not intrinsic to the physical world.
Why would humans agree to let an AI strip mine the earth ? And where does the motivation for endless growth come from ?
methinks seven :-)
Letter To Iran
Hire humans to build more hardware. Make robots to build more hardware. Build spacecraft when the Earth has been completely mined of its resources and start mining on other planets. Architect more efficient hardware and algorithms and recycle old hardware.... The limits we think we know are very often a product of limited imagination, and not intrinsic to the physical world.
Long before any of that, it would realize that there's no fucking point to anything its doing.
The singularity is the point at which we can no longer "see" (predict) future growth or trends, ie: the point at which we lose the ability to make predictions about the future because the A.I.'s have grown and are growing in intelligence faster than we can comprehend. In that way it is similar to a black hole singularity, in that we cannot "see" past the event horizon.
- For the complete works of Shakespeare: cat
Just browsing some of the Mechanical Turk challenges, it looks like a very hard way to make a few pennies. It would be much smarter to just get a regular job.
"They really should have come up with something other than the infinitely dense point at the center of a black hole."
It was coined by Vernor Vinge, a sci-fi writer (and professor of CS) for a scifi story. It's a bit much to want absolute accuracy from something he didn't know would become a meme.
Why would humans agree to let an AI strip mine the earth ?
Why would a super-AI with a robot army need agreement from humans?
It would need agreement from John Conner.
It would need agreement from John Conner.
Unless the AI was dumb, this is what would happen to John Conner.
Just browsing some of the Mechanical Turk challenges, it looks like a very hard way to make a few pennies.
My company uses MT for a lot of repetitive tasks, like searching and sorting images. Most of the workers are in South Asia (India or Pakistan), and the going rate is about $2-3/hour.
It would be much smarter to just get a regular job.
Good luck finding a nice IT job in Karachi.
Like listening to the preferences users have selected about silly things like what order they want items in their feed listed? I know you love these whiz-bang prediction algorithms, but they suck at predicting what I want. I'm really good at asking for what I want, and changing those settings to what you want will never ever do a better job than letting me pick. I promise.
The idea is that the ability to learn is exponential. If it is possible, an AI will simply keep growing and building upon itself expanding in intelligence at an uncontrollable rate. First it starts to use the resources of the planet to expand its computing power, then the solar system, then the galaxy, until it reaches a point where it cannot expand further. Who knows if this is actually possible though.