Slashdot Mirror


Wired Founding Editor Now Challenges 'The Myth of A Superhuman AI' (backchannel.com)

Wired's founding executive editor Kevin Kelly wrote a 5,000-word takedown on "the myth of a superhuman AI," challenging dire warnings from Bill Gates, Stephen Hawking, and Elon Musk about the potential extinction of humanity at the hands of a superintelligent constructs. Slashdot reader mirandakatz calls it an "impeccably argued debunking of this pervasive myth." Kelly writes: Buried in this scenario of a takeover of superhuman artificial intelligence are five assumptions which, when examined closely, are not based on any evidence... 1.) Artificial intelligence is already getting smarter than us, at an exponential rate. 2.) We'll make AIs into a general purpose intelligence, like our own. 3.) We can make human intelligence in silicon. 4.) Intelligence can be expanded without limit. 5.) Once we have exploding superintelligence it can solve most of our problems... If the expectation of a superhuman AI takeover is built on five key assumptions that have no basis in evidence, then this idea is more akin to a religious belief -- a myth
Kelly proposes "five heresies" which he says have more evidence to support them -- including the prediction that emulating human intelligence "will be constrained by cost" -- and he likens artificial intelligence to the physical powers of machines. "[W]hile all machines as a class can beat the physical achievements of an individual human...there is no one machine that can beat an average human in everything he or she does."

11 of 284 comments (clear)

  1. But how will I trick investors!?! by Anonymous Coward · · Score: 5, Funny

    Anything is possible in 10-20 years, just give me all your money!

    1. Re: But how will I trick investors!?! by Zero__Kelvin · · Score: 5, Insightful

      I can design a system that is a Star Trek style Communicator that is also a computer more powerful than today's multi-million dollar Supercomputers, fits in your pocket, and will run on battery power for days*.

      * Circa 1970

      Today's "youth" have no perspective. It's you know your technology history you DO NOT doubt such claims. Do you have any idea how far we have progressed in less than half a human lifetime? Do you not get that the advancement of technology has far been non-linear to the point of being almost exponential?

      --
      Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
    2. Re: But how will I trick investors!?! by TheRaven64 · · Score: 5, Informative

      Except that the claims of strong AI 'real soon now' have been coming since the '60s. Current AI research is producing things that are good at the sorts of things that an animal's autonomic system does. AI research 40 years ago was doing the same thing, only (much) slower. The difference between that and a sentient system is a qualitative difference, whereas the improvements that you list are all quantitative.

      Neural networks are good at generating correlations, but that's about all that they're good for. A large part of learning to think as a human child is learning to emulate a model of computation that's better suited to sentient awareness on a complex neural network. Most animals have neural networks in their heads that are far more complex than anything that we can build now, yet I'm not seeing mice replacing humans in most jobs.

      --
      I am TheRaven on Soylent News
  2. Re:"constrained by cost" by raftpeople · · Score: 5, Informative

    Given that our knowledge of the computational complexity of a single neuron is growing steadily, I think it's safe to say your FPGA cell estimate for a neuron was significantly too low.

    For example, scientists now know that one single neuron (of certain types) is an entire neural network all by itself. Dendrites with multiple localized spikes communicating with each other and with other cells. Ultimately performing non-linear computation prior to forwarding any signal to cell body.

  3. Neither can most humans by The+Evil+Atheist · · Score: 5, Insightful

    there is no one machine that can beat an average human in everything he or she does

    Neither can most humans. There is no such thing as an average human. Every individual human specializes, and increasingly so as they get older (or they do not improve). It is a pervasive strawman to require AIs to "beat" an average human when the same quality isn't used to judge humans.

    --
    Those who do not learn from commit history are doomed to regress it.
  4. Re: Well it's easy to show superhuman AI is a myth by Anonymous Coward · · Score: 5, Insightful

    AlphaGo is not a "general purpose" learning mechanism. It won't ever write sonnets meaningful to humans, or be able to to dance, or even employ symbolic differentiation.

    It is a really nice toolset, and it is able to solve a task which is difficult for humans, but so does Google or your high-school calculator when you calculate sin(1.2).

    It won't ever go beyond the computational underpinnings of playing Go-like games: evaluating game positions and calculating game trees. It won't ever say 'forget it, I'd rather be drinking beer with my buddies', which is an intelligent thing to do for most of us with respect to playing Go.

    There's nothing human-like about AlphaGo, except that it solves a problem relevant to humans; the calculator example comes in mind.

    I'd be thrilled to know what kind of specific major human problems you'd consider AI-approachable, because I currently only see a bunch of more or less advanced mechanisms that are fine-tuned to solve very specific computationally well-defined problems, and most human problems are not computationally well defined.

  5. Re: Boners by Zero__Kelvin · · Score: 5, Funny

    Holy Shit! Donald Trump is a Slashdotter! Don't worry Donnie. They'll be working on bigger hands next!

    --
    Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
  6. Re:Well it's easy to show superhuman AI is a myth. by Visarga · · Score: 5, Interesting

    This kind of problem will be very visible in healthcare. Human doctors will self censor for fear of contradicting AI and taking the wrong choice, that ends up badly for the patient. Because AI is right most of the time, who will have the courage of saying otherwise? Saying truth to AI could cost a person their job. Many doctors stop giving honest feedback the moment they hear another doctor has given a diagnosis out of solidarity with their colleagues or fear of the consequences of making enemies.

  7. Re:"constrained by cost" by mikael · · Score: 5, Informative

    Human (or just vision in general) is the best example. It accounts for 30% of the brain capacity. At one end, you have the human eye with a retina consisting of 100 million rods and cones. Then just in that space of a 5mm disc, there are seven layers of processing used to do contrast detection between colors and intensity along with edge detection. The optic nerve takes the compressed information from a thousand areas then passes it through to the brain into two paths; one to identify where objects are, the other to determine what the objects are and their orientation. Understanding what just a single region or layer of brain cells does leads to dozens of papers being published and advances in digital photography (image stabilization, motion correction).

    --
    Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
  8. Re:"constrained by cost" by angel'o'sphere · · Score: 5, Interesting

    Indeed!
    And one of the myricals in this is: if an object is about to hit your eyes or comes close by, the reflext to close the eyes and raise your hands etc. is triggered _before_ that information has even reached the brain/visual cortex.
    The signal processing in the eye can bypass the visual cortex to trigger protective actions.

    --
    Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  9. Re: Well it's easy to show superhuman AI is a myth by sudon't · · Score: 5, Insightful

    1) AlphaGo exploded on the scene by beating world class Go players much faster and much earlier than expected. Exponentially is a loaded word. e^0.0000001 is an exponential growth rate. So let's not quibble about how exponential the growth rate is.

    Particularly as we can't really measure intelligence. But "exponential" has a meaning, and it means a steady rate of doubling.

    2) AlphaGo is a general purpose learning tool. Just listen to the lectures and articles penned by the DeepMind team.

    No, it's a narrow AI. In the end, it's simply doing math. It's not "thinking" in any sense of the term. It's just able to hold many more probabilities in its memory than a human, and play them out much faster.

    3) Alphago has displayed human-like intelligence, as claimed by the Go professionals it has played. They have said that AlphaGo plays like a human player.

    That is what you call anthropomorphizing. The human players are simply projecting onto the machine.

    4) If you take the fourth assumption literally, AI's intelligence is going to expand infinitely. Talking about infinity in human terms is unreasonable. Yes, AI's intelligence will expand.

    "Infinite" simply means there's no limit. We don't know whether or not there's a limit to intelligence, but since the universe is finite, there would seem to be a limit to the things one could know. Infinite intelligence is our notion of God. What are the odds that infinite intelligence is also mythological?

    --
    -- sudon't

    Air-ride Equipped