Slashdot Mirror


What AI Experts Think About the Existential Risk of AI

DaveS7 writes: There's been no shortage of high profile people weighing in on the subject of AI lately. We've heard warnings from Elon Musk, Bill Gates, and Stephen Hawking while Woz seems to have a more ambivalent opinion on the subject. The Epoch Times has compiled a list of academics in the field of AI research who are offering their own opinions. From the article: "A 2014 survey conducted by Vincent Müller and Nick Bostrom of 170 of the leading experts in the field found that a full 18 percent believe that if a machine super-intelligence did emerge, it would unleash an 'existential catastrophe' on humanity. A further 13 percent said that advanced AI would be a net negative for humans, and only a slight majority said it would be a net positive."

8 of 421 comments (clear)

  1. Funny, that spin... by Garridan · · Score: 5, Insightful

    The summary really emphasizes the minority opinion, "and only a slight majority said it would be a net positive." As if "only a slight majority" is not the majority opinion.

    1. Re:Funny, that spin... by Anonymous Coward · · Score: 5, Insightful

      In light of the fact that Stephen Hawking, Bill Gates and Elon Musk are not even remotely experts in A.I. your opinion is fairly odd.

    2. Re:Funny, that spin... by reve_etrange · · Score: 4, Insightful

      the opinion of people like Stephen Hawking, Bill Gates and Elon Musk

      I disagree with the premise, that fame is more important than domain-specific expertise.

      --
      .: Semper Absurda :.
    3. Re:Funny, that spin... by hey! · · Score: 4, Insightful

      Spin, sure, but it's a waay bigger minority than I expected. I'd even say even shockingly large.

      The genius of Asimov's three laws is that he started by laying out rules that on the face of it rule out the old "robot run amok" stories. He then would write, if not a "run amok" story, one where the implications aren't what you'd expect. I think the implications of an AI that surpasses natural human intelligence are beyond human intelligence to predict, even if we attempt to build strict rules into that AI.

      One thing I do believe is that such a development would fundamentally alter human society, provided that the AI was comparably versatile to human intelligence. It's no big deal if an AI is smarter than people at chess; if it's smarter than people at everyday things, plus engineering, business, art and literature, then people will have to reassess the value of human life. Or maybe ask the AI what would give their lives meaning.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    4. Re:Funny, that spin... by TapeCutter · · Score: 4, Insightful

      Asimov's three laws are a metaphor that says you can't codify morality, AI is the vehicle he used to make that point.

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
    5. Re:Funny, that spin... by Shoten · · Score: 5, Insightful

      In light of the fact that Stephen Hawking, Bill Gates and Elon Musk are not even remotely experts in A.I. your opinion is fairly odd.

      Question: What role do people who think that AI research is dangerous hold in the field of AI research?

      Answer: None...because regardless of their qualifications, they wouldn't further the progress of something they think is a very, very bad idea.

      Asking AI experts whether or not they think AI research is a bad idea subjects your responses to a massive selection bias. And discounting the views of others because they don't specialize in creating the thing they think should not be created does the same. You do realize that at your core, that's your only point...not that Hawking is an idiot, or that Gates doesn't know anything about technology. It's just that they don't work in the field of AI, so therefore they must not have any inkling whatsoever as to what they're talking about.

      --

      For your security, this post has been encrypted with ROT-13, twice.
  2. The Sony connection by AchilleTalon · · Score: 4, Insightful

    "The Sony hacking incident last year was ample demonstration that our information systems are becoming more and more vulnerable, which is a feature, not a bug, of the increasing transfer of our infrastructure into digital space."

    Sorry guys, I can't stop laughing. This writer is a clown. The Sony incident demonstrates Sony is incompetent. It was never a threat against the humanity, only against the gang of fat butts at Sony Pictures.

    --
    Achille Talon
    Hop!
  3. Missing the key point by Giant+Electronic+Bra · · Score: 4, Insightful

    Everyone is missing the key thing here. The question asked was "if a machine superintelligence did emerge", which is like asking "if the LHC produced a black hole..." There's nobody credible in AI who believes we have the slightest clue how to build a general AI, let alone one that is 'superintelligent'. Since we lack even basic concepts about how intelligence actually works we're like stone age man worrying about the atomic bomb. Sure, if a superintelligent AI emerged we might be in trouble, but nobody is trying to make one, nobody knows how to make one, nobody has any hardware that there is any reason to believe is within several orders of magnitude of being able to run one, etc.

    So, what all of these people are talking about is something hugely speculative that is utterly disconnected from the sort of 'machine intelligence' that we ARE working on. There are several forms of what might fall into this category (there's really no precise definition), but none of them are really even close to being about generalized intelligence. The closest might be multi-purpose machine-learning and reasoning systems like 'Watson', but if you actually look at what their capabilities are, they're about as intelligent as a flatworm, hardly anything to be concerned about. Nor do they contain any of the sort of capabilities that living systems do. They don't have intention, they don't form goals, or pose problems for themselves. They don't have even a representation of the existence of their own minds. They literally cannot even think about themselves or reason about themselves because they don't even know they exist. Beyond that we are so far from knowing how to add that capability that we know nothing about how to do so, zero, nothing.

    The final analysis is that what these people are being asked about is virtually a fantasy. They might as well be commenting on an alien invasion. This is something that probably won't ever come to pass at all, and if it does it will be long past our time. Its fun to think about, but the alarmism is ridiculous. In fact I don't see anything in the article that even implies any of the AI experts think its LIKELY that a superintelligent AI will ever exist, it was simply posited as a given in the question.

    --
    "Malo periculosam, libertatem quam quietam servitutem." -- Jefferson