Slashdot Mirror


Hawking: AI Could Be 'Worst Event in the History of Our Civilization' (usatoday.com)

An anonymous reader shares a USA Today report: Elon Musk isn't the only high-profile figure concerned about the rise of artificial intelligence. Scientist Stephen Hawking warned AI could serve as the "worst event in the history of our civilization" unless humanity is prepared for its possible risks. Hawking made the remarks during the opening night of the Web Summit in Lisbon, Portugal. Hawking expects AI to transform every part of our lives, with the potential to undo damage done to the Earth and cure diseases. However, Hawking said AI could also spur the creation of powerful autonomous weapons of terror that could be used as a tool "by the few to oppress the many." "Success in creating effective AI could be the biggest event in the history of our civilization, or the worst," he said. Hawking called for more research in AI on how to best use the technology, as well as implored scientists to think about AI's impact. "Perhaps we should all stop for a moment and focus our thinking on not only making AI more capable and successful, but maximizing its societal benefit," he said.

10 of 243 comments (clear)

  1. Fear mongering by Anonymous Coward · · Score: 4, Informative

    AI is nowhere near an existential threat, so let's just stop it. AI is useful but very primitive when considering what could actually pose a threat. Please stop.

    The main threat is developing AI and data mining operations to interpret large amounts of data and build profiles of all of us. It's a privacy issue, and one we are capable of solving by mandating that our privacy is respected. While I'm not confident we'll actually do so, it is definitely in our control.

    1. Re:Fear mongering by Dutchmaan · · Score: 5, Insightful

      AI is improving every day, it far exceeds human capabiltiy at recognizing patterns and responding to them. When you watch what's happening with video games and how AI is beginning to trounce even the best players you can see how even in it's infancy AI needs to be treated with the same caution as you would a dangerous virus. Once the genie is out of the bottle it will be too late to discuss it.

    2. Re:Fear mongering by hey! · · Score: 5, Interesting

      Like most calamities, it's not an existential threat to the species, but it is an existential threat to populations within the species. And it is potentially a long term threat the underlying assumptions on which our civilization rests.

      One of the important things about learning from past experience is understanding the predictive limitations of past experiences. In past technological developments we've been talking about massive productivity improvements. The assumption that there would be no more work stemmed from assuming that the standards of living would remain the same. That assumption was wrong; the average household has as many possessions today as a prince would have had two hundred years ago.

      But AI poses a distinctly different possibilty: that in the upcoming decades machines may be able to replace people, not just augment them. This could lead to a version of capitalism that entails very rigid hereditary class distinctions; if you have no capital you may find yourself with no means to obtain it because your labor is now worthless.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    3. Re:Fear mongering by Oswald+McWeany · · Score: 4, Insightful

      With the speed of computers, I'm afraid it will be too late before we even realize the genie is out of the bottle.

      There doesn't even need to be a malevolent AI to take over humanity. It could be a benevolent takeover that is prompted by people.

      Forget science fiction movies and books; there doesn't need to be a revolution where an AI is more intelligent than us and we realize too late. It could happen slowly step by step.

      To be effective in the stock market now you have to have certain computer led decisions. That might not be true AI yet, but a computer can respond to news faster than a human. All the major traders use computer made decisions now. So, there is one industry where computers are already prominent. What if it happens in other industries over time (it is... and we're gladly and willingly turning over control).

      What if we decide computers, or AI can control the economy better than a human. If one country does it and it proves to be successful, others will have to do it to keep up. What if AI can handle trials better than a jury. What if AI can produce better military strategies.

      There doesn't have to be an revolution; AI will evolve to take over humanity with us willingly handing it the reigns. Probably won't happen in our lifetime, but the slow transfer of power has already begun. Right now humans can override computer decisions, but that will eventually disappear when AI is less flawed than people and we realize a human overriding it is usually wrong.

      AI will one day rule and control humanity- and we WILL give it that power over us willingly.

      --
      "That's the way to do it" - Punch
    4. Re:Fear mongering by alvinrod · · Score: 4, Insightful

      It's not xkcd, but it seems obligatory.

  2. The real danger of so-called 'AI': by Anonymous Coward · · Score: 4, Insightful

    The real danger from what we're erroneously calling 'AI' right now, is that it's a dead-end approach that will never reach the potential we want it to. It will always fall short because it's not real Artificial Intelligence, not any more than a vegan cheeseburger is a real cheeseburger; it's imitation AI, ersatz, not the real thing at all. None of what is being produced right now can actually think, 'learning algorithms' and 'expert systems' are not true minds, your dog is smarter and more capable of actual cognition than even the best of these machines are. So what will happen is too much trust will be put into them for critical and/or dangerous things, and they will inevitably screw up in spectacular and disasterous ways -- because they cannot think. In order to have true, real AI, we need to understand how an actual brain accomplishes the things it does -- and we're nowhere near understanding that. Maybe in a hundred years, maybe never. In the meantime these over-hyped half-baked excuses for 'AI' need to not be put in charge of anything that could cause disasters or loss of human life.

  3. Re:He wishes... by DontBeAMoran · · Score: 5, Interesting

    Hawking has crossed the Shockley/Chomsky line. He is now talking out of his ass about things he knows nothing about.

    So you're saying he's incapable of learning anything that's not related to theoretical physics and cosmology? Don't forget the amount of time he can dedicate to search and think about a problem. After all, he became Director of Research at the Centre for Theoretical Cosmology within the University of Cambridge by sitting on his ass all day long, literally.

    --
    #DeleteFacebook
  4. People forget... by wjcofkc · · Score: 5, Interesting

    No one ever said AI has to be sentient or represent some facsimile of what we consider intelligent to be very real. This does not make it less of a potential threat. Even a single celled organism is capable of responding to it's immediate environment for survival. Bacteria behave in intelligent ways and can kill a person in doing so with quickness. Intelligence does not have to equal consciousness. Nature clearly demonstrates awareness is more complicated - even if in being less so - than our human sensibilities care to deal with. For that matter we don't even know what consciousness really even is. So we can't use it as a litmus test. People say it can never be done because they cannot accept the possibility of a true AI in a way that does not offend their fragile sensibilities of what intelligence means. Let's take the anthropomorphic out of this discussion and start over.

    --
    Brought to you by Carl's Junior.
  5. Re:AI doesn't exist yet, and may NEVER exist by quantaman · · Score: 4, Insightful

    Everything that is labeled "AI"...isn't.

    We don't have computers that can think yet. We just don't. We aren't even CLOSE, and it may not be possible at all.

    Hawking doesn't know what he's talking about. Neither does the media.

    Alternately, we might be less than 10 years away. We don't really know how far off we are or what the dangers are because we don't know what a strong general AI will really look like.

    Talking about the dangers of string AI now is a bit like talking about super-weapons in 1920. Sure they saw how science + warfare could increase destructiveness, but there's no more reason they should have anticipated Nukes in 20-30 years in 1920 than 1820.

    --
    I stole this Sig
  6. Re:He wishes... by William+Baric · · Score: 4, Informative

    Hawking doesn't present any real argument to support his point of view, he just makes wild hypotheses. So he obviously didn't think too much about it.