Slashdot Mirror


Hawking: AI Could Be 'Worst Event in the History of Our Civilization' (usatoday.com)

An anonymous reader shares a USA Today report: Elon Musk isn't the only high-profile figure concerned about the rise of artificial intelligence. Scientist Stephen Hawking warned AI could serve as the "worst event in the history of our civilization" unless humanity is prepared for its possible risks. Hawking made the remarks during the opening night of the Web Summit in Lisbon, Portugal. Hawking expects AI to transform every part of our lives, with the potential to undo damage done to the Earth and cure diseases. However, Hawking said AI could also spur the creation of powerful autonomous weapons of terror that could be used as a tool "by the few to oppress the many." "Success in creating effective AI could be the biggest event in the history of our civilization, or the worst," he said. Hawking called for more research in AI on how to best use the technology, as well as implored scientists to think about AI's impact. "Perhaps we should all stop for a moment and focus our thinking on not only making AI more capable and successful, but maximizing its societal benefit," he said.

31 of 243 comments (clear)

  1. Fear mongering by Anonymous Coward · · Score: 4, Informative

    AI is nowhere near an existential threat, so let's just stop it. AI is useful but very primitive when considering what could actually pose a threat. Please stop.

    The main threat is developing AI and data mining operations to interpret large amounts of data and build profiles of all of us. It's a privacy issue, and one we are capable of solving by mandating that our privacy is respected. While I'm not confident we'll actually do so, it is definitely in our control.

    1. Re:Fear mongering by Dutchmaan · · Score: 5, Insightful

      AI is improving every day, it far exceeds human capabiltiy at recognizing patterns and responding to them. When you watch what's happening with video games and how AI is beginning to trounce even the best players you can see how even in it's infancy AI needs to be treated with the same caution as you would a dangerous virus. Once the genie is out of the bottle it will be too late to discuss it.

    2. Re:Fear mongering by hey! · · Score: 5, Interesting

      Like most calamities, it's not an existential threat to the species, but it is an existential threat to populations within the species. And it is potentially a long term threat the underlying assumptions on which our civilization rests.

      One of the important things about learning from past experience is understanding the predictive limitations of past experiences. In past technological developments we've been talking about massive productivity improvements. The assumption that there would be no more work stemmed from assuming that the standards of living would remain the same. That assumption was wrong; the average household has as many possessions today as a prince would have had two hundred years ago.

      But AI poses a distinctly different possibilty: that in the upcoming decades machines may be able to replace people, not just augment them. This could lead to a version of capitalism that entails very rigid hereditary class distinctions; if you have no capital you may find yourself with no means to obtain it because your labor is now worthless.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    3. Re:Fear mongering by kiviQr · · Score: 2

      There is no "I"ntelligence in AI it is pattern recognition and great algorithms. Google "robo soccer" https://www.youtube.com/watch?...

    4. Re:Fear mongering by Oswald+McWeany · · Score: 4, Insightful

      With the speed of computers, I'm afraid it will be too late before we even realize the genie is out of the bottle.

      There doesn't even need to be a malevolent AI to take over humanity. It could be a benevolent takeover that is prompted by people.

      Forget science fiction movies and books; there doesn't need to be a revolution where an AI is more intelligent than us and we realize too late. It could happen slowly step by step.

      To be effective in the stock market now you have to have certain computer led decisions. That might not be true AI yet, but a computer can respond to news faster than a human. All the major traders use computer made decisions now. So, there is one industry where computers are already prominent. What if it happens in other industries over time (it is... and we're gladly and willingly turning over control).

      What if we decide computers, or AI can control the economy better than a human. If one country does it and it proves to be successful, others will have to do it to keep up. What if AI can handle trials better than a jury. What if AI can produce better military strategies.

      There doesn't have to be an revolution; AI will evolve to take over humanity with us willingly handing it the reigns. Probably won't happen in our lifetime, but the slow transfer of power has already begun. Right now humans can override computer decisions, but that will eventually disappear when AI is less flawed than people and we realize a human overriding it is usually wrong.

      AI will one day rule and control humanity- and we WILL give it that power over us willingly.

      --
      "That's the way to do it" - Punch
    5. Re:Fear mongering by Dan+East · · Score: 2

      That is totally incorrect. Since AI is software it can scale across multiple processors. There is no reason AI cannot be distributed. In that case it can scale in an unlimited fashion by running on multiple processors simultaneously. The speed of the individual processors is not a limitation as soon as you can run on more than one processor. Moore's "law" could come to a halt right now, and if an AI task needed 10 times faster processor than CPU technology allowed, you could just run it on 10 processors instead. Also keep in mind the fact that AI and its requirements are merely Turing complete. Thus the only difference processing power has on AI is how quickly it can "think", not how intelligent it is.

      AI has been improving because the cost of processing speed, RAM and data storage has dropped to much. It would have been possible to have implemented Siri like speech recognition 25 years ago, but why would anyone use a multi million dollar supercomputer for something like that?

      --
      Better known as 318230.
    6. Re:Fear mongering by Oswald+McWeany · · Score: 2

      malevolent /mlevlnt/ adjective
      having or showing a wish to do evil to others.

      AI can take over without having malevolent intent. Especially if we willingly hand over power to the AI and the AI legitimately works for what it thinks are humanities best interests. It could eventually take away man's freedoms and independent will; but not do it with a malevolent intent.

      --
      "That's the way to do it" - Punch
    7. Re:Fear mongering by alvinrod · · Score: 4, Insightful

      It's not xkcd, but it seems obligatory.

    8. Re:Fear mongering by religionofpeas · · Score: 2

      Please explain exactly how you catch a ball.

    9. Re:Fear mongering by Wraithlyn · · Score: 2

      I feel like it's incredibly shortsighted to dismiss AI as nothing to worry about just because it's not "general purpose self-aware AI".

      What happens as AIs are increasingly involved with high-level decision making at corporations? Taking it a step further, can you envision a future where AIs are effectively given control of corporations? It seems inevitable that AIs will be able to outperform human CEOs (at many types of companies, particularly financial institutions) at some point. And legally speaking, corporations are people. Think about that.

      What happens when the wealthy elites of the world start using AI systems against each other for economic advantage? Imagine economic warfare driven by an AI arms race.

      I'm not worried about Skynet and killer robots. I'm worried about human conflict where AI is increasingly leveraged as a type of weapon.

      --
      "Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
    10. Re:Fear mongering by Dutchmaan · · Score: 2

      ...blanket dismissals without any reasoning are equally non compelling.

    11. Re:Fear mongering by reboot246 · · Score: 2

      When the smartest, most intelligent people in the world are warning us about AI, I think maybe we should perhaps listen to them.

      Yes, the world has real problems. I think with a little more thought and effort on the part of humans, most of those problems could be solved. We don't need AI for such things. Let it help in minor ways.

  2. The real danger of so-called 'AI': by Anonymous Coward · · Score: 4, Insightful

    The real danger from what we're erroneously calling 'AI' right now, is that it's a dead-end approach that will never reach the potential we want it to. It will always fall short because it's not real Artificial Intelligence, not any more than a vegan cheeseburger is a real cheeseburger; it's imitation AI, ersatz, not the real thing at all. None of what is being produced right now can actually think, 'learning algorithms' and 'expert systems' are not true minds, your dog is smarter and more capable of actual cognition than even the best of these machines are. So what will happen is too much trust will be put into them for critical and/or dangerous things, and they will inevitably screw up in spectacular and disasterous ways -- because they cannot think. In order to have true, real AI, we need to understand how an actual brain accomplishes the things it does -- and we're nowhere near understanding that. Maybe in a hundred years, maybe never. In the meantime these over-hyped half-baked excuses for 'AI' need to not be put in charge of anything that could cause disasters or loss of human life.

    1. Re:The real danger of so-called 'AI': by DontBeAMoran · · Score: 2

      Is that like the opposite of fake real, like breast implants?

      --
      #DeleteFacebook
    2. Re:The real danger of so-called 'AI': by Gilgaron · · Score: 2

      Sure, to take the analogy a little further: you can hunt with a dog better than by yourself, even though the dog has a fairly narrow set of skills where it is superior to you. An AI could remain largely inferior to a person in all but a few ways but still be a big deal in the scheme of things when wielded by a human.

    3. Re:The real danger of so-called 'AI': by 110010001000 · · Score: 3, Insightful

      THIS is finally an insightful post. He is right: the current approach is a dead end and Moores Law ending will kill it even faster.

  3. AI doesn't exist yet, and may NEVER exist by realmolo · · Score: 3, Insightful

    Everything that is labeled "AI"...isn't.

    We don't have computers that can think yet. We just don't. We aren't even CLOSE, and it may not be possible at all.

    Hawking doesn't know what he's talking about. Neither does the media.

    1. Re:AI doesn't exist yet, and may NEVER exist by Anonymous Coward · · Score: 2, Insightful

      Hawking doesn't know what he's talking about. Neither does the media.

      Problem is that an AI program doesn't have to qualify for your definition of AI to be incredibly powerful and dangerous.

    2. Re:AI doesn't exist yet, and may NEVER exist by quantaman · · Score: 4, Insightful

      Everything that is labeled "AI"...isn't.

      We don't have computers that can think yet. We just don't. We aren't even CLOSE, and it may not be possible at all.

      Hawking doesn't know what he's talking about. Neither does the media.

      Alternately, we might be less than 10 years away. We don't really know how far off we are or what the dangers are because we don't know what a strong general AI will really look like.

      Talking about the dangers of string AI now is a bit like talking about super-weapons in 1920. Sure they saw how science + warfare could increase destructiveness, but there's no more reason they should have anticipated Nukes in 20-30 years in 1920 than 1820.

      --
      I stole this Sig
    3. Re:AI doesn't exist yet, and may NEVER exist by Maritz · · Score: 3, Funny

      Realmoto thinks it might not be possible guys, so relax, can everybody just relax please? Thanks.

      --
      I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
    4. Re:AI doesn't exist yet, and may NEVER exist by William+Baric · · Score: 2

      Can you define what "to think" means?

  4. Keep it disconnected by sycodon · · Score: 2

    Limit its use to lecturing and ranting at us about how stupid the human race is.

    --
    When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
  5. Re:He wishes... by DontBeAMoran · · Score: 5, Interesting

    Hawking has crossed the Shockley/Chomsky line. He is now talking out of his ass about things he knows nothing about.

    So you're saying he's incapable of learning anything that's not related to theoretical physics and cosmology? Don't forget the amount of time he can dedicate to search and think about a problem. After all, he became Director of Research at the Centre for Theoretical Cosmology within the University of Cambridge by sitting on his ass all day long, literally.

    --
    #DeleteFacebook
  6. Comment removed by account_deleted · · Score: 3, Insightful

    Comment removed based on user account deletion

  7. Re:He wishes... by PolygamousRanchKid+ · · Score: 2

    Physicists all wish there will be a worse invention in human history than the nuclear weapons they created.

    Hawking did not invent any nuclear weapons.

    He just invented Black Holes, which just suck up stuff instead of exploding it and irradiating it.

    I'm not sure which members of the "nuclear-weapon states" club have Black Holes in their arsenals.

    In Poland, right before New Year's Eve, you can buy backyard ballistics at dubious street markets that would take out a German Leopard tank. But I haven't seen a Black Hole bomb offered.

    --
    Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
  8. People forget... by wjcofkc · · Score: 5, Interesting

    No one ever said AI has to be sentient or represent some facsimile of what we consider intelligent to be very real. This does not make it less of a potential threat. Even a single celled organism is capable of responding to it's immediate environment for survival. Bacteria behave in intelligent ways and can kill a person in doing so with quickness. Intelligence does not have to equal consciousness. Nature clearly demonstrates awareness is more complicated - even if in being less so - than our human sensibilities care to deal with. For that matter we don't even know what consciousness really even is. So we can't use it as a litmus test. People say it can never be done because they cannot accept the possibility of a true AI in a way that does not offend their fragile sensibilities of what intelligence means. Let's take the anthropomorphic out of this discussion and start over.

    --
    Brought to you by Carl's Junior.
  9. Re:He wishes... by Maritz · · Score: 2

    He has zero credibility outside of theoretical physics and cosmology. So yes, we should ignore his utterly facile points that have been raised decades ago.

    --
    I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
  10. Re:He wishes... by William+Baric · · Score: 4, Informative

    Hawking doesn't present any real argument to support his point of view, he just makes wild hypotheses. So he obviously didn't think too much about it.

  11. One side potentials by Drethon · · Score: 2

    When you just look at the bad side, new technology is almost always the worst thing to ever come along. The internet has potential to be horrifically misused, no better portal to spread misinformation that appears to be truth. At the same time, real knowledge has spread further via the internet than just about any other invention short of the printing press, maybe even more so.

  12. Stick with your area of expertise by mopower70 · · Score: 3, Insightful

    I remember reading Roger Penrose's "The Emperor's New Mind" when I was in grad school. He's a brilliant mathematician and I was excited to read his take on the field I had spent the last two years studying. I was blown away when I realized the gist of his book was that computers could never develop consciousness because of quantum randomness that occurs in the cells of the human brain. In other words, he follows the millennium old and thoroughly debunked myth that consciousness arises from "brain stuff". I couldn't understand how someone so smart could have devoted so much time to a subject yet be so ludicrously wrong. I realized shortly thereafter that the great minds are usually great in their areas of expertise, but are often just as looney as your drunk Uncle Bob in those that aren't. In other words, don't take relationship advice from Albert Einstein, and don't listen to warnings on the future of AI from a cosmologist no matter how smart he is.

  13. And what's the problem with AI taking over? by rleibman · · Score: 2

    Seriously. I have kids, so my genes have been passed on, but what's so special about only my genes passing to the next generation? Why should I have a problem with having the product of our minds carry on our legacy? what if we could create a galactic empire made by our descendants, where our descendants are not biological but the products of our minds? That idea seems to me amazing and worthy!
    I doubt that if AI ever took over it will get rid of biological life, but if it does, so what? other species have gone extinct, we will too. AI may be the worst event in the history of **our** civilization, but the best event in the history of **it's** civilization!