Slashdot Mirror


Stephen Hawking Warns That AI and 'Superhumans' Could Wipe Humanity; Says There's No God in Posthumous Book (cnn.com)

Stephen Hawking says artificial intelligence will eventually become so advanced it will "outperform humans." The renowned physicist who died in March warns of both rises in advanced artificial intelligence and genetically-enhanced "superhumans" in a book published Tuesday. Hawking also weighed in on god, and aliens. From a report: According to an excerpt of the book "Brief Answers to the Big Questions" published by the U.K.'s Sunday Times, Hawking wrote AI could prove "huge" to humanity so long as restrictions are in place to control how quickly it grows. "While primitive forms of artificial intelligence developed so far have proved very useful, I fear the consequences of creating something that can match or surpass humans," Hawking wrote. "Humans, who are limited by slow biological evolution, couldn't compete and would be superseded." Hawking wrote about a need for serious research to explore what impact AI would have on humanity, from the workplace to the military, where he expressed concerns about sophisticated weapons systems "that can choose and eliminate their own targets." Hawking also wrote about advances to manipulating DNA, or what he calls "self-designed evolution. Early advances involving the gene-editing tool CRISPR include alerting DNA to create "low-fat" pigs. CNN: "There is no God. No one directs the universe," he writes in "Brief Answers to the Big Questions." "For centuries, it was believed that disabled people like me were living under a curse that was inflicted by God," he adds. "I prefer to think that everything can be explained another way, by the laws of nature."

"There are forms of intelligent life out there," he writes. "We need to be wary of answering back until we have developed a bit further." And he leaves open the possibility of other phenomena. "Travel back in time can't be ruled out according to our present understanding," he says. He also predicts that "within the next hundred years we will be able to travel to anywhere in the Solar System."

14 of 733 comments (clear)

  1. No such thing as true artificial intelligence by Anonymous Coward · · Score: 4, Insightful

    The simple fact is we've made some crude machine learning algorithms that can be trained but this is not true intelligence, that can make intuitive leaps and predictions about things it has never experienced based on first principles. We are nowhere near being able to create something like that. We may never be able to do that.

    1. Re:No such thing as true artificial intelligence by Drethon · · Score: 5, Interesting

      The danger is there regardless of how "sentient" it actually becomes. In fact isn't it more dangerous the less sentient but more "powerful" or ubiquitous we thoughtless allow it to become, meanwhile?

      You mean like the same danger with putting any automated software in charge of a critical function? https://www.flightglobal.com/n...

      This wouldn't be anything special about AI, or Machine Learning or even software. Any process that isn't properly vetted can lead to people getting killed, such as mismanaged dams that broke. People somehow think that AI will be more powerful but it isn't about the power of the tool but about the criticality of the application is it allowed to automate without oversight. See DO-178b software levels as an example of how this is handled: https://en.wikipedia.org/wiki/...

  2. Re:Stephan Hawking was not ... by Tablizer · · Score: 5, Funny

    Stephen's thoughts on these matters are as useless as tits on a boar.

    Don't knock them until you try them.

    - LonelySlashdotter

  3. We already have the societal problems by bradley13 · · Score: 5, Interesting

    ...gene-editing technology will be used to correct genes leading to diseases like cystic fibrosis, but people won't resist using the technology to make them stronger or smarter. "Once such superhumans appear, there are going to be significant political problems with the unimproved humans, "

    True enough, and absolutely inevitable. First, you correct for genetic defects, then you choose features you want. Why wouldn't parents prefer a healthy, attractive, intelligent, athletic child over one lacking those attributes?

    We already have the societal problems. As the saying goes: "Think of how stupid the average person is, and realize half of them are stupider than that." Even if we raise the averages, the problems remain essentially the same. What do we do now, with the ineducable and unskilled? We don't currently have any good solution...

    Meanwhile, imagine the potential* benefits to society, if we could increase average health, and raise the average intelligence by a standard deviation or two.

    *Potential. It is also entirely believable that the people who take most advantage of this will - intentionally or otherwise - select for sociopathy or other deleterious traits.

    --
    Enjoy life! This is not a dress rehearsal.
  4. We already have a solution by rsilvergun · · Score: 5, Insightful

    Birth Control + Bread and Circuses and they stop breeding enough to sustain their population. This is what's happening in every first world country. Even the US with it's Evangelicals can't keep it's birthrate above 2.0. As for "below average", good enough is always good enough. You just need people smart enough that they don't fall for demagogues and mumbo-jumbo. That's not a very high bar, and we can do it now with some more education (yes, that means the liberal arts education that /.ers hate. If you're not smart enough for a STEM degree that's the next best way to tech critical thinking)

    When people have options they don't breed uncontrollably. We're not animals. We're people. In the future the problem is likely to be under population. That is, unless we let the Evangelicals take control. Then they'll ban birth control and sex ed based on a few well chosen passages in their holy books.

    What this all means is progressivism vs conservatism. e.g. we need to get folks to favor progress and improvement and stop looking back wistfully at the "good 'ole days". That does mean you're gonna have to take care of some folks who are now obsolete (like coal minors) and get over the fact that they get paid to do nothing because there's no useful work they can do anymore. Another thing folks hate because it pisses people off to have to get up to go to work when somebody else doesn't.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  5. Um, not really by rickb928 · · Score: 4, Insightful

    "For centuries, it was believed that disabled people like me were living under a curse that was inflicted by God,"

    From John 9:2:

    And his disciples asked him, “Rabbi, who sinned, this man or his parents, that he was born blind?”

    Jesus answered, “It was not that this man sinned, or his parents, but that the works of God might be displayed in him."

    And Stephen Hawking has surely increased our understanding of the Universe.

    I suppose it's all in how carefully you read the text, for many books, many authors, many stories are misunderstood.

    --
    deleting the extra space after periods so i can stay relevant, yeah.
  6. Re:Atheism is pessimism by Camel+Pilot · · Score: 4, Interesting

    Ironically, from theology came medical care. Without God, the law survival of the fittest is taken to its most extreme interpretation, and there are no cripples, not for long anyway, until they are sacrificed or abandoned as unwanteds.

    Medical care is sourced in empathy - a common trait in humans.

    Many religions and ideas of God interpret the sick and disadvantage of being cursed by God as noted in the summary above. For example, the The Hindu's have their caste system and the Christians a notion of the "elect" and "reprobates".

  7. Re:Stephan Hawking was not ... by kilfarsnar · · Score: 5, Insightful

    Being an atheist is an evidence-based worldview. This obviously isn't your wheelhouse either, and nobody has perfected AI or even come anywhere close. Thanks for your boar tits though, tasty.

    Being Agnostic is an evidence-based world view. You cannot prove a negative and therefore cannot prove that god does not exist. The most science has to say about god is that there is no scientific evidence for its existence. There also used to be no evidence for germs or atoms. The best we can say is that we don't know.

    Whether or not we are living in a simulation is a hot topic today. If we are, it implies that there is a reality outside our own, and beings that inhabit it to run the simulation. Perhaps when we die here, we exit the simulation and re-enter the other reality. Well, does that sound familiar?

    I'm not saying the God of the Bible is necessarily real or described accurately in that book. I am saying that foreclosing the possibility of a greater, unseen intelligence or consciousness existing outside of, or in concert with, our observed reality is not scientific.

    --
    "What the American public doesn't know is what makes them the American public." -Ray Zalinsky (Tommy Boy)
  8. Your god vs my god vs his god by Anonymous Coward · · Score: 5, Interesting

    Nobody has conclusive information on the existence or nature of a god or gods.

    Any time someone tries to point out that they have a belief in God, the correct response is "yea, right. Whatever you loon". A more polite response is "that's nice, good for you" and carefully skirt around the subject. Because religious people are sometimes dangerously unstable.

    The safest course is to act as if there is no god, until you have information about the nature of such god(s). Right now there is nothing in the material world that needs god to explain it. Sometimes we don't understand something, but time and time again we've puzzled out some understanding of natural laws of the Universe.

    You should believe in God once you can establish a practical purpose to such a belief. If that believe enables you to build skyscrapers, harvest crops, whatever.

    Abrahamic religion is preposterous though. The insist on monotheism (one true God). But all of them have lots of extra supernatural beings. The issue is, we have no physical evidence of any of them.

    We can just barely detect some very elusive classes of sub-atomic particles. But multiple people can run the experiments and confirm they exist.

    Beings that come down and talk to people throughout the ages, providing different stories to different "prophets" so that we fight over which story is the right one? That doesn't seem just or all powerful or even sane. If there is a God, we'd have less strife in the world if never talked to us than whatever he/she/it does today giving conflicting stories. (sorry, but man is evil enough without having to invent a Satan to place the blame)

    P.S. I'm going to hell. Assuming Christians or Muslims are right. Which is reasonable if reality were a democracy that we can all vote on.

  9. Re:I'm pretty sure he believes in God now... alas. by nitehawk214 · · Score: 4, Insightful

    So, which of the thousands of gods will you put your wager on?

    --
    I'm a good cook. I'm a fantastic eater. - Steven Brust
  10. From 1994 Macworld Boston Keynote by bill.pev · · Score: 5, Interesting

    Hawking gave the 1994 MacWorld Boston keynote from his chair. It lasted about an hour. The room had about 5000 people shuffling papers and coughing.. until about 30 min in, and then, for 30 min you could hear a pin drop. I have tried to get a copy (better still, a recording) of that address, even writing a few of his 6 assistants, Apple PR, and the organizers of MacWorld a bunch of different times. No joy.

    He compared the genome and the information in the genome to the global library of knowledge and then 30 min in said it was inevitable that 1. We will mess with the genome and create a super-race of humans that will make current humanity puny and incapable in comparison (while he sat motionless in his chair) and 2. artificial intelligence will hasten this outcome. He said these were not inevitable because of human frailty, but because that is the whole nature of adaptation and evolution. We would do it because that would speed up adaptation to a rapidly changing world, and because we can. He ended with a statement along the lines of: Get Ready.

    A pin drop. It was electric. I haven't read his book, but it sounds like something along the same lines. If anybody has a recording of the 1994 Macworld adress, please let me know! I know it was recorded. It was a top five memorable speech of my life. I'm 58.

  11. Re:Stephan Hawking was not ... by Megol · · Score: 4, Insightful

    Agnostics are Atheists and more common in places where the word Atheist is seen as something negative.
    Do you believe in a god or gods? Then you aren't an atheist.
    Do you believe gods don't exist? Then you are an atheist.
    Do you believe gods may exist but don't believe in one? Then you are an atheist of the agnostic kind.

    I can't prove that the world didn't start existing the moment I posted this. But believing that it is possible would be of no use - so I simply say I don't believe in it.

  12. Re:I'm pretty sure he believes in God now... alas. by RatBastard · · Score: 5, Insightful

    Good old Pascal's Wager, an act of craven cowardice and an insult to God Almighty. Pascal's Wager is predicated on God being so stupid that He can't tell you're going through the motions out of fear and that you don't actually have faith. I'm sorry, but if God does exist, I'm not going to stand in front of him as a liar and insult Him to His face. And as for "what will you say to God?", there is nothing I can say, no case to plead, nothing to explain because God knows all. He (if He exists) knows why I didn't believe in Him. I will either burn or not, but I will do it with a clean conscience.

    --
    Boobies never hurt anyone. - Sherry Glaser.
  13. Re:The Terminators will take out the leftover supe by HeckRuler · · Score: 5, Interesting

    Well first off, megacorps are the secondary antagonists of both the Terminator and Aliens franchise. They're why the monsters ran amok if the first place.

    But we don't need crazy aliens or future tech to step into the Shadowrun setting. We're essentially already there.

    • The fact that everyone has a cell phone might seem old-hat, but it's technically one of those "cyberpunk" things from the 80's.
    • Shadowrun's PAN is coming into being. People's watches are talking with their phones. And their phones are talking to speakers. Phone-banking is a thing. I wish we had better bluetooth mouse/keyboard and an HDMI dock. There's no real reason people need to be restricted to thumbs and 3" screens.
    • Smartlink is a real thing. Auto-aim. TrackingPoint.
    • The whole "Internet of Compromised Things" is straight out of a bad shadowrun game. "Yeah sure, you can Compromise a Casino's High-Roller Database Through their Thermometer in the Lobby Fish Tank. That sound reasonable in shadowrun, why not?"
    • "Annual sex robot convention is axed from London's Goldsmiths university over fears it would provoke a terror attack by Muslim extreamists. " is another real news article headline.
    • Meltdown and Spectre as a whole new class of vulnerability. And old bugs like heartBleed. Like, welcome to the world "where everything can be hacked".
    • China's social credit score is dystopian as all get out.
    • The cable leaks showed us that the US foreign affairs is in the pocket of large corporations.
    • Have you seen that video of the ball-room dancer with cyberlegs?
    • Or the mind-controlled prosthetic hands?
    • They've even given some people cyber-eyes. Literal eye-replacements that connect to their brain. (Spoiler, it degrades over time)
    • Hell, body scanners at airports (and now subways) are a thing.
    • "Police Use Fitbit Data To Charge 90-Year-Old Man In Stepdaughter's Killing" Read that again and realize that fit-bits are essentially health monitors. Now we just need a docWagon contract.
    • There's a good argument that World of Warcraft and Minecraft were virtual reality worlds that consumed people for a little while. I dunno, I lost friends for like 5 years due to "raid night"
    • Gene therapy is a real thing.
    • Every maker-space/hacker-space I've ever been to has been straight out of a cyberpunk novel.
    • That quad-copter drones are even a thing. That they're sub-$50 toys in walmart is cyberpunk as fuck.
    • There are people that get undercuts ironically. I think pink mohawks have been a thing for a while, but this just kind of fashion coming up to speed with the fiction.