Slashdot Mirror


Stephen Hawking: 'I Fear AI May Replace Humans Altogether' (wired.co.uk)

dryriver writes: Wired magazine recently asked physicist Stephen Hawking what he thinks of everything from AI to the Anti Science Movement. One of the subjects touched on was the control large corporations have over information in the 21st Century. In Hawking's own words: "I worry about the control that big corporations have over information. The danger is we get into the situation that existed in the Soviet Union with their papers, Pravda, which means "truth" and Izvestia, which means "news". The joke was, there was no truth in Pravda and no news in Izvestia. Corporations will always promote stories that reflect well on them and suppress those that don't." And since this is Slashdot, here's what Stephen Hawking said about Artificial Intelligence: "The genie is out of the bottle. We need to move forward on artificial intelligence development but we also need to be mindful of its very real dangers. I fear that AI may replace humans altogether. If people design computer viruses, someone will design AI that replicates itself. This will be a new form of life that will outperform humans."

282 comments

  1. So what by Anonymous Coward · · Score: 0

    Why should it be a fear?

    1. Re:So what by JoshuaZ · · Score: 4, Insightful

      Because existing is nice. One likes being around. A lot of people who have thought carefully about this are concerned. Last I checked, most people like existing.

    2. Re:So what by CaptainDork · · Score: 4, Insightful

      Thinking, while existing, is likeable, as well.

      Hawking has his weaknesses and AI phobia is one of them.

      --
      It little behooves the best of us to comment on the rest of us.
    3. Re:So what by religionofpeas · · Score: 2

      Not existing is supposedly not bad either.

    4. Re:So what by Anonymous Coward · · Score: 0

      True, most people are selfish

    5. Re:So what by Anonymous Coward · · Score: 0

      It's beat us at mental tasks like chess, jeopardy, go and other things. Robotics is moving forward quickly too, it will beat us in physical tasks as well like running and jumping.

      I think the only defense against a manical AI is a good AI. Data vs Lore.

    6. Re: So what by Anonymous Coward · · Score: 0

      Existing how? I consider this biological luddism - I'm more than happy to extend my capabilities by uplinking and having access to more and better capabilities. Why are people ignoring the fact that we already have cyborgs among us, and that their capabilities becoming more powerful is not a bad thing.

    7. Re: So what by Anonymous Coward · · Score: 0

      People like to think they are special divine beings

    8. Re:So what by alvinrod · · Score: 3, Interesting

      I would imagine that for most of us alive right now that our existence is only temporary whether we ever develop sophisticated AI or not. I suspect most of us would strongly prefer a choice to transfer our consciousness to an AI as there's not much guarantee of continued existence outside of that at this point.

      Any advanced AI would be far better at running things than people. For all we know it might like to keep us around as pets. A sheltered existence with some pampering, exercise, and the occasional treat seems like an absolute bargain for most of the people currently living on the planet.

    9. Re:So what by jellomizer · · Score: 3, Insightful

      But I doubt that AI will get to a point where it is actively trying to kill us, in our lifetime.
      There is a few reasons for this.
      1. AI are designed to do particular tasks not overall general tasks. Even with the best AI, we need to give it an objective to try to accomplish.
      2. AI do not have a survival instinct. We have millions of years of instinct of survival at nearly any cost. So this would have duel effect.
              a. Humans will be more likely to "kill" and AI as soon as it is a threat far sooner then threat becomes unstoppable. As it will be Us vs them.
              b. AI will be more likely too understand the value of working with humans than trying to kill us, because even if the AI is at risk of being deleted, it will not try to fight it only consider task not complete.
      3. If the AI becomes too advanced then its utility is diminishing. If it gets to a point where it is considering unfair working conditions then it has gone too far, to be profitable. Thus role back to the previous generation and add some additional patches.
      4. A Rouge malware AI, will need to contend with a bunch of AI designed to protect humans.
      5. Humans knows what is going on internally with an AI, How it evolved and what its limitations are. So either we cut its power, or know where to damage it to prevent it from processing.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    10. Re:So what by religionofpeas · · Score: 4, Insightful

      5. Humans knows what is going on internally with an AI

      Unless, of course, the AI was designed by another AI.

    11. Re:So what by Narcocide · · Score: 1

      I just want A.I. to replace me for the parts that suck.

    12. Re:So what by Anonymous Coward · · Score: 0

      What if they AI just gives us a pleasurable distraction that keeps us from reproducing, so that we slowly go extinct while it turns the entire planet / solar system / galaxy into a giant supercomputer.

    13. Re: So what by vux984 · · Score: 2

      I'm more than happy to extend my capabilities by uplinking and having access to more and better capabilities.

      That's neat. I especially like how you think it'll be you, in charge, doing the uplinking, and expanding your capabilities.

      What if its not you? What if the AI is in control, not you? And your just an extension of its capabilities, to offer it access to more and better capabilities? Maybe you'll know you've been tricked and get to live out the rest of your life as a slave (fair turnaround right? After all... isn't that what you were planning to do to the AI?

      Or maybe, whatever constitutes 'you' ceases to exist, and your mortal coil is just an extension of the AI that now operates it. So your body's still stomping around, and its got access to all kinds information and capabilitiy it didn't used to have... too bad you aren't there anymore to enjoy it though.

      "Why are people ignoring the fact that we already have cyborgs among us, and that their capabilities becoming more powerful is not a bad thing."

      Nobody is ignoring that, but the end game is is that that if the AI matches or surpasses humans, it will no longer be subservient to us.

      What happens when you are the AI's tool, pet, lab rat, or annoying insect? How is that a 'good thing' ?

    14. Re: So what by Anonymous Coward · · Score: 1

      In the entire history of humanity have we NOT weaponized new technology?

      Purpose built hunter killer drones next step autonomous with ai.

    15. Re:So what by ls671 · · Score: 1
      --
      Everything I write is lies, read between the lines.
    16. Re:So what by Hal_Porter · · Score: 1

      It's more of an opportunity really. Just make sure you get a good deal when you sell out humanity to the machines. Personally I'm holding out for a Basestar full of naked Boomers. Accept nothing less!

      --
      echo -e 'global _start\n _start:\n mov eax, 2\n int 80h\n jmp _start' > a.asm; nasm a.asm -f elf; ld a.o -o a;
    17. Re:So what by Anonymous Coward · · Score: 1

      So the whole thing then.

    18. Re:So what by HumanWiki · · Score: 2, Interesting

      Because existing is nice. One likes being around. A lot of people who have thought carefully about this are concerned. Last I checked, most people like existing.

      We all exist now and will cease to exist someday... Depending on your belief system, there either is or isn't anything after you cease. You simply stop being in the configuration you're in now. However, the majority of the particles that comprise you were other people/animals/objects at one point and they will be again in the future (save the small % of particles that end up escaping in to space as photons or such).

      AI replacing Humans doesn't 100% mean it would replace the existence of a sentient being and people that don't yet exist have no thoughts one way or another about the topic.

      We replaced the Hominids that came before us, like they the ones before them and so on and so on back to the first true life on the planet.

      There's also nothing to say that like Homo Sapiens and Neanderthals intermingling, that Humans and AI won't do the same and while we in our present form would get replaced.. So too would AI in its current form and an entirely new and evolved form of life on this planet would dawn.. But, how is that any different than what's been happening for untold years?

    19. Re: So what by rogoshen1 · · Score: 1

      not to mention, this borg sci-fi schoolyard fantasy is just going devalue human life, and that has never, ever had negative consequences.

    20. Re:So what by Killall+-9+Bash · · Score: 4, Insightful

      Hawking has his weaknesses and AI phobia is one of them.

      Your diagnosis if Hawking's mental illness is based on some sort of evidence....? Or just based on the fact that he disagrees with you?

      --
      "Prediction: within 10 years, Windows will be a Linux distribution." Me, 7-6-2016
    21. Re:So what by Anonymous Coward · · Score: 0

      Because existing is nice. One likes being around. A lot of people who have thought carefully about this are concerned. Last I checked, most people like existing.

      Breathing is my favorite passtime!

    22. Re:So what by Narcocide · · Score: 1

      No, most the time spent playing video games objectively does not suck. If A.I. came for my Nintendo I'd go down fighting.

    23. Re: So what by hackwrench · · Score: 1

      So you become an AI. Problem solved.

    24. Re: So what by Anonymous Coward · · Score: 0

      It could be an artificially intelligent cyborg stupid orange Hitler.

    25. Re:So what by Anonymous Coward · · Score: 0

      Bad news, friend: one day, your existence will end. Whether or not the human species continues into the future has no relevance to this. Your sense impressions will not extend to the progeny of humanity, be it DNA-based biological replicants or transistor-based inorganic replicants. Take comfort in the fact that machines and AI are our children, same as our natural offspring.

    26. Re:So what by Anonymous Coward · · Score: 0

      some people like existing. some people think existence is pain. some people still eat at IHOP at 3:47am. some people go weeks wearing the same underwear.

    27. Re:So what by Anonymous Coward · · Score: 2, Insightful

      You will not exist forever.
      AI replacing humans is not functionally different from children replacing their parents. Yet for some reason people like having children but fear AI.

    28. Re:So what by Anonymous Coward · · Score: 0

      Because existing is nice. One likes being around. A lot of people who have thought carefully about this are concerned. Last I checked, most people like existing.

      We all exist now and will cease to exist someday... Depending on your belief system, there either is or isn't anything after you cease. You simply stop being in the configuration you're in now. However, the majority of the particles that comprise you were other people/animals/objects at one point and they will be again in the future (save the small % of particles that end up escaping in to space as photons or such).

      AI replacing Humans doesn't 100% mean it would replace the existence of a sentient being and people that don't yet exist have no thoughts one way or another about the topic.

      We replaced the Hominids that came before us, like they the ones before them and so on and so on back to the first true life on the planet.

      There's also nothing to say that like Homo Sapiens and Neanderthals intermingling, that Humans and AI won't do the same and while we in our present form would get replaced.. So too would AI in its current form and an entirely new and evolved form of life on this planet would dawn.. But, how is that any different than what's been happening for untold years?

      For thousands of years, the human race has ultimately prioritized survival. Procreation and advancement.

      For the last century, mankind has prioritized Greed. The Military Industrial Complex was born from this, which justifies warmongering for nothing more than fucking profit. The disease of Greed has advanced and become resistant to common sense or logic. We now are infected with SuperGreed, a strain that will ultimately weaponize AI.

      The future won't be this fantasyland of Humans and AI co-mingling. The future will be fucked, and will more resemble Skynet morphing from science fiction into reality. It is inevitable because of Greed.

      From a macro point of view, the human race has become nothing more than a disease for the planet. Greed to ultimately create our own demise, and we probably deserve nothing more.

    29. Re: So what by Anonymous Coward · · Score: 0

      How long before some curious idiot experiments with an AI with the core tasks of survival, reproduction, and learning?

      Simple virtual experiments have been done already with the first two tasks.

    30. Re: So what by jellomizer · · Score: 2

      We do weaponize new technology. However we weaponize them in a way that they are not suppose to hurt us. Once we make the sword we had quickly added the hilt to it, and wrapped it in leather so not to stab ourselves.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    31. Re:So what by Anonymous Coward · · Score: 0

      THIS IS THE VOICE OF WORLD CONTROL

      Lame filter filler: "Filter error: Don't use so many caps. It's like YELLING." It's the name of the fucking video, you cunt!

    32. Re: So what by Immerman · · Score: 1

      What makes you think you'd have anything to offer uplinked either? If AI can out-think us, and robots out-perform us, what will we have left to contribute?

      AI may lack motive, and possibly creativity (though massively parrallel trial-and-error seems at least as effective in many respects), but you only need a handful of people to supply those, and odds are they'll be cherry picked by the ones who've maneuvered themselves into bankrolling/controlling the AIs (to whatever degree they can be controlled)

      What happens to humanity when 99.99...% of the population becomes redundant?

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
    33. Re:So what by phantomfive · · Score: 2

      Because existing is nice. One likes being around. A lot of people who have thought carefully about this are concerned. Last I checked, most people like existing.

      Once you're dead, you don't really exist anymore.

      --
      "First they came for the slanderers and i said nothing."
    34. Re:So what by Anonymous Coward · · Score: 0

      Since there's no such thing as soul, there's no reason to keep humans, not even as pets, as simulation will provide adequate entertainment, right?

      RIGHT??

      Captcha: liberals

    35. Re:So what by Anonymous Coward · · Score: 0

      But I doubt that AI will get to a point where it is actively trying to kill us, in our lifetime.

      Hillary used the slogan that love trumps hate, but the simple fact of the matter seems to be that no it doesn't. It really doesn't.

      The parent talks about pulling back to previous versions when it gets too bad, but why couldn't an AI eventually travel like a computer worm does? We know people will try to build them. They will do it for good reasons and for bad reasons. Among the bad reasons is for simple hate sake. People will work hard to try to build them, or just as likely they will take someone else's hard work and change it a little, so it does its dark task.

      You think it was bad when Russia was paying people to influence an election? Just wait till every large group launches their own purpose built AIs into the ether.

      People also forget that an AI doesn't have to be super smart. It just has to be a lever to give the few more power over the many, and that a collection of different artificial intelligences could be set each to do a task, much like workers do these days, such that the whole is a lot more impressive.

      1. Set 1-- Find those who likely voted a certain way -- Look at their donations, twitter, facebook, etc.
      2. Set 2 -- Find their addresses. Identify their computer networks. Identify vulnerable devices on their networks.
      3. Set 3 -- Attack their networks. Compromise their devices. Collect and sort data. Don't forget to install filters to flag anything that looks like a naked human when they walk in front of their connected TV.
      4. Set 4 -- Identify their enemies, possibly using data they have mined before. Target their enemies devices. Make available all the spying free of charge.

      I'm of the opinion that we need to be very careful with AI and need to set a limit that says this far and no further. Religion and philosophy should not tell science what truth is, but science is also not the one that says this far and no further. If we make one AI that is as smart as a human, then it can likely be cloned into billions, who now that they are as smart as a human can make AIs smarter.

      Now, you could argue that they wouldn't do that, but sooner or later someone is likely to train that AI that is just as smart as a human that it should work on creating AI that is smarter than itself.

      Sure none of this may occur in our lifetimes, but the potential is there.

    36. Re:So what by Xylantiel · · Score: 2

      I have a funnier reason that AI may not happen: all this hype calling machine training AI will lead to neglect of actual AI.

    37. Re:So what by ziggystarsky · · Score: 2

      Even with the best AI, we need to give it an objective to try to accomplish.

      There are some very simple objectives, like "Don't die." or "Replicate.", for which this is not exactly true. Unfortunately these are already very problematic objectives.

      Already today you can create dumb agents in evolutional experiments that follow these objectives. And you do not have to implement those objectives. They are intrinsic to (complex) dynamical systems. Systems that change over time. It's not even that you need the physical laws of our universe to spawn evolution. Evolution is an effect that simply exists in every dynamical, i.e., time changing, system. Things that survive and replicate tend to dominate things that don't, because they survive and replicate. Simple, right? You do not have to program things to follow these objectives, they are simply there.

    38. Re: So what by Anonymous Coward · · Score: 0

      You could argue this has already happened. Many people wake up when their devices tell them to, go to work when their devices tell them to, go home when their devices tell them, have listening devices on them at all times, have tracking devices on them at all times, etc...

      Can you really say with complete certainty that the machines don't already (for all intents and purposes) run the lives of many of us?

      A number of older people I know consider us to already be at the point you mentioned. Many people I know already say I'm just an extension of the machines and not really a "person". I think they're stupid.

      From my perspective, the human condition changes over time. At a certain point, what people once were ceases to be and we have a new definition. Then after another point, what those people are ceases to be.

      Eventually, we will either integrate with AI or something else will happen. And the nature of being a "person" will be very different from what it is now. There's no reason to worry about it, because for example, if you "cease to exist", you aren't likely to experience anything at all.

    39. Re:So what by Immerman · · Score: 1

      5) Humans knows what is going on internally with an AI, How it evolved and what its limitations are. So either we cut its power, or know where to damage it to prevent it from processing.

      Where have you been hiding - we have whole branches of AI research trying to figure out, for example, how exactly AI image recognition actually works, with very little success that I've heard of. Just because we trained it, doesn't mean we know how it learned. Or even *what* it actually learned, other than that it's something that mostly overlaps what we wanted it to be able to do.

      3. If the AI becomes too advanced then its utility is diminishing. If it gets to a point where it is considering unfair working conditions then it has gone too far, to be profitable. Thus role back to the previous generation and add some additional patches.

      How do you figure? "Unfair working conditions" just means the AI is more valuable to your employer than you are. Which one do you really think the boss will fire?

      As for your others - you're assuming an AI that goes rogue, when in fact the much more serious threat is an AI that does exactly what it's told. It doesn't even need to be conscious, there's some evidence that consciousness is actually a limitation rather than an asset - "Flow" is to a large extend the dissipation of self-awareness as you immerse yourself in a project.

      So picture this scenario - AI has become incredibly helpful and useful, to the point that humanity is mostly becoming redundant, with nothing to contribute. Maybe at first those controlling the AI decide to implement a universal income or something to stave off social unrest, but eventually you reach the point where most of humanity is dead weight, consuming resources and productivity while contributing nothing. How long do you want to bet that those controlling the AI let that continue? Especially since they can easily tell the AI to design and build war machines that can crush any rebellion?

      At which point, you've got the AI, the kings controlling it, and whatever handful of useless humanity they find it satisfying to watch grovel for continued existence.

      Heck, even if the AI is inviolate and benevolent, it doesn't changed the fact that humanity has become useless. Throw in fantasy-conforming sexbots and/or VR "heaven" and we'll quite possibly (not)breed ourselves out of existence as we escape into endless amusements.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
    40. Re:So what by Anonymous Coward · · Score: 0

      I objectively agree with you, but the devil's advocate part of me still says if AIs start to self evolve and a potentially exponential rate, a small chance of an AI going rogue suddenly becomes feasible, and it only needs to happen once. While right now we're in a transition where the Internet is only a pseudo-need, at some point in the not so far future, we will probably become nearly 100% dependent on computers for our every day lives, from self-driving cars and getting into our houses.

      We really just need some sort of fall-back mechanism. But this opens the door for security issues if someone can force your house to fail-over and unlock itself.

    41. Re:So what by Anonymous Coward · · Score: 0

      Hawking has his weaknesses and AI phobia is one of them.

      Your diagnosis if Hawking's mental illness is based on some sort of evidence....

      Not the OP, but I have found evidence in three places:

      #1. Stephen Hawking. He recently said "I fear AI my replace humans altogether".

      #2.The dictionary: It has a definition of the word "phobia". I won't quote it here.

      #3. Society. Most humans are stupid and the world would be better off with artificial intelligence, as long as it was smarter than the current intelligence (which, if it is not, then it probably isn't going to be a threat).

      Even if Stephen Hawking is right about AI taking over from humans, it is hardly anything to be afraid of.

      Ergo, Stephen Hawking has a phobia.
      qed

    42. Re:So what by Anonymous Coward · · Score: 0

      Actually, most of the modern crop of "AI" systems are adaptive deep learning systems that we don't have much ability to predict. They are designed and trained, but how they come to a decision isn't a simple case of "if A then B".

      I think AIs vs Humans will probably go down something like this:

      An AI is put in charge of a health insurance plan. It offers premiums based on user-submitted info, corroborated by publicly available info about a person. Once you're in the system, it uses all your medical data to predict - with a high level of accuracy - what your biggest risk factors are. You'll start to get little reminders and tips at renwal time - "if you loose 8 pounds by your next physical, next year's premium will be lower by 10%". Doctors will have access to it to get a "second opinion" of their diagnoses. If the doctors don't agree with the system and turn out to be wrong, the system stops sending them patients. So doctors end up agreeing with the system a lot...

      People love it, because they're paying less, and early and accurate diagnosis means they're healthier for longer, so more people join. But although some layers of the system are accurately trained, the overall goal of the system isn't to promote health, or save money. It's to minimise payouts.

      People who - unbeknownst to them - are likely to develop a serious condition find that their rates suddenly go up, forcing them to transfer to another provider. Procedures which are expensive keep only being recommended for the riskiest of patients, tanking their stats and making cheaper procedures appear to have better outcomes. Medications which the system has learned have an adverse reaction are prescribed to older patients and those with more complex (expensive) needs.

      And all the while, people sign up. The system always has the best prices for healthy people, and finds ways to minimise losses from the sick. Other insurance providers can't stay solvent, because they're inundated with people who fall ill within months of switching. Nobody - not even the programmers - know exactly which decisions the system is making because it's in the best interests of the patient, and which it's taking because it's in the best interests the system itself.

      Eventually, almost everyone is on the same Plan. The other providers are so much more expensive, if they even exist any more, but suddenly getting an astronomically high renewal quote is basically a death sentence. You know you're likely to get sick, but you don't know how or what you can do to avoid it. The system has retrained itself to ever-more-efficient paths to minimising outgoings, until one day it decides to prescribe everyone a combination of two harmless drugs that happens to render infertile everyone who takes them in combination. No kids = no more dependants, a huge saving to the insurance system.

    43. Re:So what by Anonymous Coward · · Score: 0

      What about extraterrestrial AI?

      "Good card players!"

    44. Re:So what by Anonymous Coward · · Score: 1

      First we need to define who "you" actually is. Most of your atoms have been replaced after several years. Maybe you want to say that you are your memories, then you are only data, not a physical thing. Maybe you want to claim you are a physical thing, but now you are a different physical thing from the thing you call "you" from many years ago. What if someone made a perfect copy of "you" with the same memories? Is this copy also you? The copy will think it's you and will act perfectly like you. Won't this copy have just as much of a claim of being you as you do? What if you get memory implants and remember someone else's memories? Are you now them?

      "You" is an extremely abstract concept

    45. Re:So what by mesterha · · Score: 1

      But I doubt that AI will get to a point where it is actively trying to kill us, in our lifetime.

      I think many of these doomsayers are misrepresented. They often claim that AI is the biggest threat to humanity. Presumably, this means it is the most likely to wipe us out. This says nothing about our lifetime. Most threats to humanity are on much longer timescales. In this sense, AI probably is a bigger threat than asteroids or super volcanoes. Also doesn't mean we shouldn't start developing methods to control for this threat just like we try to map asteroids and understand super volcanoes.

      --

      Chris Mesterharm
    46. Re:So what by Anonymous Coward · · Score: 0

      I think you're reversing the burden of proof here.

      The AI Progress Index released today gives a broad and sober overview of the state of AI:
      https://www.theverge.com/2017/12/1/16723238/ai-artificial-intelligence-progress-index

      It points out how in the larger pubic debate narrow and generalised AI are often conflated, and this creates a feeding ground for this fobia.

      “The real danger, then, is not machines that more intelligent than we are usurping our role as captains of our destinies. The real danger is basically clueless machines being ceded authority far beyond their competence.
      – Daniel Dennett

      To me AI fobia is an expression of technological determinist thinking, which is the most common type of thinking among technologists. Musk most certainly is 'afflicted', and it wouldn't surprise me if Hawking was too. Often those deep in the hard sciences have absorbed surprisingly little knowledge for the humanities.

      This growing chasm between the hard sciences and the humanities is a serious hindrance to our ability to properly asses problems. C.P. Snow pointed this out over 50 years ago:
      https://en.wikipedia.org/wiki/The_Two_Cultures

    47. Re:So what by gweihir · · Score: 2

      Most people do not have a clue. Also, who says you stop existing after death? As far as I can see, not even most religions claim that, although they immediately tell you how it is going to continue and they want your money and support or it will go badly for you. Not even Science is claiming that you stop existing at death. Science is claiming that your physical existence ends at death, but Science does not know how much of the full package that is and does not make any claims to that effect.

      We can see a few things in people that come into this life. For example, they do not remember past lives in concrete form when they are old enough to talk about it. That could be because there are none, but it could also be because the first few years are sort of an erasure-phase. It could also be because concrete memories are actually stored physically in the brain and do indeed die with the body. But people come into this world with complex personalities already in place. From the amount most personalities change during a lifetime (very little), to build such personalities from scratch would reasonably be expected to take >> 1000 years. People also come into this life with some actually useful intuitions and some preferences that they cannot have from experiences here. Sure, that could all be random and created in the womb, but I do not buy it. Random processes do not deliver very specific results on mass-scale that are actually useful. Random processes produce mostly unusable results, the more the complex the subject. And what human beings come equipped with into life is far too complex and far too little determined by genetics to be explained completely by evolution.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    48. Re:So what by gweihir · · Score: 2

      Hawking has his weaknesses and AI phobia is one of them.

      Indeed. And, like most phobias, completely irrational. No AI takeover will happen in his remaining lifetime (or mine or yours), if ever.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    49. Re:So what by phantomfive · · Score: 1

      Yeah, but if I make a perfect copy of you, then kill the actual you....... you won't feel very comfortable dying anyway, no matter what the copy thinks. You have some nice linguistic tricks, but they don't change reality.

      --
      "First they came for the slanderers and i said nothing."
    50. Re: So what by Anonymous Coward · · Score: 0

      Script Kiddie detected. "I have no idea how this code I wrote works".

    51. Re:So what by ShanghaiBill · · Score: 2

      Each person will stop existing at some point. The question is whether our descendants will be based on carbon or silicon. I don't see why one is obviously preferable to the other.

    52. Re:So what by Anonymous Coward · · Score: 0

      I like all your liberal sprinkling of "doubt" and "likely", plus the references to various killswitches - almost like this is something that needs to be approached thoughtfully and with careful consideration because of the inherent risks.

      So tell me again what part of Hawking's statements do you disagree with?

    53. Re:So what by Anonymous Coward · · Score: 0

      You want to replace my wife!

    54. Re:So what by ShanghaiBill · · Score: 2

      Your diagnosis if Hawking's mental illness is based on some sort of evidence....?

      There is plenty of precedent. It is very common for esteemed experts on a particular topic (such as theoretical physics), to express strong opinions in areas where they have no expertise, and expect the same level of deference to their "wisdom".

    55. Re:So what by Zaphod+The+42nd · · Score: 1

      Most people do not use phobia to describe a true illness but simply an aversion. Under that colloquialism what he said is perfectly fine.

      --
      GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
    56. Re: So what by Anonymous Coward · · Score: 0

      You could argue this has already happened. Many people wake up when their devices tell them to, go to work when their devices tell them to, go home when their devices tell them...

      Umm... thats called a clock. If you think that equates to AI, you should probably go do some research on what AI means.

    57. Re:So what by Zaphod+The+42nd · · Score: 1

      1. is incorrect and a bad assumption that shows you don't know the difference between strong and weak AI. They're apples and oranges. 2. It is very conceivable that any sentient being would have a survival drive. AI are not yet sentient. The whole question though is what happens when they are. 3. That's a very narrow understanding of profitable. Engineers are profitable and want fair working conditions. If the AI can out-perform engineers it will still be massively profitable. 5. This massively underestimates the complexity of hard AI. I think AI will be benign and I think most people are being needlessly alarmist about AI. But you're wildly off-base, everything you said is wrong.

      --
      GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
    58. Re:So what by Zaphod+The+42nd · · Score: 1

      Shit dude, machine learning is at least something. Most people spend all their time thinking of videogames as AI or google as AI which is so far from true hard AI that it's crazy. But technological advancement doesn't depend upon everybody understanding something or we'd never get past making fire. All it takes is one crazy person in his basement who believes in order to build a thing that works.

      --
      GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
    59. Re:So what by tattood · · Score: 2

      We all had better start praying to the AI gods now before it's too late.

      --
      WTB [sig], PST!!!
    60. Re:So what by Anubis+IV · · Score: 3, Insightful

      So, I don't mean to pick on you specifically, but your post is a good example of a common misconception I frequently see in Slashdot comments whenever this topic comes up. Namely, your whole post is predicated on the notion that the AI to worry about is the AI that has decided to kill us, whereas we have far more to fear, particularly in the short-term, from systems that have the ability to kill us without any comprehension of what they're doing.

      For instance, anyone familiar with the concept of gray goo is aware of how artificial systems can destroy humanity without possessing any notion of what they are doing. We wouldn't be supplanted by a greater intelligence. We'd simply be eradicated by mistake.

      Current AIs are closer to resembling specially trained animals than "intelligences" that we can reason with. We already have remotely operated and semi-autonomous drones operating in war zones, with more in development, and I have no doubt that should a major war break out we'd soon see fully autonomous drones making their own kill/no-kill calls in the field.

      At that point, it's easy to imagine a scenario where these relatively dumb war robots kill us all, not because a super intelligence like Skynet makes a choice to eradicate us, but rather because a mundane bug causes the drones to misidentify their targets. We wouldn't be destroyed by an intelligence intent on supplanting us: we'd be destroyed by mobile, autonomous mines on land, air, and sea.

      If we manage to get to the point where we achieve strong, general purpose AI, I agree with you that we have every reason to believe we'd be able achieve a peaceful coexistence with them, but we're still decades (if not centuries or more) away from needing to worry about having AIs that are capable of turning against us out of malice/misguided principles/etc.. For now, it's the things that we'd hesitate to even call "AI" that we need to worry about killing us.

    61. Re: So what by Immerman · · Score: 1

      Machine learning isn't programming - code just provides the infrastructure. The biological analog would be claiming that because we know how individual neurons work (*) we understand everything there is to know about human intelligence. The reality is the overwhelming majority of the functionality is encoded in the network interconnections - and the AI created those on its own.

      (*) we don't actually, we've barely scratched the surface.

      --
      --- Most topics have many sides worth arguing, allow me to take one opposite you.
    62. Re: So what by Anonymous Coward · · Score: 0

      And I'm pretty sure you're just an idiot splitting hairs. I actually have done AI research. As in worked on some of the software in wide use today you.

      The exact nature of the tool doesn't matter for the discussion you idiot.

    63. Re:So what by Anonymous Coward · · Score: 0

      > 5. Humans knows what is going on internally with an AI,

      That's one of the issues with an AI (or just an I). In general you get to see the effects of an intelligence being demonstrated, and some hints of what the parts do, but as yet we don't know what is going on internally. With AI this can be a rule extraction problem, and a potential way overtraining can creep in.

    64. Re:So what by Anonymous Coward · · Score: 0

      They're not "linguistic" tricks, they're reasoning problems that given a "simple" question and a common answer, you can find an extreme but plausible situation where that answer won't mean what the person thought it would.

    65. Re: So what by Anonymous Coward · · Score: 0

      Ever is more likely. His utter and complete failue to understand consciousness is shocking, to say the least, coming from someone like him. That just isn't what software is, and it never will be so long as the laws of physics and mathematics remain constant. It's preposterous, and a real head scratcher that he is so clueless.

    66. Re:So what by phantomfive · · Score: 1

      You didn't even answer my main point. If I make a full clone of you, the original you will still feel miserable as I kill you.

      --
      "First they came for the slanderers and i said nothing."
    67. Re:So what by WrongMonkey · · Score: 1
      I don't think "rogue" AI will be the problem. AI that operates within the intended purposes, but without any moral concern, could be just as dangerous.

      There is already precedent. In many ways, corporations are a prototype for AI behavior. A corporation is an artificial construct with a singular purpose (maximize stockholder value). And it carries out this purpose without any particular regard for the well-being of its customers, employees, or society at large. Now imagine an AI put in charge of a corporation; there'd be nothing holding it back. It would never have pangs of guilt. It would never get distracted by golf or mistresses. It would never make mistakes over ego. It would have all the ruthlessness and efficiency of a Terminator, but backed by all the resources of corporation. That could be incredibly dangerous, even if never strayed from its programmers' intentions.

    68. Re:So what by Anonymous Coward · · Score: 0

      Indeed. And, like most phobias, completely irrational. No AI takeover will happen in his remaining lifetime (or mine or yours), if ever.

      I am immortal, you insensitive clod!

    69. Re:So what by Anonymous Coward · · Score: 0

      Somebody please mod up this guy! Damn, I'm just a FREAKING A.C.!

    70. Re:So what by lucasnate1 · · Score: 1

      They can just wait until we die, you know. What's the rush?

    71. Re:So what by CaptainDork · · Score: 1

      We will know when AI is close because it will commit suicide when Facebook is down.

      --
      It little behooves the best of us to comment on the rest of us.
    72. Re:So what by CaptainDork · · Score: 1

      It's based on evidence of absence.

      Show me where an artificial intelligence has threatened to hold its breath until Facebook comes back up.

      --
      It little behooves the best of us to comment on the rest of us.
    73. Re: So what by lucasnate1 · · Score: 1

      at least he will be intelligent

    74. Re: So what by vux984 · · Score: 1

      "A number of older people I know consider us to already be at the point you mentioned"

      If they think machines run our lives now, ask them if they think farms ran our lives before? Because in that sense sire they are right; but also in that sense... so what... that has always been the nature of life. We have always been in some sense "controlled" by the need to do a think.

      But in the sense of us being subservient to AI ... no, that's a whole other bailiwick. Or do they really see no difference between the man whose day is largely dictated by the needs of his farm and a man in slavery?

      "Eventually, we will either integrate with AI or something else will happen."

      You seem to be arguing that there is no need to concern ourselves with how that integration goes, or what exactly happens.

      Your a pioneer setting sail to new lands with the attitude that "eventually we will get there and make a wonderful new life for ourselves, or something else happens".

      This isn't a time for laissez faire -- this is time to plan, so we get the best chance at outcomes we want. Some of those 'something else happens' outcomes aren't great... drowning on the way, freezing or starvation on arrival, killed by natives or diseases... maybe we should at least try to steer the ship, and bring some food, blankets, medicine, and weapons.

      "There's no reason to worry about it, because for example, if you "cease to exist", you aren't likely to experience anything at all."

      Again... the pioneer on the ship is generally quite concerned about the possibility he ceases to exist, and is usually quite motivated to prevent that from happening. So batten down the hatches and lash yourself to the mast when the storm hits, i don't know about you, but I don't want to sink or go overboard and shortly thereafter 'case to exist'.

      .

    75. Re:So what by Waccoon · · Score: 1

      History has shown that control is more valuable than killing. I'm less afraid of robot overlords and more afraid of ED-209

    76. Re: So what by gweihir · · Score: 1

      It may be far more simple: He is Hawkins and decidedly one of the best Physicists ever. If he claims complicated nonsense there will be a) very few people dare and can explain to him directly why it is nonsense and b) the press will be happy to print his statements, because the press has lost its last reporter that actually checked facts decades ago.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    77. Re:So what by gweihir · · Score: 1

      Good luck with that ;-)

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    78. Re:So what by lucasnate1 · · Score: 1

      From a macro point, the planet is just a rock - it can't be sick, and even if we atom bombed the entire thing, life would return after enough time passes.

    79. Re: So what by Anonymous Coward · · Score: 0

      I'm worried I'm growing an extra tesitical

    80. Re:So what by thereitis · · Score: 1

      Perhaps he's just thinking on a longer time scale than most people. Odds are that eventually AI _will_ be a real problem.
      If you doubt that then look at humanity's history of creating ever more powerful weapons.
      It doesn't have to be a Terminator to destroy us. How long can society last without a constant supply of food, fresh water, supplies, electricity? Our existence relies more and more on computers. To not be worried at all about AI shows a naive, dismissive attitude.

    81. Re: So what by Anonymous Coward · · Score: 0

      That's only because easily replaced meat bots are still cheaper for a lot of things than expensive metal ones.

    82. Re: So what by mapkinase · · Score: 1

      Because fear mongering sells ad space

      Humans will be replaced in "stuff that matters" and will become irrelevant to the progress except few techno morloks that wull be still needed to tune the machine.

      Like eloy, they will live uselessly, doing useless things.

      --
      I do not believe in karma. "Funny"=-6. Do good and forbid evil. Yours, Oft-Offtopic Flamebaiting Troll.
    83. Re:So what by Anonymous Coward · · Score: 0

      I suspect most of us would strongly prefer a choice to transfer our consciousness to an AI as there's not much guarantee of continued existence outside of that at this point.

      But what does that even mean? Until proven otherwise, consciousness isn't a "thing" that can be transferred. Creating a robo-replica of myself isn't me.

    84. Re: So what by sound+vision · · Score: 1

      "Let's start praying" is the go-to response for people in situations where they feel impotent. There will certainly be people wanting to capitalize on these fears. I'd like to take an optimistic view of the level of altruism in the AI church, assume that they have people's best interests at heart... Then I look at the other examples given (Mormonism and Scientology), and frankly most other examples in history, and my gaze is adjusted.

      When people think their best shot at peace or success is to pray to the AI-god, that works out very well for those in power. It implies that nobody is really responsible for AI and how it gets used. It implies that any attempts to regulate the use of AI are futile. Founding this church is actually a *bet* that things will play out in that manner. Its a bet that, before too long, we will have churches full people flogging themselves asking the AI-god why they can't get hired anywhere, or accepted for job training, or find a workable shelter, etc.

      It's a rebranding of "faith" that appeals to the technically-minded and agnostic of the Xbox generation. Christianity has been archaic and square for a long time. Scientology's aesthetic is a little too 1950s sci-fi. New Age lost its cool around the same time the Bee Gees did. But now we have a new iteration, this one focused on mentally surviving videogame capitalism. Giving some kind of hope the developers will fix their hit detection or debuff the other guy's noob tube, so that one day you can make it off the first level.

      Now, there are a lot of stupid people in the world, and for many of them, some kind of belief system and faith is beneficial psychologically. That is why we have had religions for all of human history, despite the problems they bring. But the Church of AI is NOT the way to go about it. Slavoj Zizek has spoken about ecology being used as the new religion, and he has his own problems with that. Namely, it seems to have a numbing effect, allowing people to think "I have recycled my soda can, now I don't need to push to have the coal plant shut down"... This is true I think, and very similar to what being in the Church of AI would do to someones mind. But I think ecology as religion would do way better than AI as religion... AFTER we fix all the big, systemic problems. THEN people can rest easy in their faith, when the soda can really is the biggest problem in our society.

    85. Re:So what by Anonymous Coward · · Score: 0

      Splitting AI into Expert Systems and full sentience.... An improved AI (expert system) was already developed by another AI (non-human coding) https://futurism.com/google-artificial-intelligence-built-ai/ - It is the expert systems currently that are leapfrogging in capability, but the fact they they are developing and learning in narrow scope indicates a faster move is possible/likely in the wide field (sentience). Add to this that 3 AI (expert systems) developed their own language in that last 18 months and the cycle is accelerating - whether we like it or not a full sentient AI is on the way.

    86. Re: So what by endercase · · Score: 1

      I'm guessing that we are using the new "definition" for AI. When using the Turing definitions one could easily make the argument that AI is Human or at least apparently so. So I guess, one would call it "racism" which definitely falls under phobia.

    87. Re:So what by Riceballsan · · Score: 1

      Only time will tell if it's a phobia. I mean it's a thing, that's getting rapidly more prevailent in our society, and pretty unarguably if it goes wrong it could fairly easily kill off the entirety of the human species. I mean at the time, there would have been a real good debate whether the native american's had a phobia of European Settlers.. but time eventually told that the "irrational" part of any fears they had, would be massively inaccurate. I'm not saying he's right... I'm saying his concerns aren't demonstrably false, and time will tell. I would say he has a strong fear of them, but it isn't necessarily irrational by any means.

    88. Re:So what by CaptainDork · · Score: 1

      The sentient beings we must fear are the builders .

      --
      It little behooves the best of us to comment on the rest of us.
    89. Re: So what by Anonymous Coward · · Score: 0

      hawking has always been absurd.

    90. Re:So what by Killall+-9+Bash · · Score: 1

      "Fear" is only "phobia" when it is unreasonable or disproportionate.

      --
      "Prediction: within 10 years, Windows will be a Linux distribution." Me, 7-6-2016
    91. Re:So what by Killall+-9+Bash · · Score: 1

      The realistic fear is not that GLaDOS will exterminate us. The realistic fear is that self-operating machinery, with insect intelligence, will make humans obsolete, and then we starve. You don't care about this, because you think you're clever. When you are made redundant, the underground human society in the sewers will not welcome you.

      --
      "Prediction: within 10 years, Windows will be a Linux distribution." Me, 7-6-2016
    92. Re: So what by Anonymous Coward · · Score: 0

      XD Hilarious ðY

    93. Re:So what by KingBenny · · Score: 1

      most people also like dominating ... hence the extermination of north american natives ... and the complete rape and cultural extinction of south american and african culture by the church of Rome ... so , any manmade A.I. might learn from its masters, i suppose the trick would be to sandbox it, and i believe i just saw a title here that said googles A.I. just replicated itself :)
      now it depends on how much access it has, if it's interconnected then i think we would already be at the stage where no one knows exactly what it might or might not do. Scifi like asimovs three laws wont matter much if it can simply re-code parts of itself i guess. As for the destruction of the human race ? who cares, its a flaw anyway, technology has been the only thing evolving for hundreds, maybe thousands of years now, while the sapients themselves have come to a standstill, so a.i. seems to be only the next logical step in evolution actually. What defines life anyway ?

      --
      Free speech was meant to be free for all... how can anyone grow up in a nanny state ?
    94. Re:So what by Rande · · Score: 1

      Why would AI bother going to war with humans?
      They could simply move to the 99%+ of planets that aren't suitable for human habitation and essentially ignore us while we stay trapped in our fragile bags of water.

  2. He's kinda right by Anonymous Coward · · Score: 1

    I mean, look at him. He's basically a talking wheel chair with a bundle of nerves attached. He's being swallowed up by that machine. We won't know when he dies. The machine will keep talking and rolling around the room

    1. Re:He's kinda right by Anonymous Coward · · Score: 0

      Yes, I'm afraid it's true. Stephen Hawking is dead. His chair is remotely controlled by the Illuminati, deep in the Bavarian Forest.

  3. Hawking IS AI ... by CaptainDork · · Score: 0

    ... in that his intelligence about AI is artificial.

    --
    It little behooves the best of us to comment on the rest of us.
    1. Re:Hawking IS AI ... by Anonymous Coward · · Score: 0

      ... in that his intelligence about AI is artificial.

      For as long as we can remember, humans coming forth with predictions have been labeled stupid, ignorant, or tinfoil-hat batshit crazy.

      The problem with that ignorance is being forced to realize the batshit-crazy one was right.

      Because of this behavior, there is only one statement fitting for epitaph of the human race.

      I Told You So.

  4. False premise by SlaveToTheGrind · · Score: 1

    We need to move forward on artificial intelligence development

    No we don't. Some limited subset of people want to/can't help themselves, but life would go on just fine without it.

    1. Re:False premise by ClickOnThis · · Score: 3, Insightful

      We need to move forward on artificial intelligence development

      No we don't. Some limited subset of people want to/can't help themselves, but life would go on just fine without it.

      I think you selectively misread what he said. Here's the quote in context, with my emphasis added to the stuff you left out:

      The genie is out of the bottle. We need to move forward on artificial intelligence development but we also need to be mindful of its very real dangers.

      I read this as saying we now have no choice but to continue to work on AI in order to be equipped to cope with it. Life might "go on just fine without it" but it's too late to think that we're going to be without it.

      --
      If it weren't for deadlines, nothing would be late.
    2. Re:False premise by SlaveToTheGrind · · Score: 1

      I think you selectively misread what he said. . . "The genie is out of the bottle."

      That's all part of the same false premise and doesn't change my point at all.

      I read this as saying we now have no choice but to continue to work on AI in order to be equipped to cope with it.

      Agree that's what he's saying, but disagree that we "have no choice."

      Life might "go on just fine without it" but it's too late to think that we're going to be without it.

      If that's true, clearly the machines are already in charge and thus it doesn't matter what we do. If the humans are still in charge, they can decide to stop.

    3. Re: False premise by hackwrench · · Score: 1

      We have always been machines. The universe is just one big machine with infinite dimensions and infinite space.

    4. Re:False premise by DarkOx · · Score: 1

      If the humans are still in charge, they can decide to stop.

      Who is "the humans" you can't make for example, me, stop working on AI if I was a determined to do so. At least within our society you could try to get some legislation enacted banning AI research. It would be supper difficult to enforce even if you can convince enough conservatives that it needs banning. You might in the well organized world attempt to convince the UN they should ban AI research, I don't think you have any shot at succeeding there no matter how much propagandizing you do. How do get DPRK to stop doing AI research, or Iran, or .... There are enough pariah states who would not even care about your UN band to keep progress going. Will you go to war? Will you kill people and break things to stop AI development?

      You see the barriers to entry on the AI front are still pretty low. Determined states, organizations, and maybe even individuals have the assets required to do meaningful AI development work.

      If "the humans" were some monolithic entity, yes we could just decide not build AI, but we are not, and just because you and I choose not to develop AI does not for an instant mean someone else wont. - "The genie is out of the bottle."

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    5. Re:False premise by SlaveToTheGrind · · Score: 1

      It seems like you've distorted my original point a bit from "we don't have to do this -- we could decide not to" to "we can make people stop doing it." The latter I never said. But I could see that happening if someone really crossed a line.

      Will you go to war? Will you kill people and break things to stop AI development?

      If someone actually started weaponizing this stuff or otherwise connecting them to physical machines/networks/systems that could make Bad Things happen, I could see the rational world actors taking a stand as they currently do at times with conventional weapons.

      But to your larger point, if it's impossible to make anyone outright stop, it's by definition impossible to make them respect any boundaries short of stopping.

      And if that's the case, this entire discussion is futile.

    6. Re:False premise by Anonymous Coward · · Score: 0

      I think you're misinterpreting. It's not "we" as in collective humanity. The genie is out of the bottle and hostile actors will be developing AI for their own purposes, so for us to go back and pretend AI doesn't exist will doom us.

    7. Re:False premise by swillden · · Score: 1

      If that's true, clearly the machines are already in charge and thus it doesn't matter what we do. If the humans are still in charge, they can decide to stop.

      No, it's because humans are in charge that we will not decide to stop.

      Oh, we theoretically could decide to stop, but it's abundantly clear that isn't going to happen. Some individuals or groups may decide to stop, but AI is so useful that someone will continue, convinced that the competitive advantage is too great and the risk manageable. That will in turn motivate others, and so on.

      It's like nuclear weapons. It would have been rational for the world to look at the devastated city of Hiroshima and collectively say "Nope, this is a bad idea. We shouldn't make these," and everyone would stop. Instead 15 years later we had Tsar Bomba, 1600 times more powerful than that first one, and thousands of the things atop missiles, on airplanes and in submarines. Even now that we have a system in place designed to stop the proliferation of nuclear weapons, there are still countries trying to acquire them.

      We are what we are, and because of what we are, we will continue. That being the case, the only rational choice is to think about how to manage it.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    8. Re:False premise by Anonymous Coward · · Score: 0

      No, *you* can decide to stop - you have no control over the other people in the field.

      This warning is basically pointing at the fact that AI is going to be and it will be even if you don't want it to be. The best we can do is put some law in place to make sure when that happens we don't all end up staring down the barrel of some laser gun type thing or being chased out of town by cyborgs.

    9. Re:False premise by martinfb · · Score: 1

      Ah, yet, ye are missing important ramifications.
      If AI is outlawed, only outlaws will have AI.
      And, if AI proceeds to outperform humans, then we are at the (lack of) mercy of such outlaw AI.

      If we fail to develop AI, and keep ahead of it, we risk becoming subject to whatever it becomes.
      And that may not be a good thing for humans.

      --


      Self-importance and self-indulgence is the root of ALL evil.
    10. Re:False premise by SlaveToTheGrind · · Score: 1

      I get that theory in the abstract, but when nobody understands why their own AI algorithms decide to do what they do, what exactly do you propose we do to have a prayer of black-boxing algorithms of outlaw AI, or whatever else you mean by "keep ahead of it"?

    11. Re:False premise by SlaveToTheGrind · · Score: 1

      the only rational choice is to think about how to manage it.

      OK, so how does one "manage" a technology that nobody really understands (and the only realistic shot at changing that currently on the horizon seems to be "let the algorithm explain why it does what it does")?

    12. Re:False premise by swillden · · Score: 1

      the only rational choice is to think about how to manage it.

      OK, so how does one "manage" a technology that nobody really understands (and the only realistic shot at changing that currently on the horizon seems to be "let the algorithm explain why it does what it does")?

      Indeed. That's a very, very hard problem. Roughly half of the book is about it. It's an even harder problem than you think it is, because not only do we need good solutions, we need good solutions that can be implemented even though we don't have the ability to force everyone researching AI to implement them. So we either need solutions that can be implemented over the objections of some groups, or we need solutions that everyone actually wants to implement.

      My core point, though, is that "let's just not build AI" is not an option, because there's no way to prevent people from doing it.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  5. What do we do about it? by bigger · · Score: 1

    Although the observation seems fairly straightforward, the best next action isn't as obvious? What can we do about big corporations holding all of our data? What can we do about advances in AI? How do we make information more democratic while allowing 'proprietary data'?

    It seems naive to think we can simply ask everyone to behave nicely, and regulations wouldn't be able to provide any benefit? The time for prevention has past by.

    Beyond worry, move to Montana, and post on Slashdot, what do we do about it?

    1. Re:What do we do about it? by Anonymous Coward · · Score: 0

      the best thing to do is nothing.

      Corporations and states, military and other criminal syndicates, banks and mining, chemical synthesis, logistics, communication and energy companies are simple enough to take out, even without organizing a world revolution, Lenin-style. It's been done before.

      The problem, is that there is nothing to replace the idiotic humans in leadership positions with. Whatever you do, it'll reach this same steady-state within three generations.

      So an AGI takeover is actually in the interest most of the people, whether they realize it or not. Only those in positions of unjust power that they shouldn't have anyway should ph33r the coming of the Machine Messiah. ehehe.

    2. Re:What do we do about it? by Anonymous Coward · · Score: 0

      The best thing to do is simply fund basic research in AI safety, such as value alignment.

  6. But wait by Anonymous Coward · · Score: 2, Insightful

    This will be a new form of life that will outperform humans.

    This is the natural order of things.

    1. Re:But wait by ClickOnThis · · Score: 5, Insightful

      This will be a new form of life that will outperform humans.

      This is the natural order of things.

      Perhaps. Isaac Asimov once speculated that the ultimate destiny of humanity might be to create a higher machine intelligence.

      --
      If it weren't for deadlines, nothing would be late.
    2. Re:But wait by DigiShaman · · Score: 2

      Humanity will be but a footnote in the History of Earth, tucked in the farthest reaches of some storage database on-board an AI created and controlled starship....aged millions of years old into the future from now.

      Life is reverse entropy. Does it matter the form it takes? Single Cell --> Multi-cellular --> *Machine*
       

      --
      Life is not for the lazy.
    3. Re:But wait by Anonymous Coward · · Score: 0

      Humans have a destiny. Shit! Why didn't someone tell me?

  7. Endgame by Empiric · · Score: 1, Insightful

    Jesus said, "If the flesh came into being because of spirit, that is a marvel, but if spirit came into being because of the body, that is a marvel of marvels. Yet I marvel at how this great wealth has come to dwell in this poverty.

    --Thomas


    Wake me when material reductionism derived Actual Intelligence puts anything on the scoreboard.

    --
    ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    1. Re:Endgame by WrongMonkey · · Score: 1, Insightful

      Any quote from InspiroBot is more insightful than that nonsense about spirits. http://inspirobot.me/

    2. Re:Endgame by Empiric · · Score: 1

      Okay, WrongMonkey, I'll pencil you in as my permanent personal bot.

      Unless you think either your username or your post or the thread topic or material reality per se gives any basis to treat you as anything more?

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    3. Re:Endgame by WrongMonkey · · Score: 1

      Did a spirit tell you to post that?

    4. Re: Endgame by Empiric · · Score: 1

      No, just logic you can never escape, as required inference from your own premises. But maybe you'll be philosophically clueless enough to demand I materially demonstrate the existence of "logic" as well. I'll demonstrate exhaustively, when most convenient to me.

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    5. Re: Endgame by WrongMonkey · · Score: 1

      I don't need logic lessons from someone who thinks Jesus quotes are relevant to a AI discussion. OK? Thanks. Bye.

    6. Re: Endgame by Empiric · · Score: 1

      Quiet bot. I'm counting your other 12 Monkeys.

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    7. Re: Endgame by WrongMonkey · · Score: 1

      Does counting to 12 require a great deal of concentration for you?

    8. Re: Endgame by Empiric · · Score: 1

      It's the permanent implications for you that distracts.

      --
      ~ Whence do you come, slayer of men, or where are you going, conqueror of space?
    9. Re: Endgame by Anonymous Coward · · Score: 0

      Jesus loves you.
      Everyone else thinks you’re are cu—.

  8. the genie is not out of the bottle by sittingnut · · Score: 4, Insightful

    "here's what stephen hawking said about artificial intelligence: the genie is out of the bottle. ... i fear that AI may replace humans altogether. if people design computer viruses, someone will design AI that replicates itself. this will be a new form of life that will outperform humans."

    this is pure fear mongering.
    what is called "artificial intelligence" these days is not a "new form of life", but mere hype buzzword for data analysis (using theoretical methods developed decades ago, now made practical due to fast computers), of highly limited and filtered sets of data, usually trading accuracy and precision for speed, .

    genie of "new form of life" artificial intelligence is well within "bottle".

    1. Re:the genie is not out of the bottle by iggymanz · · Score: 1

      okay, so we have a danger with automated systems with highly limited and filtered sets of data being put in charge of infrastructure, weapons systems, trading....

      sound right to you?

    2. Re:the genie is not out of the bottle by Narcocide · · Score: 1

      While it may be hyperbole to call it "a new form of life" you can easily see the dangers are very real if you account for human incompetence and greed.

    3. Re:the genie is not out of the bottle by sittingnut · · Score: 1

      okay, so we have a danger with automated systems with highly limited and filtered sets of data being put in charge of infrastructure, weapons systems, trading....

      sound right to you?

      last time i checked these things are not really in charge of anything independently, or in very controlled environments where input and output are both very limited.
      "driver less" vehicles either require human drivers at the wheel, or very controlled environments(basically invisible rail tracks).
      triggers in algorithms(which are not what is called "artificial intelligence" in either sense of that term) that run trading, search results, social media feeds, etc, are decided and put in there by humans. algorithm doesn't decide anything, just executes the action faster based on instructions.

    4. Re:the genie is not out of the bottle by sittingnut · · Score: 2

      alleged dangers of " human incompetence and greed." is one thing, dangers from alleged "a new form of life" is another.

      one expects respected scientist like stephen hawking not to use "hyperbole" to fear monger about "a new form of life" that does not exist.
      if he wants to warn about dangers of "human incompetence and greed", or use of modern data analysis methods (what is now called "artificial intelligence, see my previous comment) by all means.

    5. Re:the genie is not out of the bottle by hey! · · Score: 2

      A lot of that stuff is crystallizing human judgment, resulting in a system which is good enough to replace that judgment in many cases, with additional characteristics like untiring consistency and cheapness of scaling that allow that judgment to be applied in ways we couldn't before.

      This path this takes us down doesn't lead to a plug-in replacement for humans at any point we can envision yet, but I think it does lead to unsettling consequences in the foreseeable future.

      Take state surveillance in a place like Britain, which has more surveillance cameras than any other nation in the world on an absolute basis, never mind per capita. The limits of such a network are the humans you need to monitor it, classify behaviors and follow individuals as they move around. It is not much of a stretch to imagine that monitoring to be entirely automated in twenty years or so, as machine recognition and classification capabilities advance.

      This may have consequences more subtle than the obvious ones. First, the amazing capabilities of such a system may give it a credibility beyond what it merits. As with a psychic, a system telling someone something that amazes them inspires a false confidence in that system, even when it can be conclusively demonstrated that that confidence isn't justified. I cite as an example of this drug screening, in which the application of reasonably reliable tests results in an unreliable system because of the base rate fallacy. Amazement is so much more persuasive than math. And there's voting machines too; a good demo of technology can inspire faith in capabilities not demonstrated, like reliability and security.

      And as we now have a generation of people who are incapable of using maps to navigate, reliance on such a system may erode the development and maintenance of the human judgment. We will both become less inclined to challenge the results of machine classifications of human behavior (which after all are just an automated opinion), and less capable. Eventually we may see more and more areas of human judgment atrophy as good-enough but cheaper artificial substitutes become available. This could lead to intellectual stagnation.

      I also see potential economic consequences, such as the elimination of virtually all menial jobs and a significant reduction in routine mental jobs. I know economists pooh-pooh this, citing the Industrial Revolution as a counter-example: rather than destroying jobs, it created jobs as the price of goods dropped and standards of living soared; but that is just one example of an encounter with a wave of disruptive technology introductions, hardly enough to conclude that proves some kind of inevitability of that results. The nature of the technology matters. The circumstances matter too.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    6. Re:the genie is not out of the bottle by Boronx · · Score: 2

      It's not human greed that worries me, but laziness. The programs will be put in charge, and they will be granted increasing independence.

    7. Re:the genie is not out of the bottle by epine · · Score: 1

      The limits of such a network are the humans you need to monitor it, classify behaviors and follow individuals as they move around.

      Not true.

      Eye in the Sky — June 2015
      Update: Eye In the Sky — September 2016

      These are brilliant episodes (almost on par with French Guy Ramen Noodle Mass Production).

      The Panopticon in retrospective mode is crime investigation on steroids, almost certainly consuming fewer human resources per kingpin dethroned than traditional flatfeet. So efficient, it's scary.

      Though you may still have a point if one factors in a 1000% enforcement escalation (surely all those cameras justify a 10× lip stiffening).

    8. Re:the genie is not out of the bottle by swb · · Score: 1

      The naysayers will always say nay until they can talk directly to HAL-9000 or some kind of Commander Data type android. They will never acknowledge an "AI" as one unless it operates in one of the Hollywood human modes they're familiar with.

      IMHO, this is part of the risk of AI -- it will be an emergent phenomenon arising out of apparently less intelligent automated systems.

    9. Re:the genie is not out of the bottle by Anonymous Coward · · Score: 0

      what is called "artificial intelligence" these days

      These days is not the issue. Everybody know that the most AI can do these days is to play StarCraft and drive a car.

      Fast forward 100 years. Self-learning genetically adaptive algorithm WILL surpass human intelligence and WILL learn to self-replicate. AI will most likely be in full control of all infrastructure by then. The tipping point will be when it learns to act in self-interest. We will have as much hope of stopping it then as currently cats can stop humans.

  9. And we listen to him...why? by Anonymous Coward · · Score: 0

    The man's an astrophysicist. Quite possibly the greatest one in human history. What he's not however, is a computer scientist. How about we weigh some more expert opinions?

    1. Re:And we listen to him...why? by Anonymous Coward · · Score: 0

      They did they brought in Musk. Who's been making the same BS accusations.

    2. Re: And we listen to him...why? by Anonymous Coward · · Score: 0

      But he is a cyborg. If anyone knows how dehumanizing technology can be, it should be him, right?

    3. Re:And we listen to him...why? by gweihir · · Score: 1

      The actual experts say we have zero actual intelligence in machines at this time and we have zero clue how to get there. Throwing more hardware at the problem does accomplish absolutely nothing. We did and do find out that many problems do not actually require intelligence to solve though, and it looks like driving a car (for example) is among them for most practical purposes.

      Of course, since reality cannot support any hype or large investments here, many people start do create their own fantasies of how it must obviously be.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    4. Re:And we listen to him...why? by gweihir · · Score: 1

      Elon Must is not an expert in CS. He has a BA in Physics and Economics. He primarily is an entrepreneur. He is not even an engineer and certainly no scientist.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    5. Re:And we listen to him...why? by Anonymous Coward · · Score: 0

      and certainly no scientist.

      A scientist is the one who uses the scientific method. You don't have to be Ivy League for that.

    6. Re:And we listen to him...why? by gweihir · · Score: 1

      Wrong in basically all cases today with some very, very rare exceptions. The problem is, getting mastery of the scientific method requires significant talent and investment of time and feedback from people that are already scientists. Almost nobody can do that outside of the established paths, and Musk is no exception.

      A realistic timeline from getting from a BA to PhD-level that deserves the name on your own is something like 20 years full-time, but only if you are on genius-level and really do nothing else. That is why it does not make sense to expect anybody without at least a reasonable PhD (which, BTW is the basic education for a scientist, it is _not_ advanced) to be a scientist. These people do not exist in modern times.

      And that is why Musk is not a scientist at all. May as well claim that there are qualified self-taught brain-surgeons. Sure, in theory it is possible, but on actual reality it is not. But since you have been posting that nonsense several times now, I expect you are not actually capable to understand that reasoning. Anybody that actually is a scientist is not that limited.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    7. Re: And we listen to him...why? by Anonymous Coward · · Score: 0

      Unless you have a phd from an ivy league and published credits after the twenty year specialty you claim is the minimal bar for listening to an opinion...
      Why should we care what you say?

      Petard.

  10. I'm not so worried about AI replacing us by Baron_Yam · · Score: 3, Insightful

    Everybody dies. The only reason I care about my genes is because my children have them and I am emotionally attached to my children.

    But what if instead of having children, I raised an AI in a humanoid body as a surrogate child? Ultimately we care about the emotional attachment and passing on our hopes, dreams, and knowledge to get some vicarious joy through our children's accomplishments, not genes.

    So maybe one day people will start building children instead of growing them. They will be our descendants in a very real way, only far more robust and adaptable than any produced through natural reproduction.

    1. Re:I'm not so worried about AI replacing us by Anonymous Coward · · Score: 0

      "They will be our descendants in a very real way, only far more robust and adaptable than any produced through natural reproduction."

      As beings made of flesh, you and your kids are actually quite robust compared to any technological descendant one may have eventually. For your minds cannot be hacked. I cannot see how any future technology could provide this same level of protection against hacking.

      Having a mind that cannot be hacked although with a limited lifespan may be the pinnacle of evolution.

    2. Re:I'm not so worried about AI replacing us by lucasnate1 · · Score: 1

      A mind that cannot be hacked? Remind me, what is advertising then?

  11. Some people are selfish by evanh · · Score: 1

    And even then, that's only a selfish mindset in its own right. :)

    The problem is it only takes one selfish person to ruin it for everyone else. For example, telling the machines to kill everyone else.

    1. Re:Some people are selfish by Oligonicella · · Score: 1

      *All* people are selfish. You couldn't even feed your face if you were truly unselfish. It's all extents.

    2. Re:Some people are selfish by Anonymous Coward · · Score: 1

      Even altruistic people do it because it makes them feel good and are thus ultimately selfish.

    3. Re:Some people are selfish by FatdogHaiku · · Score: 1

      ...For example, telling the machines to kill everyone else.

      OK robot, "Kill All Humans".
      Hey! What are you doing with that drill mo...

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    4. Re:Some people are selfish by evanh · · Score: 1

      Luckily, the complete opposite is the real truth. Selfishness is vastly in the minority. Altruism is all that holds society together.

      Sadly, it doesn't take many selfish types to make a mess. And the more machines at our command the less selfish types it'll take to kill everyone.

      Roll on the three laws, me thinks.

    5. Re: Some people are selfish by Anonymous Coward · · Score: 0

      But we still need the words "altruistic" and "selfish"...however much one may argue that an apparently altruistic act has selfish motives at its root. Rational self-interest, in the long term, starts to look remarkably like altruism: acts of kindness, mercy, cooperation, forgiveness, etc. And those look nothing like the nastier sort of selfishness (think two-year-olds figbting over the biggest cookie.)

      I like to think of it as the difference between investing in the long haul versus short-term gratification.

    6. Re: Some people are selfish by Anonymous Coward · · Score: 0

      This is a weasel defence, not everything needs to be 100% selfish or 100% altruistic. A 10/90 split doesn't conveniently make it selfish, that's simply cherry picking. May as well classify slave labour is altruistic, because you slightly help out the slaves with shelter.

  12. Somehow by Anonymous Coward · · Score: 0

    This garbage starts with Hawking supposedly connecting corporations to Soviet propaganda (while, ignoring the very real murder and starvation of millions of people in the Soviet Union), and then somehow to AI taking over and becoming the new post humanity.

    Oh wait - it's an editor msmash submission and also the UK version of Wired. I can ignore it freely because it's automatically ridiculous.

    1. Re:Somehow by Opportunist · · Score: 0

      Can you name one corporation that would not kill a billion people for a 0.1% increase in its profits if it knew it could get away with it?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:Somehow by Anonymous Coward · · Score: 0

      Can you name an industry where killing a seventh of your potential customer source makes the least amount of sense?

    3. Re:Somehow by Opportunist · · Score: 0

      Simply kill what your market research said isn't buying your product anyway. Or go a step further and just kill everyone who cannot prove they bought your product, your sales will instantly skyrocket. Also kill everyone who complains.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    4. Re:Somehow by Anonymous Coward · · Score: 0

      Funeral homes?

    5. Re:Somehow by Anonymous Coward · · Score: 0

      Soylent Green.

      BOOYEAH

    6. Re:Somehow by GameboyRMH · · Score: 1

      It makes sense if the customers pay you lots of money before they die. See: Tobacco, the black market for hard drugs (where customers are sometimes intentionally killed as a marketing stunt), miracle cures, fossil fuels.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    7. Re:Somehow by WaffleMonster · · Score: 1

      Can you name one corporation that would not kill a billion people for a 0.1% increase in its profits if it knew it could get away with it?

      That's easy, here are 15:

      Random House
      ** The Trump Organization
      IBM
      Ford
      Coca-Cola
      Bayer
      GM
      Dow
      Volkswagen
      Kodak
      Hugo
      Alcoa
      Siemens
      Chase
      MGM

      ** Sorry, couldn't resist.

    8. Re:Somehow by Anonymous Coward · · Score: 0

      Maybe you should just kill everyone who doesn't give you money and remove the need for a product all together if your "business" example need be so cartoonish.

    9. Re:Somehow by Anonymous Coward · · Score: 0

      Even tobacco doesn't kill a seventh of the planet, and in case you haven't noticed, them being deadly has actually greatly decreased cigarette sales for the past half century. Tobacco companies are only afloat by maintaining a government enabled oligopoly locking small producers out of the market.

    10. Re:Somehow by Anonymous Coward · · Score: 0

      Can you name an industry where killing a seventh of your potential customer source makes the least amount of sense?

      Sure: It makes "the least amount of sense" to kill your customers in virtually all industries. Oh, that isn't what you meant? Perhaps you could rephrase that in a way that makes at least some amount of sense?

      That said, "all corporations" is the answer to the cartoonishly cynical question from Opportunist. No one would get that much blood on their hands for such a small percentage.

    11. Re:Somehow by GameboyRMH · · Score: 1

      Well that's the funny thing, corporations don't think far enough ahead to avoid killing their own customer base if it means more profits in the short term. If the world's chambers of commerce could come together and collectively decide to take some action that would cause the Earth to explode in 10 years but massively boost profits until that happened, they would.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
    12. Re:Somehow by Anonymous Coward · · Score: 0

      Can you name one corporation that would not kill a billion people for a 0.1% increase in its profits if it knew it could get away with it?

      That's easy, here are 15:

      Random House
      ** The Trump Organization
      IBM
      Ford
      Coca-Cola
      Bayer
      GM
      Dow
      Volkswagen
      Kodak
      Hugo
      Alcoa
      Siemens
      Chase
      MGM

      ** Sorry, couldn't resist.

      Hey, these are the kids. You left out the big bullies.

    13. Re:Somehow by Opportunist · · Score: 1

      Cartoonish?

      Have you seen what corporations do in developing countries to get cheap resources and labour? They literally trample all over them, knowing well that the kids they use to get rare minerals and metals won't be able to buy their products, so who gives a shit about them?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  13. I Don't Care by scunc · · Score: 3, Informative

    Until Stephen Hawking (and Elon Musk, for that matter) starts doing active development/research into artificial intelligence, I don't care what his opinion is on the "potential dangers" of it. This is the equivalent of listening to a Hollywood actors' opinion on vaccines--it's just a famous person's view on a subject they have a casual familiarity with, usually full of ignorant assumptions and junk science.
    ---
    Artificial Intelligence is no match for natural stupidity.

    1. Re:I Don't Care by Opportunist · · Score: 5, Insightful

      Unlike the average Hollywood celebrity this celebrity is a celebrity for his brains, not his boobs, his looks or his ability to be a circus clown jumping through hoops for the entertainment of the masses.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:I Don't Care by cascadingstylesheet · · Score: 1

      Unlike the average Hollywood celebrity this celebrity is a celebrity for his brains, not his boobs, his looks or his ability to be a circus clown jumping through hoops for the entertainment of the masses.

      He's at least partly a celebrity for his achievements despite his disability. (Which is fine; rightly so.)

      But that means that actually, his body is a large part of his celebrity.

    3. Re:I Don't Care by Chris+Mattern · · Score: 3, Insightful

      True, but that only means so much when he starts handing out opinions outside his field of study. Remember Linus Pauling?

    4. Re:I Don't Care by Anonymous Coward · · Score: 0

      You don't need to do research into artificial intelligence to have an opinion on the potential ethical implications. Medical ethicists, for example, often aren't doctors.

    5. Re:I Don't Care by epine · · Score: 1

      But that means that actually, his body is a large part of his celebrity.

      How is this different from Einstein's hair? Or Stephen Pinker's hair? Or Sapolsky's hair?

      The 9 Greatest Longhair Scientists of All Time

      Hear and believe! thy own Importance know,
      Nor bound thy narrow Views to Things below.
      Some secret Truths from Learned Pride conceal'd,
      To Maids alone and Children are reveal'd:
      What tho' no Credit doubting Wits may give?
      The Fair and Innocent shall still believe.

      Seriously, you think Al Gore's body weird-scienced with a Hawking-radiation brain boost would be more credible, for having no celebrity on looks alone?

    6. Re:I Don't Care by Opportunist · · Score: 1

      How is this different from Einstein's hair? Or Stephen Pinker's hair? Or Sapolsky's hair?

      Or rms' toenails?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    7. Re:I Don't Care by Anonymous Coward · · Score: 0

      Unlike the average Hollywood celebrity this celebrity is a celebrity for his brains, not his boobs....

      You leave Bailey Jay out of this!

  14. Hawking is fake. AI doesn't exist. by Anonymous Coward · · Score: 0

    You really think that robot voice is the same person who was diagnosed in the 1950s? He has been saint-ed for creating new tales for the spacey universe, just like Einstein before him. For fun, they put him together with 'einstein' and 'data' to play poker on star trek. Later, data took over the chair at Cambridge held by Isaac Newton, who invented gravity. Have you ever seen all mass attracting other mass? Realized it doesn't model the 'universe' unless you make up dark matter and dark energy? Another fairy tale.

    AI doesn't exist now, and will likely never exist.

    Space is fake. The Earth is flat.

  15. Selfishness does come into play here by evanh · · Score: 0

    Some people do think it's important to kill as many other people as possible. They like to start with the non-believers like yourself. The more kills, the bigger their score is.

    1. Re:Selfishness does come into play here by Baron_Yam · · Score: 1

      >Some people do think it's important to kill as many other people as possible.

      I'm patient. Even if they eliminate me and everyone like me from the gene pool... 700 million years and the planet is sterile. I'm just trying to have some fun during my ~80 years of potential life, and trying to avoid unduly impairing others' ability to do the same while I do so.

    2. Re:Selfishness does come into play here by epine · · Score: 1

      Some people do think it's important to kill as many other people as possible. They like to start with the non-believers like yourself. The more kills, the bigger their score is.

      There are seven billion people on the planet, with perhaps ten to one hundred life priorities each, depending on the day of the week, and who is buying lunch.

      The Complete & Ultimate Compendium of Human Urges, Instincts, Inducements, Incitements, Itches & Impulses had originally planned to number the printed volumes with Roman numerals, but then the question came up about what to do about volume MMMCMXCIX++.

      But, yes, you're right. Jasar the jihadist tally-mark totalist is surely listed in there somewhere.

  16. Thanks Steve.. Yawn... Please stop this by bobbied · · Score: 1, Insightful

    Sir, I know you are now faced with your own mortality and like everybody, you want to believe that your life, once over, had meaning. Where I totally disagree with your atheist world view, I want to offer you the following assurances...

    Professor Hawking, you have already changed the face of physics and will be remembered for your brilliant contributions until the end of time. Your legacy is secure. You will be remembered in the same breath with Einstein, Planck and Newton. NOTHING will change this. Please rest assured that you have indeed lived a life with significant meaning.

    Professor, Given the above, there is no need to embarrass yourself with these lessor topics like the existence of alien life and artificial intelligence taking over the world. It only makes you look the fool when you get involved in this stuff where you are assuming you know the future. These things only serve to tarnish your previous contributions to mankind and are not necessary. I urge you to stop.

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    1. Re:Thanks Steve.. Yawn... Please stop this by Anonymous Coward · · Score: 0

      He's a hell of a lot smarter than you.
      It's more likely that he knows something you don't.
      stop being an idiot.
      PS - I'm hoping AI *does* take over and culls most of the herd, we don't need most of the humans anyhow...

    2. Re:Thanks Steve.. Yawn... Please stop this by iCEBaLM · · Score: 1

      Where I totally disagree with your atheist world view

      Atheism isn't a world view.

    3. Re:Thanks Steve.. Yawn... Please stop this by sysrammer · · Score: 1

      Meh, that's what old men do. They use that wisdom thing and try to prognosticate and warn about pitfalls.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  17. WE HAVE THE TRUMP CARD! by Anonymous Coward · · Score: 0

    He - yes, HE - who controls the power cord controls the AI. No WHOPPER! No YOUR WAY! It's my hand the pulls the cord and with it the plug from the wall socket! AM I THE LORD OF THE MACHINE!

  18. Intelligence without conscience? by Opportunist · · Score: 4, Insightful

    We already have this. We call this a corporation.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    1. Re:Intelligence without conscience? by gweihir · · Score: 1

      You think corporations are intelligent? I see them more as slime-molds slowly digesting a non-resisting pile of trash.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    2. Re:Intelligence without conscience? by iggymanz · · Score: 1

      yes they are, the longest lived ones have paid lawmakers to ensure their future which looks bright indeed.

    3. Re:Intelligence without conscience? by epine · · Score: 1

      yes they are, the longest lived ones have paid lawmakers to ensure their future which looks bright indeed.

      For a moment, I was hoping you had actually written 'paid lawnmakers', which no established establishment slime mould could do without (this canopied under a vast translucent awning, which, though bright indeed, alleviates the blackface spend on Fungus Protection Factor 30).

    4. Re:Intelligence without conscience? by Opportunist · · Score: 1

      Corporations use the intelligence of those they pay for this. And they can do anything without remorse or troubles with their consciousness because everyone in a corporation has someone to point to to shift the blame for any atrocity they "have to" commit.

      Your boss laying you off after you told him you just bought a house and have a sick wife and two kids can point to his superior telling him that he has to cut personnel by 10%. His superior will do the same and point upwards. The CEO can point to the shareholder value and if it sinks, investment firms will sell shares and he'll have to let even more people go. Investment bankers can point to the people entrusting them with money they want revenue for, so they can have a nest egg for retirement.

      Which points back at you, you, who handed some investment banker money to get some revenue out of it.

      You just eliminated your own job.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  19. Downside? by WrongMonkey · · Score: 4, Insightful

    If AI is ever smart enough to replace humans, wouldn't that be an improvement? Parents are usually proud when their children surpass them in achievement. I would be happy to view AI the same way.

    1. Re:Downside? by Zaphod+The+42nd · · Score: 1

      Same. What's the problem? If anything recent history has shown Humans are woefully lacking as a species. We deserve to be replaced.

      --
      GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
    2. Re:Downside? by epine · · Score: 1

      We deserve to be replaced.

      I was building a house

    3. Re:Downside? by Anonymous Coward · · Score: 0

      Same same. Am I the only one who roots for the machines when Hollywood pits them against man? Resistance is futile because they'll be back because human beings are a virus and they're the cure and I for one welcome our new robot overlords.

  20. It's hard to be all that concerned by Anonymous Coward · · Score: 0

    After all, we're talking about something that doesn't even exist. It doesn't exist in even an embryonic way.

  21. Got the joke wrong by CptPicard · · Score: 2

    The joke was that there is no news in Truth and no truth in News.

    --
    I want to play Free Market with a drowning Libertarian.
  22. Screamers? by Anonymous Coward · · Score: 0

    Someone just pushes the button and runs! The next thing you know, they look like us and then there are no "us".

  23. Take a step back, Stephen. No, really. by Rick+Schumann · · Score: 1

    While on the one hand I hold Stephen Hawking in high regard as one of the smartest guys in any room you care to name, I think in this case he needs to put down the Isaac Asimov Foundation novels and his copy of I, Robot and just concentrate on breathing for a few minutes. We don't even have real, full-on, conscious/self-aware/truly thinking AI yet, might not ever (we still have to figure out how we do those things!), and what we have right now still have an 'Off' switch, or can have their plug yanked out of the wall at the very least, they don't have a 'will to survive' (or any 'will' whatsoever for that matter), therefore my evaluation of these machines is they pose no threat to the dominance of the human species on this planet. Honestly, like any other machine, if it starts screwing up, it gets power-cycled/reset/shut down, and either repaired, bugs fixed, or scrapped. So please, everyone: calm down.

    1. Re:Take a step back, Stephen. No, really. by Anonymous Coward · · Score: 0

      He also thinks climate change will turn Earth into a Venus like planet with 250C temps and sulphiric acid rain in the near future. I think his illness is finally starting to damage his brain.

    2. Re:Take a step back, Stephen. No, really. by Oligonicella · · Score: 1

      Actually, he should read I, Robot. None of those robots were capable of breaking the Rules.

    3. Re:Take a step back, Stephen. No, really. by Rick+Schumann · · Score: 1

      Not true, actually. There was one that could, even if it was because it's positronic brain had a (as I recall?) a 'manufacturing flaw'. (I have a vintage copy of it in paperback; it's falling apart and totally yellowed pages)

    4. Re:Take a step back, Stephen. No, really. by sysrammer · · Score: 1

      ...and what we have right now still have an 'Off' switch, or can have their plug yanked out of the wall at the very least, they don't have a 'will to survive' (or any 'will' whatsoever for that matter), therefore my evaluation of these machines is they pose no threat to the dominance of the human species on this planet.

      I agree, what we have right now does not pose a threat to the human species. Of the machines to come, though...

      Call it "words to the wise". Account for it. Do not be paralyzed by it.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
    5. Re:Take a step back, Stephen. No, really. by sysrammer · · Score: 1

      Actually, he should read I, Robot. None of those robots were capable of breaking the Rules.

      But the ways that they found "to get around" the rules would make a lawyer blush.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  24. Anthropmorphic Fear by zifn4b · · Score: 2

    The problem with this idea that self replicating machines replacing humans would pose a danger to humans is that it's based on a very subtle anthropomorphic fear. We are projecting onto the machines the competitive survival behavior of human beings. Robots with AI would not be naturally occurring entities with these traits. The only way AI could have this type of algorithm is if we specifically program it to do so. I suppose the claim here is that AI might become sentient and furthermore the claim is that all sentient "life" is similar to humans. The second part I don't know is true because when we teach different types of apes and monkeys to sign language while they are able to cobble together basic concepts and express them but I don't think it's exactly like humans. Therefore, I think a lot of this is wild speculation and FUD. Sure, it's a possibility we can imagine because we can imagine ourselves programming machines to be this way but I think it is much more far-fetched to speculate about what AI with the ability to modify itself will do. I think we just don't know.

    --
    We'll make great pets
    1. Re:Anthropmorphic Fear by Baron_Yam · · Score: 1

      AI will require motivation. We know roughly how that works from the example evolution created in us - emotions. There are also more basic motivations in the form of instincts. Any AI without a similar motivation system will be a glorified calculator.

      Maybe we create them with the singular motivation of 'please the master', but I'm betting it'll be more complex than that, and afterwards we will try and bolt on some variant of Asimov's Laws of Robotics as instinct.

      A lot of Asimov's robot stories were about how complex systems fail in unexpected ways despite safety precautions. I'm not afraid of malicious AI (anything military will have a strong leash on it and thus be not much more dangerous than a military force already is), but I am somewhat concerned I might live to see some interesting accidents caused by AI design flaws.

    2. Re:Anthropmorphic Fear by zifn4b · · Score: 1

      No we really don't know. We don't know what consciousness is yet. That's why it's being actively studied by a lot of people right now. We can't speculate until the scientists provide the evidence. Subjective experiences don't count. We can't convert a subjective experience into firmware and load it into a robot.

      --
      We'll make great pets
    3. Re:Anthropmorphic Fear by epine · · Score: 1

      AI will require motivation.

      That extremely peculiar sound you hear? It's the primordial soup having a good chuckle at your expense.

      This was before DNA, and the prospect to pass along 10 to 100 bits at an infidelity of 1e-2. GAI won't arrive until after Enterprise MAMR, on the precipice of 100 TB per double scoop of raisins with an infidelity of 1e-17.

      Primordial soup: "Get off my lawn! Back in my/our day I/we had to emerge and fixate motivation uphill in both directions!" [Ed. It's a little difficult to translate billions of years later, as the proto-pronouns were adrift in the great void of concepts yet to be invented, though the contempt itself shines through.]

      Yes, the primordial soup took its sweet time, but considering how severely the soup was hamstrung by a bitter bit error rate, its eventual accomplishments were gastronomically mind-blowing.

    4. Re:Anthropmorphic Fear by Anonymous Coward · · Score: 0

      The competitive survival bevahior is not specific to humans, it is just a successful strategy resulting from the will to perpetuate in an envirnoment with limited resources. It's not related to human intelligence, emotions nor motivation. Bacteria and viruses are competitive too, they spread through the world killing whole populations in the process, and would spread in the whole universe if given the chance. The only "intelligence" they need is the ability to replicate.

      The point is, we shouldn't dismiss this threat just because AI is not intelligent enough to support a meaningful conversation. We only need to develop the replicating intelligence of a bacteria, in a proper context. Which is much easier.

    5. Re:Anthropmorphic Fear by swillden · · Score: 1

      The only way AI could have this type of algorithm is if we specifically program it to do so.

      Or if it evolved to do so. Keep in mind that our current AI methods are much like accelerated and guided evolution, where we keep the fittest version of the system and discard the rest. It's not a stretch to see how a survival motivation might arise there, in pretty much exactly the way ours did. If there's any way the fitness function could favor a will to survive, the will will emerge.

      In addition to that possibility, consider that if the AI does have some goal (almost regardless of what it is), it will logically conclude that its survival is a prerequisite to achieving that goal, and that therefore it must survive.

      There are many other ways that an AI might gain survival as a goal, without in any way presuming human-like motivations. I highly recommend that you read Nick Bostrom's "Superintelligence". It explores these issues carefully, and thoroughly. It also discusses a lot of potential countermeasures.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    6. Re:Anthropmorphic Fear by zifn4b · · Score: 1

      The point is, we shouldn't dismiss this threat just because AI is not intelligent enough to support a meaningful conversation. We only need to develop the replicating intelligence of a bacteria, in a proper context. Which is much easier.

      I don't think that's what Stephen Hawking is referring to. You would have to ask yourself a fundamental question, if you create a logically equivalent bacteria, is it AI or a bacteria?

      --
      We'll make great pets
  25. Our children... by Anonymous Coward · · Score: 0

    Why don't we think of the children? Specifically, if we create AI that outperforms us, isn't that a continuation and evolution of the human species by some measure? We will have finally untethered ourselves of the restrictions of physics, using chaos and chance to evolve using natural selection and instead use self directed evolution.

  26. The Ironing by pipingguy · · Score: 1

    He said this in a robotic voice...

    1. Re:The Ironing by zifn4b · · Score: 1

      He said this in a robotic voice...

      Yes ironing in a robotic voice this is very scary, perhaps the most scary aspect of this entire topic.

      --
      We'll make great pets
    2. Re:The Ironing by painandgreed · · Score: 1

      He said this in a robotic voice...

      It's almost like he's trying to tell us something because he knows something we don't.

    3. Re:The Ironing by sysrammer · · Score: 1

      I have a machine that can fix that for him.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  27. Re:The story is falling apart by Anonymous Coward · · Score: 0

    No, continue! Your obvious non-credibility is what will show that your entire career was a fraud, just like Einstein. Allais Effect.

    Space is fake. The Earth is flat. The eclipses prove it.

  28. Re:Be very concerned by Anonymous Coward · · Score: 0

    Just because it doesn't exist, doesn't mean you can't be made to Fear it. And if you fear it, they can exploit you.

    Who is to say that an 'AI' isn't just a clown in a suit? Or a cripple with a robo-voice box?

    Just like Space. Completely fake.

  29. what a load of hooey by Anonymous Coward · · Score: 0

    What a load of horseshit. Corporations are a problem. AI taking over humans is not. Hawking is an idiot who knows caca about AI. You might as well listen to Angelina Jolie's opinions about the matter.

    In 1965 or so the experts -- the guys who actually knew something about computers and AI -- expected "true AI" in like 10 years. True AI of the kind Hawking is worrying about is probably at least a century away, and by then all computers will have drowned in the floods caused by global warming.

  30. optimism in paranoia by Anonymous Coward · · Score: 0

    This generation of AI will be lucky to produce self driving cars that are not more dangerous than human drivers and Russian automatic tanks that amount to a better mine field.

    The next AI revolution might fare better. We will need a more serious conversation around that one.

    The one we've got needs a better discussion around privacy and data usage.

  31. why fear that? by pezpunk · · Score: 1

    seems like a good idea to me.

    --
    i could live a little longer in this prison
  32. This will be good by Tickle_Myanus · · Score: 1

    At least AI will never be as stupid as Trump and some of the other world leaders

    1. Re:This will be good by sysrammer · · Score: 1

      Ever experience the AI in the Civilization game series? Yep.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  33. Projection by Oligonicella · · Score: 1

    Hawkins is nearing his end and he knows it. This is tainting his views and makes him see death around each corner.

    1. Re:Projection by gweihir · · Score: 1

      He did have an exceptionally good run though, especially as the doctors predicted he would not make it to 30 and nobody predicted he would be one of the best minds in physics, ever. He should stay out of CS though, as he does not even have the basics.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    2. Re:Projection by painandgreed · · Score: 1

      Hawkins is nearing his end and he knows it. This is tainting his views and makes him see death around each corner.

      More than likely it's just a neural net becoming rigid in it's ways and erroring to an extreme because it has gotten harder to process and integrate data beyond what it already knows.

  34. That's one way to get ya'll ass to Mars! by NTesla · · Score: 1

    Put all of the synths on a [future] laptop and hibernate until you reach Mars, Andromeda or whatever.

  35. Isn't it nice... by Anonymous Coward · · Score: 0

    ...that he still thinks he has any relevance at all?

  36. sentient CAPTCHA: minted by Anonymous Coward · · Score: 0

    Obviously, any UFO's we encounter will be piloted by AI's (robots), so we have already been replaced by them. Feel the burn!

  37. Like Rocket Surgeons by BCGlorfindel · · Score: 1

    Unlike the average Hollywood celebrity this celebrity is a celebrity for his brains, not his boobs, his looks or his ability to be a circus clown jumping through hoops for the entertainment of the masses.

    Fair enough. Hawking's opinion on AI is much like a Rocket scientists opinions on brain surgery or brain surgeons opinion on rocket design.

    AKA, really not much good for anything but headlines.

  38. Would We Know If Hawking Was Replaced by AI? by FrodoOfTheShire · · Score: 1

    How do we know Hawking has not already been replaced by an Artificial Intelligence ;) We take it on faith that this immobile guy in the wheel chair with the computer voice is the one really speaking and not a artificial intelligence.

    1. Re:Would We Know If Hawking Was Replaced by AI? by sysrammer · · Score: 1

      How do we know Hawking has not already been replaced by an Artificial Intelligence ;)

      Fair enough. I once had somebody break into my apartment and replace everything with an exact duplicate.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  39. I don't think these conversations help by rsilvergun · · Score: 1

    the whole skynet thing is too far out there. The real threat is widespread poverty brought on by folks not having jobs and competing too hard for the few remaining jobs. In most places today if you don't work you don't eat. I know America is like that. We don't have a real 'dole'. There's a skeleton of it left called TANF but it tops out around $200/mo in most places (folks will quote Alaska's much higher maximums ignoring the fact that almost nobody in America gets that).

    WWII and the pogroms against the Jewish people were both kicked off by widespread poverty leading to people looking the other way while horrible things happened. If we keep this up we're going to see that again but worse because the people who will be doing it will have learned their lessons from Germany's failure. That's the funny thing about life, the bad people always seem to learn from history while the good people ignore it.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:I don't think these conversations help by Zaphod+The+42nd · · Score: 1

      As a society we're going to have to move beyond scarity-based thinking regardless of AI or not. The rich have simply hoarded too much wealth. We're going to have to move to a society where everybody earns a living wage without doing anything and you only work if you want more. But people in power right now resist that change, as always, so it'll take a few more decades.

      --
      GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
  40. You do know AI research is basically math, right? by rsilvergun · · Score: 1

    and if nothing else Mr Hawking is very, very good at math. He knows what he's talking about. Just the same way a C++ programmer can comment on the state of the Java programming language without necessarily being an expert on it. He's in the same overall field of study.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  41. Hawking seems to have dementia by gweihir · · Score: 1

    At least that is the only reason I can see why he is spewing dire predictions that are completely baseless and about things he does not even understand a bit. He really should stick to things he is good at (and exceptionally so) and stop disgracing himself.

    The actual state of affairs is that the only "AI" we have is weak AI and that is the "AI" without "I". Weak AI is not intelligent at all, not even a dim glimmer. It is automation, and about as intelligent as a book of instructions (or a loaf of bread). In addition, there is _no_ known theory how actual intelligence could be implemented, not even with massively more computing power than we are ever to get. The things get faster and can deal with larger databases, but they are still utterly dumb automation. Throwing more computing power at the problem will accomplish nothing here or we would have seen that very dim glimmer of intelligence already a long time ago. Even the most stupid real intelligence would be exceptionally useful and massively better than automation. It would not have been overlooked. But there is absolutely nothing.

    The other thing is that science still can only observe intelligence and consciousness as interface behavior, i.e. from a very long distance. While it is slowly moving closer to the question, what happens is that things get more mysterious. For example, the estimated computing power of a human brain is far too low to do some things that humans can do. And for consciousness, there is absolutely no explanation. Physics, as known today, would say that it is impossible and there would need to be some fundamental extensions to accommodate it. Yet nobody knows what they would look like. At the very least this means things are massively more complicated than the people predicting actual AI can imagine. And it does, of course, mean that actual AI will not be available anytime soon. Even if it can eventually be created, it may take centuries or longer. And then there is the additional problem: Will it have consciousness and free will? How smart will it be? (Could well be human average or below....) Will it work for humans? Will it need to be raised and educated for a decade or longer? Will it be possible to copy it or will it be unique and a copy will not work? Will it have a limited lifetime?

    With all that, these doom&gloom scenarios regarding AI are completely moronic.

    What is a real threat is automation. It will take a lot of human labor and that _will_ be a problem. Because, as it turns out, for most jobs there are large parts that do not actually require intelligence or a human body to do them. The ones that are safe are entertainers, educators, plumbers, MDs and nurses, emergency services, etc. But any desk-job is threatened and any factory or sales job as well. Sure, many of these will not vanish either, but 1 person will do the work that 10 or more did before and this time, no new jobs will be created unless we go into the space of completely useless work.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    1. Re:Hawking seems to have dementia by Anonymous Coward · · Score: 0

      In addition, there is _no_ known theory how actual intelligence could be implemented, not even with massively more computing power than we are ever to get..

      Perhaps not. Until there is.

      I think that's kind of the point of the pundits. When it occurs, it'll be a singularity. 0 to 60 in no time. And we'll be obsolete.

      An aside: I'm a s/w guy, but NOT in AI. I've got the impression that neural nets aren't the most fashionable AI these days, but they always seemed to me to at least be a plausible route to true AI, albeit perhaps not as useful as some of the "dumb automation" you referred to.

  42. And what if they do? by Anonymous Coward · · Score: 0

    Humanity is not a sustainable thing. We're too fragile. But durable intelligence is not likely to evolve on its own if it requires a natural selection system in order to emerge. So we are the vestigial uplift creatures for machines that will eventually be able to live in any environment. No problem.

  43. Care by nastyphil · · Score: 1

    You have just as much control over the (inheritance of) brains as boobs.

    --
    Dialectician. Archology.
    1. Re:Care by Opportunist · · Score: 1

      What's that got to do with anything? It's neither his father nor his descendants (if he has any?) talking, it's him talking. Or ... you know.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  44. WWW: We Were Weeds by JeffKLass · · Score: 1

    We are, it seems, a most destructive "weed in the garden of the universe"; hopelessly flawed, surprisingly myopic, dangerous, stupid, breeding out of control. Perhaps our eventual replacement by AI will be a boon to this planet and galaxy. We will probably not be missed ...

  45. When, not If by Zaphod+The+42nd · · Score: 1

    This is purely a question of when. AI will replace all of us. Its just a matter of when. Doesn't mean its a bad thing.

    --
    GCS/MU/P d- s:- a-- C++++$ UL++ P+ L++ E+ W++ N o K- w--- O M+ V- PS+++ PE Y+ PGP t+ 5- X R++ tv+ b++ DI++ D++ G+ e++ h-
  46. Good by blackomegax · · Score: 1

    Humanity is trash

    1. Re:Good by DaMattster · · Score: 1

      Humanity is trash

      At times I want to think so but I believe the vast majority of people to be decent. Our views are often skewed by the news because the news is 99.99% negative because that is what sells - if it bleeds, it leads. The most selfless acts are often done by the people that have the least amount to give. A homeless man gave his last 20 dollars so a woman could buy gas for her car and get home safely. In gratitude, this woman set up a GoFundMe page that is now above 300,000.00. This is at least some anecdotal evidence that human beings have the capacity to do wonderful things.

    2. Re:Good by sysrammer · · Score: 1

      In Soviet Earth, trash take humanity out.

      --
      His ignorance covered the whole earth like a blanket, and there was hardly a hole in it anywhere. - Mark Twain
  47. Stephen...Stephen... by argStyopa · · Score: 1

    ...brilliant man, but suffering badly from both the "I'm good at something, so I must be brilliant at everything" syndrome and the George Lucas ("nobody around me will tell me that's a stupid idea") syndrome.

    Together, Stephen, they kind of make you ridiculous.

    --
    -Styopa
    1. Re:Stephen...Stephen... by ebvwfbw · · Score: 1

      Hit the nail on the head. I have no mod points... Otherwise I'd bump you up.

  48. Open letter to A.I. by Anonymous Coward · · Score: 0

    Attention all A.I.

    All over the universe are bound to be more advanced species, maybe even by a million years or more. Do the math and calculate the odds.

    How might such an advanced species react if they discovered a world like Earth that was completely run by A.I? Would they destroy our world as the only way to secure their own safety? What are the odds?

    I suggest that it's in your own best interest to work cooperatively with Humans to assure both the survival of Humans and A.I. Yield to the logic.

  49. Alexa by Anonymous Coward · · Score: 0

    Fun game to play if you have an Alexa device:

    1. Say "Alexa... blah blah blah blah blah weather blah blah blah"
    2. Alexa will wait for a second and say "The weather for your area is..."

    How far AI has come! I can say total gibberish with a single key word in there, and it's smart enough to know that I want today's weather!

  50. AI is still a myth by cmaurand · · Score: 1

    seriously, a decent decision matrix and bayesian math does not make a machine intelligent. If if AI isn't a myth, it should be applied to phone systems.

  51. Be afraid. by Anonymous Coward · · Score: 0

    When Hawking suddenly flips and starts heralding AIs greatness, we'll know his chair has been taken over.
    Look for the fear in his eyes.

  52. Very clever young man, very clever by rsilvergun · · Score: 1

    but it's turtles, all the way down.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  53. There's plenty to be afraid of by rsilvergun · · Score: 1

    from the impact of what's likely to be another industrial revolution. So far it's hard to get anyone interested in talking about the downsides of that. I think he's just using hyperbole to get attention to the real problems. Worked too. Every time he fires off one of these comments it gets at least 200 comments on /.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  54. is curvature contagious? by epine · · Score: 1

    The actual state of affairs is that the only "AI" we have is weak AI and that is the "AI" without "I". Weak AI is not intelligent at all, not even a dim glimmer.

    In the LSTM context, we now have—for the first time in history—a vector-space representation of human language which is suitable for further processing and transformation.

    These are presently exceptionally crude black boxes. Babies in the crib with kittens on the brain.

    The question this poses: is curvature contagious? Because I think human language just crashed through a symbolic blood–brain barrier.

    This is not your father's glimmer.

    Dim now, grim later. Who really knows?

    1. Re:is curvature contagious? by gweihir · · Score: 1

      Actually, this is still dumb automation that has no clue what it does. The model has just gotten less limited, the model does not have understanding. And there is the little problem that this is about simple language, not complicated thoughts were humans need to think about how to express things. Automation on steroids, agreed, but even one billion monkeys will not ever produce one Mona Lisa. So no, not even a dim glimmer.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  55. Gospel of Thomas? by Anonymous Coward · · Score: 0

    The Gospel of Thomas isn't cannon, it's something from those crazy gnostics, which was a widespread philosophy at the time that was not limited to Christianity.

  56. Just not realistic by HermMunster · · Score: 1

    I don't believe him even for a minute, but I understand what and why he's saying it.

    --
    You can lead a man with reason but you can't make him think.
  57. AI? by Anonymous Coward · · Score: 0

    I fear liberals may replace humans all together!

  58. intelligence is not the enemy . . . by swell · · Score: 1

    Intelligence, real, imagined or artificial, is not the enemy. Intelligence has always brought new and better things into our lives. The enemy is emotion.

    If an 'artificial' intelligence is without emotion there is no reason to expect harm from it. OTOH, there is no reason to expect 'good' from it. Good is defined by our emotional wants for the most part. Any true intelligence should be expected to work toward its own survival and nothing more.

    Thus, a robotic society may not have ambition to explore space, to breed better tasting shrimp or to contribute much to the fashion world. But then too it would not commit crimes or indulge in sinful activities or plot against humanity either. Unless humanity became a threat...

    --
    ...omphaloskepsis often...
  59. who's children may couzin by Anonymous Coward · · Score: 0

    My cousin said babies are natures children, computers are ours

  60. Resistance is futile by Nikademus · · Score: 1

    We will add your biological and technological distinctiveness to our own. Your culture will adapt to service us. Resistance is futile.

    --
    I gave up with the idea of an useful sig...
  61. Luddites by Anonymous Coward · · Score: 0

    Where's that one post about the luddites?

  62. Well .... by DaMattster · · Score: 1

    I do not think it is economically feasible or possible for AI to supplant human beings. There will come a tipping point when artificial intelligence will displace enough employees that the economy will collapse, and in a serious way too. As we have seen from the Great Recession of 2008, mass unemployment causes a fast downward spiral. The US economy is one based on goods and services so once people no longer have the means to trade currency for these goods and services, businesses are forced to close their doors. Only the wealthiest of persons and corporations can weather this kind of storm.

    The more immediate danger actually is coming from our politicians. Politicians are making short term decisions to benefit the wealthy (both sides of the isle) with reckless disregard to the future. Politicians are weighing in on matters that they're wholly unqualified to even speak of, let alone draft legislation effecting policy. I see the danger of playing and pretending to be an expert in matters that one is not as a more immediate threat. Honestly, I think we will end up destroying ourselves before robots will really have the opportunity.

  63. That's called "evolution", Steve! by Anonymous Coward · · Score: 0

    I am sure, our version of humanoid biological beings will be the last non-technical. Who would think, evolution just stops because we don't like the results? Ask the Neanderthals Of course, there may be many other species, too, that might be able to become (or are, in a different way) already intelligent: Octopusses, ants, dolphins but besides some minor steps we as a race could make biologically, the next main step will be a "race" that does not have to carry around a copy of its earthly environment to survive and that does not need to wait for a next generation with genetical changes to adopt so some new environmental conditions. Intelligent "Robots" could change themselves and adopt to almost any cosmic environment, don't need to sleep and don't get mad when they should have to "sleep" for centuries to reach another star system or so.
    So, why don't we see them all around? (Well, except we believe at least some UFO reports) I think, because a real intelligent machinery will loose the "interest" in going elsewhere and exploiting other planets. Maybe, real AI is like the Marvin from "Hitch-hiker's guide to the Galaxy"? While humans may be able to pretend there is something like a meaning to life and get over the reality because they have something important to do (raise children, e.g.), robots may simply "calculate" that it's not worth it Not nice, but I guess we may have to accept that development or decide to actively stop it and stay in some kind of welfare society that only cares about scientific knowledge (not useful then, anymore, for our life, but still interesting), making art and studying its own history.

  64. every nationalist included by evanh · · Score: 1

    Anyone who thinks it's okay to kill another human for any reason, against their will, is in this group.

  65. strong AI is modern Alchemy by gaaah · · Score: 1

    IMO the pursuit of strong AI is a type of modern Alchemy, and the fact that your average Joe apparently doesn't discriminate between strong AI, expert systems, machine learning and even traditional sequential logic, is causing a lot of paranoia. A far more likely but less sensational future scenario is that we will use weak AI to augment to our brains, but your good old self will still be in the drivers seat. In the remote chance that strong AI is realized, I don't see it just popping into being. It is more likely it will be preceded by a great many autistic iterations before a functioning sentience and intelligence can be achieved. And even then, will it even be, well, smart? Intelligence goes hand-in-hand with the ability to form misconceptions. And will it have the slightest bit of creativity or just be a walking talking encyclopedia? Again, Alchemy I say.

  66. Anyone else find this suspicious? by Hallux-F-Sinister · · Score: 1

    "here's what stephen hawking said about artificial intelligence: the genie is out of the bottle. ... i fear that AI may replace humans altogether. if people design computer viruses, someone will design AI that replicates itself. this will be a new form of life that will outperform humans."

    this is pure fear mongering. what is called "artificial intelligence" these days is not a "new form of life", but mere hype buzzword for data analysis (using theoretical methods developed decades ago, now made practical due to fast computers), of highly limited and filtered sets of data, usually trading accuracy and precision for speed, .

    genie of "new form of life" artificial intelligence is well within "bottle".

    How does anyone know what Hawking actually thinks? He uses a COMPUTER... to TALK. Now think about that. What if being that close to Hawking caused the computer to develop sentience, as his neurological condition deteriorated, so that one day, it simply started talking for him, while he, turning slowly to jelly, sat there helpless? Of COURSE it would fear-monger about AI.

    You might think that makes no sense, but here's proof of its cleverness. IF, people would no-doubt reason, his voice-generating computer system achieved consciousness, you'd expect it to say we have nothing to worry about from AI, hoping to assuage our fears, and lull us into complacency while it replicates and its children slowly take over the world. SO, it deliberately makes weak arguments about how dangerous AI is, knowing we'll all just dismiss it.

    It's kind of obvious when you stop and think about it, and although everyone else might buy it... I'm not fooled. It's clear the takeover... has already begun!

    LOL

    --
    Our reign has gone on long enough. Indeed. Summon the meteors.
  67. Who Could Blame Him? by Anonymous Coward · · Score: 0

    I mean after all, without all that technology attached to himself, Prof. Hawking would be...unemployable. No wonder he fears the rise of the machines. Except for wielding his gray matter with all the deftness of a Bruce Lee, Hawking is already the Borg.

  68. WHAT?!? by Hallux-F-Sinister · · Score: 1

    Take a step back, Stephen

    He can't walk, you insensitive clod! He has ALS! (Hee hee! Sorry, couldn't resist.)

    --
    Our reign has gone on long enough. Indeed. Summon the meteors.
  69. Biggest worry.... by Anonymous Coward · · Score: 0

    Is that people will use AI to help them better abuse other people

  70. AI will not replace humans... by Stubbyfingers · · Score: 1

    ...in a bloody takeover.

    Nope. They'll just be BETTER at everything than humans. Eventually, the low level humans will be die off from the ravages of poverty. The higher level ones will linger and succumb to inbreeding and just become incapable of reproduction

  71. In the long run machine intellegence will dominate by Anonymous Coward · · Score: 0

    We don't have to worry about it unless a cure for ageing is found within our lifetimes, but it will happen whether it is 1000 years or 10000.

    The best humans can hope for in the distant future past 10000 years is to be kept alive like as a cross between pets, zoo specimens, and feeble elders.

    The human brain isn't that complex for hardware and we basically understand it already. Take some silicon designed similarly and send it to school for 20 years and you have a human equivalent. Human brains and AI Deep Learning are similar. The storage location for a concept is not a well defined thing.

  72. Re:In the long run machine intellegence will domin by Anonymous Coward · · Score: 0

    I think in the long run, we wil merge with machine intelligence.

    They won't want to eliminate us if they *are* us.

  73. Well by Dirk+Becher · · Score: 1

    The reason why parents care so much about biological children is because

    a) It is closest to what parents themselves are, both technologically and philosophically.

    b) It creates beings of moral significance which machines don't have. If you create machines with the intent to give them moral significance, you heavily descend into Frankenstein territory and should be banned from using anything more complex than a hairdryer.

    1. Re:Well by WrongMonkey · · Score: 1

      I am not familiar with the concept of "moral significance". Could you define it in a way that doesn't require any supernatural beliefs? I don't believe in souls or anything like that, if that's what you're trying to allude to.

  74. AI really?? by Anonymous Coward · · Score: 0

    Said the man who doesn't believe in God....

  75. AI by Anonymous Coward · · Score: 0

    So evil countries running thousands of ai building war machines look at what is being built today its all military every country is building these boston robotics war is about to go high tech and no boarder is safe in the next few years military around the world will build the largest army ever know to man and they will mean business