Slashdot Mirror


Killer Robots Will Only Exist If We Are Stupid Enough To Let Them (theguardian.com)

Heritype quotes the Guardian's science correspondent: The idea of killer robots rising up and destroying humans is a Hollywood fantasy and a distraction from the more pressing dilemmas that intelligent machines present to society, according to one of Britain's most influential computer scientists. Sir Nigel Shadbolt, professor of computer science at the University of Oxford, predicts that AI will bring overwhelming benefits to humanity, revolutionising cancer diagnosis and treatment, and transforming education and the workplace. If problems arise, he said, it will not be because sentient machines have unexpectedly gone rogue in a Terminator-like scenario.

"The danger is clearly not that robots will decide to put us away and have a robot revolution," he said. "If there [are] killer robots, it will be because we've been stupid enough to give it the instructions or software for it to do that without having a human in the loop deciding...."

However, Prof Shadbolt is optimistic about the social and economic impact of emerging technologies such as machine learning, in which computer programmes learn tasks by looking for patterns in huge datasets. "I don't see it destroying jobs grim reaper style," he said. "People are really inventive at creating new things for humans to do for which will pay them a wage. Leisure, travel, social care, cultural heritage, even reality TV shows. People want people around them and interacting with them."

22 of 143 comments (clear)

  1. stupid enough by PopeRatzo · · Score: 5, Insightful

    It's 2018. We've broken through the "stupid enough" barrier.

    --
    You are welcome on my lawn.
    1. Re:stupid enough by NoNonAlphaCharsHere · · Score: 4, Insightful

      We don't have a "human in the loop, deciding" for the current generation of neural net AIs. We don't have a human deciding over genetic algorithms, either. We create a fitness function, back propagation, whatever, and it's off to the races, unintended consequences be damned. The fact that we build/design along the lines of "improve yourself along criterion X" means we're slowly building an existential threat to ourselves whether we realize it or not. Clearly, a soldier-bot has two prime directives: 1) wipe out the enemy 2) stay functional, so you can wipe out the enemy.

    2. Re:stupid enough by Ol+Olsoc · · Score: 4, Interesting

      It's 2018. We've broken through the "stupid enough" barrier.

      We've completely demolished it.

      Olsoc's rule if killy stuff : If there is a method of killing people, Governments will rush to it like a dog to bacon. The more barbaric, the more bacon.

      Olsoc's second rule of killy stuff: Unless people are being killed, there isn't much point of warfare.

      Which brings us to Olsoc's third rule of killy stuff: War robots will be specifically designed to kill people.That is how humans work.

      --
      The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
    3. Re:stupid enough by grep+-v+'.*'+* · · Score: 2

      It's 2018. We've broken through the "stupid enough" barrier.

      Not yet. Just wait, it'll get better. We're All Getting Dumber, Says Science.

      Peak oil? Peak coal? I've said we've been at peak intelligence for awhile now. Kids don't have to think, students have been taught to regurgitate facts and Google is quite good at answering questions. Now the answer being correct or incorrect, that's literally besides the point. If I FEEL that it's a right answer, then it is. Don't disrespect me just because I'm stupid! You must conform to MY way of thinking to keep from hurting my feelings.)

      Also label warnings on everything. Don't drink bleach! Don't eat batteries! (But add it to chicken and it gives that tang you can't get anywhere else.)

      Patents. "Sorry, I've got a patent on thoughts, you'll have to quit doing that."

      Laws. It's illegal under section 1495.24 paragraph 3 to help that wild animal. It's also illegal under section 1495.24 paragraph 4 to NOT help that wild animal. (Laws generally seem to be individual reactions to problems and not as a cohesive whole. Someone should compile all of them together to see how many logic errors they contain.)

      Basically, life is so easy in the US (I'm waiting for the complaints) that we can worry about having 998 genders while we munch on our "fries with that".

      Let's drop some people (Me included -- I don't actually realize how good we've got it either!) over to North Korea or one of the lesser Russian states and see how easy it becomes.

      NOW, BACK TO ROBOTS:, I say we build them and let nature take it's course (The quick/smart/lucky ones live.) People liked Thanos killing half of everyone to save half of everyone? Well here we go. Or to save the planet simplify matters even further -- kill everyone with (without) a penis. The problem is solved within two generations.

      --
      If the universe is someone's simulation -- does that mean the stars are just stuck pixels?
  2. Not much of a comfort. by religionofpeas · · Score: 2, Insightful

    We clearly are stupid enough.

    1. Re:Not much of a comfort. by Hognoxious · · Score: 5, Funny

      Speak for yourself, you insensitive clod!

      I'm just lazy and careless.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    2. Re:Not much of a comfort. by gweihir · · Score: 2

      We clearly are stupid enough.

      As a group, most definitely.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  3. The rich are going to want automated kill bots by rsilvergun · · Score: 4, Interesting

    because they'll be cheaper than maintaining a huge standing army and you don't have to worry about a general taking over. The engineers who keep the things running will lack the charisma and ambition to overthrow the current ruling class (they're part of the merchant class after all and will be doing well enough).

    The way to stop this crap is pretty clear. Declare all human beings deserving of a decent quality of life and then make that happen. Get over the fact that you'll have a few surfer dudes and wellfare queens that don't work very much or at all (shouldn't be too hard, most of us have long since stopped getting mad at the idle rich with inherited wealth). If you want a population smart enough and paying enough attention to see this kind of crap coming and stop it you need to take care of their basic needs first. Otherwise they'll be too busy fighting for survival to do anything about it, which is kind of the point.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  4. It's not a matter of stupid by Jeremi · · Score: 5, Insightful

    People won't make or deploy killer robots "by accident". If a robot goes on a killing spree, it will be because somebody deliberately programmed it to go on a killing spree.

    Are people perverse enough to make a machine that will deliberately kill other people, either based on specific entry-conditions or even just randomly? The existence and widespread use of land mines and car bombs demonstrates that the answer is yes.

    So really we know the answer; we're only arguing about an implementation detail: exactly how sophisticated people will allow their automated killing machines' triggering-mechanisms to be.

    --


    I don't care if it's 90,000 hectares. That lake was not my doing.
    1. Re:It's not a matter of stupid by gweihir · · Score: 3, Insightful

      Not at all. If machines have code and capabilities ready to go on a killing spree, it will also happen by accident. Remember the world was almost nuked by accident several times.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    2. Re:It's not a matter of stupid by careysub · · Score: 2, Interesting

      Absolutely. And there is a very effective, and unfortunately extremely plausible warning film about this released in November of last year called SlaughterBots .

      All of the pieces of technology described in this short film are available, and can soon be integrated into the little drone packages depicted.

      --
      Starships were meant to fly, Hands up and touch the sky - Nicky Minaj
  5. Only one guy by lorinc · · Score: 5, Insightful

    It takes only one guy with the right capabilities and stupid enough to do it. History has proven that there are plenty of such people. You can be sure that there are plenty of high level military officers in many countries that are day dreaming of something from Screamers, and will do anything that is in their power to make it a reality...

  6. What a sweet talk! by MerlinTheWizard · · Score: 4, Interesting

    I'm not sure this "professor" has really understood what AI was all about. Thinking that any AI-enabled device will just act as it is "programmed to" is clearly simplistic (although by itself a tautology, since software-based machines are just running 'programs') and a complete misconception of where AI is heading to IMO.

    AI without the internal ability of devising new ways of doing things is NOT AI. And by being able to devise new ways, it has pretty much equal chances for them to be bad or good, all the more that humans have a hard time enough defining clearly what is good or bad, let alone machines.

    This overly "optimistic" talk just sounds like marketing babble, more so than an educated opinion. Sorry "Sir'.

    1. Re:What a sweet talk! by Maxo-Texas · · Score: 2

      Exactly. The a.i. does what we train it to do, but we already have many examples where we were not training it to do what we thought we were training it to do.

      I think strong a.i. is going to be composed of multiple weak a.i. systems. Just as the cerebellum isn't intelligent, and the amygdala isn't intelligent, and the hippocampus isn't intelligent, etc. etc. etc.

      You get some bizarre behavior in humans when the amygdala is broken or damaged.

      Any strong A.I. is going to be so complex that it can't be understood any more than human beings (or even dogs) can be understood.

      --
      She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  7. Computer scientist rather than software engineer.. by fuzzyfuzzyfungus · · Score: 4, Insightful

    The theory that enormously complex software systems specifically designed to be capable of novel behavior definitely won't go off the rails seems like something that you could only embrace if you've never actually interacted with real software as written by real people.

    There is also the...minor...problem that "have a human in the loop deciding" will be a feature that will have to be implemented in software; and we definitely don't have a history of either unhelpful program output or unpleasant reaction to malformed inputs; so that will go well.

  8. So, basically... by flargleblarg · · Score: 4, Interesting

    Killer robots will exist.

    1. Re:So, basically... by gweihir · · Score: 2

      Most assuredly. There are boatloads of money to be made, there are masses of people that are willing to see "undesirables" get killed, there are very few people that do understand the actual, massive dangers. The human race, as a group, is stupid, vicious and driven by fear and greed. About the worst combination possible.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  9. Rise of Stupidity by duke_cheetah2003 · · Score: 2

    Beware the power of stupid people in large groups.

    In all honesty, assuring me that we'll never see killer robots because we'd have to be incredibly stupid to make such a thing... not much assurance.

    You're talking about a species where a not-insignificant number of people believe the earth is flat. Yes. In 2018. It's true.

    A majority of humans are convinced there's an invisible man living in the sky who watches everything we do, every minute of every day. Really? And you're trying to assure me that we're not stupid enough to make killer robots?

  10. They already exist by gweihir · · Score: 4, Insightful

    Every landmine qualifies as a very low capability "killer robot". The insane harm landmines to around the globe is a good indicator that there are by far enough people with power and money and absolutely no qualms about maiming and killing innocent bystanders and civilians in general. Hence we will definitely see killer robots of much higher capabilities, unless we get the fucked-up part of the human race under control that simply cannot stop killing others and using violence to solve disagreements.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  11. Not easy to avoid in an arms race by Kjella · · Score: 3, Insightful

    Side A builds robots that can't fire without human control. Side B builds jammers. Side A decides robot soldiers need to be able to act in "self-defense". Side B puts civilians in harm's way. Side A decides they need "smart robots" who can tell friend from foe by themselves. Or that we need tighter coordination between light arms, heavy arms, air support, putting down covering fire for advancing troops etc. with so tight margins that it can't be done on manual. If you're being mauled to death by a perfectly coordinated fully automatic enemy you will fight fire with fire. Maybe you're creating the world where we'll lose control of our Terminators. But in the short term if you're not playing the game you're going to lose right now.

    --
    Live today, because you never know what tomorrow brings
  12. This stupidity is certain by klingens · · Score: 2

    With the US military and the companies that provide the weapons for it, this kind of stupidity can be taken for granted.

    Sooner or later the US, and probably Israel, will produce autonomous aerial drones (Reaper etc.) and autonomous land based robots (Boston Dynamics). Both have the same problem: they are constantly involved in or start wars abroad, but every soldier coming back home dead, crippled or wounded erodes the support for these wars.
    So to sustain these wars they want weapons that work more and more autonomously are needed so that no precious soldier citizen can ever be harmed.
    The fact that this computer scientist doesn't know or understand that, isn't a good sign for the ones who hired him at his university.

  13. Sure by fluffernutter · · Score: 2

    Sure, just like privacy-invading internet companies will only exist if we let them.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.