Slashdot Mirror


Killer Robots Would Be 'Dangerously Destabilizing' Force in the World, Tech Leaders Warn (washingtonpost.com)

Thousands of artificial intelligence experts are calling on governments to take preemptive action before it's too late. The list is extensive and includes some of the most influential names in the overlapping worlds of technology, science and academia. From a report: Among them are billionaire inventor and OpenAI founder Elon Musk, Skype co-founder Jaan Tallinn, artificial intelligence researcher Stuart Russell, as well as the three founders of Google DeepMind -- the company's premier machine learning research group. In total, more than 160 organizations and 2,460 individuals from 90 countries promised this week to not participate in or support the development and use of lethal autonomous weapons. The pledge says artificial intelligence is expected to play an increasing role in military systems and calls upon governments and politicians to introduce laws regulating such weapons "to create a future with strong international norms."

"Thousands of AI researchers agree that by removing the risk, attributability, and difficulty of taking human lives, lethal autonomous weapons could become powerful instruments of violence and oppression, especially when linked to surveillance and data systems," the pledge says. "Moreover, lethal autonomous weapons have characteristics quite different from nuclear, chemical and biological weapons, and the unilateral actions of a single group could too easily spark an arms race that the international community lacks the technical tools and global governance systems to manage," the pledge adds.

18 of 163 comments (clear)

  1. Structure it like the international mine treaty by xxxJonBoyxxx · · Score: 5, Interesting

    >> introduce laws...with strong international norms

    Why not structure it like the international mine treaty? You know, the one that pretty much everyone except the USA has agreed to.

    (rolls eyes at idea that Russians/Chinese won't use AI-augmented weapons to their full advantage)

  2. If it can be done, it will be done by Ol+Olsoc · · Score: 5, Insightful
    "Thousands of artificial intelligence experts are calling on governments to take preemptive action before it's too late."

    It is too late.

    --
    The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
    1. Re:If it can be done, it will be done by Rick+Schumann · · Score: 2

      Worse, it'll completely insulate people from the horror that is war -- all except the victims, of course. When you don't even have a drone pilot pushing the button to drop a bomb, who is there to have any sort of conscience? My main complaint about the poor excuse for 'AI' everyone keeps trotting out to do this-or-that, is that it's incapable of actual thought, and everything is just an object to it, it doesn't know the difference between a living being (like a human) or a rock or fencepost -- therefore 'collateral damage' has no meaning. Sadly so far as I understand it the current approach isn't ever going to be capable of actual thought or consciousness because we haven't a clue how our own biological brains manage to produce those phenomena, and the chances of being able to build machines that can do that without solving that riddle are slim and none.

  3. The only thing that will stop bad robot with a gun by olsmeister · · Score: 5, Insightful

    Is a good robot with a gun. If you take the guns away from the good robots, then only the bad robots will have the guns.

  4. Most feared robot is autonomous cars by u19925 · · Score: 4, Interesting

    The biggest autonomous "robots" deployment is going to be fully autonomous cars. Many pundits are predicting that autonomous cars are the future and once you have autonomous cars, owning a car would be lot more expensive than ride sharing services. They are predicting that US car ownership can reduce by 50-80% and ride sharing services running millions of autonomous cars. Imagine if someone can break into a large ride sharing service and start all the autonomous cars and direct them on pedestrians... It can be far worse than 9/11.

    1. Re:Most feared robot is autonomous cars by Rick+Schumann · · Score: 2

      I've been saying this all along. We can't even seem to manage to secure our basic data systems, personal computers, and smartphones, do they really think they'll be able to keep anyone from hacking SDCs and taking remote control of them? Especially considering that, in the SDC Future Utopia they're trying to sell us, remote control capability will be baked right into the cars' software, so that law enforcement can take control any time they want, and the occupants won't have any say in it, they'll be locked into the vehicle and taken wherever it is the cops want them to go. From there it'll be TRIVIAL for criminals, terrorists, or whoever has the smarts to pull it off, to hack into whatever vehicle they want to, kidnap people, send them to their deaths, or use the vehicle as an assault weapon or a bomb delivery device. Oh and by the way a reminder: this is all in addition to the massive risk of the car itself fucking up and getting you killed, or killing someone else, while you watch in horror, unable to make it STOP. I'd rather WALK everywhere the rest of my life than set foot in one of these death traps. I'll be glad when the whole fad dies and goes away.

  5. stoopid hoomans! by Thud457 · · Score: 2

    It's not the killbots that are gonna get ya, it's the sexbots that are going to lead to your extinction.

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

    1. Re: stoopid hoomans! by lgw · · Score: 2, Funny

      IVF and women say no. They don't really care about sex, yeah they enjoy it. But they really want a kid.

      Sexbots for women will open jars, kill spiders, and take out the garbage. Then humanity really will go extinct.

      --
      Socialism: a lie told by totalitarians and believed by fools.
  6. I'm sure the Russians would NEVER.. by Zorro · · Score: 2

    Create killed Robots.

    Putin pinkie promised!

  7. Ultimately futile by OpenSourced · · Score: 3, Insightful

    You could rewrite that 70 years in the past and substituting "Killer Robots" by "Nuclear weapons", and make the same arguments, and even some arguments being proven right in hindsight.

    But technology will mature when it's ready to do so, and no amount of hand-wringing will change that. And anyway, if I they want to choose a dangerous tech to get all anxious about, hands down it should be "genetically engineered viri" rather than "killer robots". At least with a robot you can shoot back.

    --
    Rome taught me patience and assiduous application to detail. Virtues which temper the boldness of great, general views.
  8. Doom and gloom by taustin · · Score: 3, Insightful

    Warnings about military and political catastrophe by people who know nothing about the military, or politics, and automatically assume that anyone who does must be evil and stupid.

    How could we possibly survive with the infinite wisdom of Silicon Valley! Just ask them.

    In other words, it's a day that ends in "y."

    This is a complete non-story. There's no content. They're not wrong, so much, as they have nothing to say at all.

  9. Killer Robots Will Be 'Dangerously Destabilizing' by rsilvergun · · Score: 3, Insightful

    FTFY.

    Seriously, the rich are already thinking about a post capitalist society where the working class doesn't factor in. Automated weapons are the way to go. You keep a few engineers on staff to monitor them and pay the engineers well. Unlike the captains of your private military they lack the ambition and charisma to overthrow you.

    Meanwhile the rest of us will just be screwed. Think living like the American Indians on the res except without the casinos. If you want to prevent that now's the time. Start demanding a decent quality of life for everyone. Establish it as a basic human right. Or cast your eyes to the reservations circa the 1900s because that's your future. Me? I'm 40 and come from a short lived family. I'll be long gone.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  10. Re:Uhm by Aighearach · · Score: 2

    Darmok and Jalad, at Tanagra.

    Obviously.

  11. "640k memory is enough for anyone" by Tsolias · · Score: 2

    grade arguments.

    ....a circlejerk of celebrity scientists someone else might say.

    I'd suggest to all of them, they'd better fix their products before dreaming in some sci-fi movie concept from the 80s.

  12. We already have killer robots. by drinkypoo · · Score: 2

    There are already sentry guns. We can already program drones to drop payloads autonomously. We already have killer robots, and we do not even need AI to make them.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  13. Don't wait for government, force it by RhettLivingston · · Score: 2

    Very few devices today are truly open source software free. The open source community should start rolling anti-weaponization provisions into all open source licenses. Problem solved.

  14. Re:Really our worst move? by drinkypoo · · Score: 2

    "Unless AI robots get vastly more flexible rapidly, seems to me that large armies of nasty humans are still a much bigger threat (albeit one we've lived with since time immemorial)."

    Robots don't have to live up to our abilities, because they don't have to cope with our particular drawbacks. They can be smaller and more numerous, for example. They don't have to be individually more capable.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  15. Re: Structure it like the international mine treat by c6gunner · · Score: 2, Informative

    Why not structure it like the international mine treaty? You know, the one that pretty much everyone except the USA has agreed to.

    You know that you're full of shit when your "almost everyone" doesn't include China, India, Pakistan, Russia, and both Koreas, amongst a list of 30+ countries. You know, only about half of the planet.

    You know you're doubly full of shit when out of that list of 30 countries the only one you specifically name is also the only one which has publicly stated that they will abide by the terms of the treaty even though they will not officially ratify it.

    Amazingly enough, despite all that, you're still not as full of shit as the countries which HAVE ratified the agreement yet continue to stockpile dual-use antipersonnel landmines such as the claymore, because these are apparently "OK". Particularly entertaining is the fact that Canada - the nation which originated the treaty - still stockpiles claymore mines.

    But hey, why waste a good opportunity to ignorantly bash the US, right?