Slashdot Mirror


Musk-Backed 'Slaughterbots' Video Will Warn the UN About Killer Microdrones (space.com)

An anonymous reader quotes Space.com: A graphic new video posits a very scary future in which swarms of killer microdrones are dispatched to kill political activists and U.S. lawmakers. Armed with explosive charges, the palm-sized quadcopters use real-time data mining and artificial intelligence to find and kill their targets. The makers of the seven-minute film titled Slaughterbots are hoping the startling dramatization will draw attention to what they view as a looming crisis -- the development of lethal, autonomous weapons, that select and fire on human targets without human guidance.

The Future of Life Institute, a nonprofit organization dedicated to mitigating existential risks posed by advanced technologies, including artificial intelligence, commissioned the film. Founded by a group of scientists and business leaders, the institute is backed by AI-skeptics Elon Musk and Stephen Hawking, among others. The institute is also behind the Campaign to Stop Killer Robots, a coalition of non-governmental organizations which have banded together to call for a preemptive ban on lethal autonomous weapons... The film will be screened this week at the United Nations in Geneva during a meeting of the Convention on Certain Conventional Weapons... The Campaign to Stop Killer Robots is hosting a series of meetings at this year's event to propose a worldwide ban on lethal autonomous weapons, which could potentially be developed as flying drones, self-driving tanks, or automated sentry guns.

"This short film is more than just speculation," says Stuart Russell, a U.C. Berkeley considered an expert in artificial intelligence.

"It shows the results of integrating and miniaturizing technologies we already have."

29 of 252 comments (clear)

  1. Pointless by Templer421 · · Score: 4, Insightful

    If it can be thought up it WILL BE built!

    1. Re:Pointless by JoshuaZ · · Score: 4, Insightful

      Nuclear bombs which are highly cobalt salted to increase fallout have been thought of but the evidence is that no nuclear power has built them https://en.wikipedia.org/wiki/Cobalt_bomb. Similarly currently, we know how to make a massive number of different types of chemical weapons, but the vast majority of countries have none in their arsenals.

    2. Re:Pointless by Baron_Yam · · Score: 2

      Given that you could make these swarms with COTS parts and mostly open-source software... yeah.

      Of course, drones that are capable of carrying a significant payload are still expensive. Right now this would very much be a 'one person per drone that gets through the defenses' kill tool. It's for assassinations, not terrorism.

      The real fun starts when someone realizes you can fly very small drones at high altitude and have them loiter until someone on the ground marks the target for them. There are already military weapons designed to do this - to home in on SAM installations that dare to turn on their targeting systems, I believe. There's nothing stopping you from scaling it down to a small Pi-powered hobby plane with a half-kilogram of explosives flying too high for anyone to notice, searching the ground below for a laser painted target.

      The day may come when high profile people don't ever want to be under an open sky.

    3. Re:Pointless by eth1 · · Score: 5, Insightful

      Nuclear bombs which are highly cobalt salted to increase fallout have been thought of but the evidence is that no nuclear power has built them https://en.wikipedia.org/wiki/Cobalt_bomb. Similarly currently, we know how to make a massive number of different types of chemical weapons, but the vast majority of countries have none in their arsenals.

      The weapons you mention are indiscriminate, and can easily cause just as many problems for those that deploy them as they do for the targets. There are very good reasons not to use or bother building them. The whole point of the drones is that they're cheap, surgical, and can be deployed with little to no consequence for the attackers.

    4. Re:Pointless by geekmux · · Score: 3, Insightful

      currently, we know how to make a massive number of different types of chemical weapons, but the vast majority of countries have none in their arsenals.

      Tobacco kills 7 million people worldwide every year.

      Alcohol kills over 3 million people worldwide every year.

      Countless other harmful yet legal chemicals used in pesticides and food additives. Cancer affects 1 in 3 humans.

      Every battlefield humans have ever stepped on cannot even try to compare to these statistics.

      Perhaps we need to understand that chemical warfare is a lot more fucking subtle these days.

    5. Re:Pointless by vivian · · Score: 3, Interesting

      The worst thing about the drones is that even if they are only used by state actors with legitimate targets in mind, they still won't be 100% accurate.

      Errors in facial recognition will happen, or criteria will be set too broadly to ensure the target gets hit - but that well targeted killbot could just as easily get the wrong guy, which would be chalked up to "acceptable collateral damage".

      If its so hard to get OCR to be more than about 98% accurate, when its analysing a high resolution scan of stationary text under nice lighting conditions, what are the chances we can get a face scanner to be 100% accurate and never get false positives when the target is running like hell and ducking under stuff? You can be sure that the bots will just be programmed to go for the strike when they get better than a 70% match, or something like that.
      I have no doubt these can and will be made, but they will never have the surgical strike capability that they will be marketed as having - they will be much more indiscriminate.

    6. Re:Pointless by ElizabethGreene · · Score: 2

      >> They will just define accurate as within a hundred miles of the official target and anyone within that region as enemy.

      You aren't wrong. In Afghanistan the definition of a militant for the purpose of counting civilian casualties was "all military-age males in a strike zone".

      Said another way, if we blew up a male aged 15-35 it was cool, because he was a "terrorist".

  2. Swarms? by quonset · · Score: 2

    Is this like Millennium Challenge where swarms of small, fast boats were able to disable/sink numerous simulated ships? Or, during that same exercise, swarms of cruise missiles overwhelmed the fleet defenses?

    I guess, in one respect, at least someone's talking about it.

  3. hmm by buddyglass · · Score: 3, Insightful

    Seems pretty easy to thwart facial recognition. More concerning is the fact that most of us carry around a homing beacon in our front pocket.

  4. What's the problem, exactly? by FritzTheCat1030 · · Score: 4, Funny

    Swarms of microdrones dispatched to kill U.S. politicians? I see no reason to rush through a preemptive ban on this technology.

    1. Re:What's the problem, exactly? by ClickOnThis · · Score: 2

      Overrated. I'm not fond of the prospect of killer drones the size of hockey pucks flying around programmed to target political leaders, no matter what side of the aisle they sit on, thankyouverymuch.

      --
      If it weren't for deadlines, nothing would be late.
  5. Re:speculation is speculation by ClickOnThis · · Score: 2

    Speculating on plausible outcomes is the first step towards mitigating the consequences of them.

    --
    If it weren't for deadlines, nothing would be late.
  6. The problem is they're too cheap by TheNarrator · · Score: 5, Insightful

    It's not that these things are more destructive than older weapons. It's that these things give the power of a targeted artillery strike to anyone for pennies of what nation state weapons cost, so it opens up WWI type levels of destructive capability to just about anyone on any budget. WWI really caught people off guard. People had no idea the level of destruction that was going to be unleashed by the industrial revolution. Likewise people have no idea the destructive power that's going to be unleashed by the AI revolution.

    1. Re:The problem is they're too cheap by mentil · · Score: 4, Interesting

      Forget artillery strikes. What's really gonna stir shit up is when drone attacks allow for anonymous murder. What society could cope with that? It's gonna be like handing a Death Note to every citizen on Earth, only you won't need to know their name. I COULD see a ban on murder-drones actually working though, as after the first time a crime family gets whacked, the black market won't touch them; people will go after individual sellers as well. Wearing a mask in public might become the norm... until voice-recognition is used instead.

      --
      Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
  7. wrong conclusion by lucm · · Score: 2

    swarms of killer microdrones are dispatched to kill political activists and U.S. lawmakers

    I know that deadly scenario is scary and romantic, but really, what is more likely to happen is swarms of microdrones delivering chicken mcnuggets and tubes of k-y, not killing political activists.

    --
    lucm, indeed.
  8. Re: Ob by lucm · · Score: 4, Insightful

    Another racist term for a Japanese person...

    Again, the SJW mod crowd shows they are idiots, but on one thing, you're right. It is a racist term, but it's racist against white people' specially, South African and Rhodesian whites.

    Subculture slang is not relevant out of its cultural context. There's a handful of well-known ethnic slurs and we don't need more. It's possible to narrow down to cover smaller populations (such as ice chinks for inuit) but you can't use localized versions for groups that are already covered by a top-level label, otherwise you're just creating confusion.

    Also I would like to point out that an ethnic slur is not the same as a racist term. Just like it's not sexist to call a woman a cunt, it's not racist to call an Asian a chink. It's rude but that's not the same as racist. I guarantee you that there's people in nice offices that will silently pass on a resume if the name sounds ebonic or latino but that would never say "the n word", while there's blue collar workers calling each other "pollocks" or "fucking sand n-word" without an ounce of discrimination in mind.

    --
    lucm, indeed.
  9. mod up please by ishmaelflood · · Score: 2

    The ignorance of the politically correct echo chamber is revealed yet again.

  10. A firecracker, not a bomb by raymorris · · Score: 3, Interesting

    >> Armed with explosive charges, the palm-sized quadcopters use real-time data mining and artificial intelligence to find and kill their targets.

    >> If you can attach a camera to a drone, you can attach a bomb

    The cameras used to hobby drones typically weigh 20-100grams. In the US, Fourth of July fireworks sold to the public can weigh 1,000 grams (with 500 grams of explosive inside). So the camera could be replaced with a small firework, which would make the target curious about that popping noise.

    1,000 Kg is a decent bomb (1 million grams, or 10,000 times as much as a drone camera).

    $500-$1000 quads CAN carry a bit more weight, but at a major reduction in flight time and range, as well as speed and the ability to fly in a stiff breeze. Unladen, a DJI Phantom 3 Professional ($700) can fly for about 23 minutes. Add a 1Kg payload and flight time is less than half that much. At 6MPH it could cover about 1 mile, if there is no breeze at all. With a 5MPH breeze against it, and carrying a 1Kg load would cover a several hundred feet before the battery died.

    You're probably better off just throwing the pipe bomb with your hand. Much simpler. If you must go "fancy", a potato gun (plumbing pipe and hairspray) will go just about as far with a 1Kg grenade.

    1. Re:A firecracker, not a bomb by raymorris · · Score: 2

      > Do you have any experience with explosives?

      Yes, I do.

      > I have seen what 200 grams of TNT will do to a human body

      Ah so you saw the video that purports to represent what could happen if you were holding it in your hand when it went off? The one made with a glove full of hamburger meat (pre-ground)? Yeah it's not recommend to hold it in your hand. Put it a few feet away, perhaps on a flying drone, and see how much difference that makes. I'm no saying it would be totally safe, but it's also not a particularly effective weapon.

      > Yes, there are more low tech ways to deliver payloads, but that is not the point.

      Yes, there are low tech ways that are cheaper, easier, and more effective. So I hope any bad guys are dumb enough to try to use a drone, thereby rendering their attack less effective.

      > Someone could carry a suitcase to a location, open it and release a swarm of small drones and then walk away

      Yes, they could have, in a suitcase, four small drones, each carrying a charge enough to be dangerous, but probably not deadly (maybe 100 grams). OR they could have the suit case be full of explosives, tens of thousands of grams of explosives, and skip wasting most of the space with RC toys. A suitcase full of explosives would be a hell of a lot more effective than drones carrying enough explosive to ruin your hand IF the target cooperates by holding onto the weapon while it goes off.

      > So I am all for a treaty to ban the use

      I don't necessarily disagree, but the "so" part confuses me. Are you suggesting your hypothetical terrorist os going to follow treaties? He IS too dumb to fill the suitcase with explosives, so I guess maybe he'll read up on the Geneva conventions and make sure his terrorism would otherwise be legal, except for the fact that it's terrorism.

    2. Re:A firecracker, not a bomb by SuricouRaven · · Score: 2

      Maybe not enough for a simple bomb, but 150g is enough for a long needle laced with something suitably toxic. A bit beyond the means of a lone wolf attacker, but well within the capabilities of even the smallest nation. All the drone need do is identify the target and ram. Ricin would be ideal. Or abrin - that stuff is so toxic you'd only need to fly the drone around your target's head while dispersing it into the air.

      I've seen this idea before many years ago. It was an episode of Bugs. Their drones looked like insects rather than quadcopters, but the idea was the same: They are just smart enough to identify a target, home in and stab.

    3. Re:A firecracker, not a bomb by Kjella · · Score: 4, Interesting

      A more realistic weapon for a palm-sized drone would be a wasp-style injection, just ram the target and have a spring released needle to punch through the clothing and skin or shoot from close range like a taser gun. There are plenty toxins you could deliver that would be fatal with even a very tiny dose. But the topic wasn't really if a drone attack is practical, but whether an autonomous drone attack is more practical. I don't really see it, if there's only one target then human RC will do fine. If there's many targets, gathered in a relatively small space like some form of meeting or conference, why wouldn't you just hit that with one big bang? I mean the assumption here is that you're willing to commit mass murder, are you going to care if there's a little collateral?

      I'd think the only reason you'd care is because you're trying to be the good guys, like IS is using human shields or they're in a camp with women and children or whatever and you want to make precision kills without harming the rest. In any case there's probably good reasons to build all this technology for non-lethal purposes, swapping out some non-critical function with some kind of trigger/detonator is always going to be easy. It's like trying to build an alarm clock that can't be rigged to blow up a bomb when the alarm goes off. What are you going to do, ban alarm clocks?

      --
      Live today, because you never know what tomorrow brings
  11. Re:MOD PARENT DOWN -1 FLAMEBAIT by Tuidjy · · Score: 2

    Really? Originally, it was used to describe South-African white males of Dutch descent. Now it is a pejorative term for any white male (males only, because it comes from the male name Jaap)

    Where is it used to refer to Japanese people, and why would you assume it is a slur for Japanese in a context where we are talking about Elon Musk, a South-African?

    --
    No good deed goes unpunished...
  12. Re:The truth usually gets censored... apk by Aighearach · · Score: 2

    No, but the book The Diamond Age covered all this stuff, we don't need a stupid bad video to point out the risks. If they wanted to do this right, they'd pay Neal Stephenson to do a film adaptation!

  13. Re:why palm sized? by CustomSolvers2 · · Score: 2

    The size is a very relevant aspect. Firstly, you need some space to store all the required electronics. Secondly, you cannot generate enough force without reaction/inertial mass. Even the size in the video seems extremely small for what is expected to be accomplished. Even by forgetting about all the required space to store what is needed to more or less autonomously operate in a 3D space, it doesn't seem possible to shoot anything in a position to pass through a skull from a so small (and instable! The fact of being flying around increases the minimal mass requirements) object even under ideal conditions. In a random situation, with that small thing flying over people and shooting from random positions, it is certainly impossible. Same thing with your proposal of injecting whatever: although almost any part of the body and minimal force seem required when talking about a deadly toxin, there are still some constraints that are very difficult or even impossible to be met under the intended conditions.

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
  14. Re:Going a little larger by gtall · · Score: 2

    It only needs to carry a very small amount of a nerve agent. I don't know microbots are viable, but they needn't carry an explosive charge to be lethal.

  15. Re:Going a little larger by wierd_w · · Score: 5, Informative

    There is a big difference between a black cat, and a shaped high explosive charge.

    Take for instance, semtex. This is a commercially available plastic explosive used for demolition. (and frequently used by terrorists.)

    250 grams of it is enough to destroy an in-flight airplane, if properly placed.

    The premise of the video is that a human skull is pretty thin, and not evolved to stop a shaped explosive's concussion wave. If one uses something like this, they can blow half your skull off with just a few grams of material, pretty much exactly like in the video.

    A shaped charge explosive works by having a special void in the explosive material on the surface that is to be favored for blast-wave creation. This provides a high velocity path of least resistance, through which combustion products of the explosion will favor being expelled, and giving the explosion a preferred direction for energy delivery. (This is very different from a fire cracker, which explodes basically uniformly.)

    Considering that just about any high explosive is many times more powerful per gram than the black powder found inside the black cat mentioned by the grandparent, and are capable of producing shaped shock fronts on detonation, I basically call bullshit on grandparent's dismissal. For reference, military grade C4 plastic explosive detonates with a combustion rate 29,000 feet per second. Black powder? Between 600 and 1400 feet per second. Literally, just replacing that "black cat" with the same weight of C4, increases the explosive force 20 times, at best, and 48 times at worst.

    Apples and oranges sir. Your black cat is not even in the same class as the material they are suggesting could be inside these drones.

  16. Re:190 pounds to make it lethal, genius by drinkypoo · · Score: 2

    A gun makes a bullet go fast, and weighs about ten pounds.

    Nonsense. A and doesn't weigh even one pound in the case of a pistol.

    Handguns are only effective out to about 20 feet,

    That's a lot of bullshit.

    and even then two or three shots probably won't kill the bad guy.

    That depends very much on how good your aim is.

    The important bit of the system is the part which aims the gun at a vital part of the target's body and fires at the proper instant. That part is called the marksman. It weighs about 180 pounds.

    What does yolo 9000 running on a raspberry pi zero weigh?

    Everything you said was wrong.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  17. Re:Don't make killer robots by sycodon · · Score: 2

    You jest, but people thought the machine gun was going to make war too terrible to wage.

    The New York Times, in 1897, called Maxim’s invention “terrible automatic engines of war,” and suggested their mere existence might convince world leaders to settle conflicts diplomatically.

    It seems that the worst things are often the handy work of people trying to prove something.

    --
    When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
  18. Re:WW3 by SuricouRaven · · Score: 2

    I did some calculations a while ago. As of last year (or was it the year before?), the ten-year average annual deaths for terrorist attack in the US is less than that for lightning strikes, but greater than that for sharks.

    In Australia, the sharks scored more kills than the terrorists.

    The point here is that people are absolutely awful at estimating risk. They are highly biased to ignore the common, and consider only the exceptional.