Slashdot Mirror


Robotic Cannon Loses Control, Kills 9

TJ_Phazerhacki writes "A new high tech weapon system demonstrated one of the prime concerns circling smarter and smarter methods of defense last week — an Oerlikon GDF-005 cannon went wildly out of control during live fire test exercises in South Africa, killing 9. Scarily enough, this is far from the first instance of a smart weapon 'turning' on its handlers. 'Electronics engineer and defence company CEO Richard Young says he can't believe the incident was purely a mechanical fault. He says his company, C2I2, in the mid 1990s, was involved in two air defence artillery upgrade programmes, dubbed Projects Catchy and Dart. During the shooting trials at Armscor's Alkantpan shooting range, "I personally saw a gun go out of control several times," Young says. "They made a temporary rig consisting of two steel poles on each side of the weapon, with a rope in between to keep the weapon from swinging. The weapon eventually knocked the pol[e]s down."' The biggest concern seems to be finding the glitches in the system instead of reconsidering automated arms altogether."

26 of 580 comments (clear)

  1. Two words: Deadman switch by riker1384 · · Score: 5, Insightful

    Why didn't they have some provision to cut power to the weapon? If they were testing it in a place where there were people exposed in its possible field of fire (effectively "downrange"), they should have taken precautions.

  2. Better than humans in the long run by danny256 · · Score: 4, Insightful

    The biggest concern seems to be finding the glitches in the system instead of reconsidering automated arms altogether.

    As with most automated technologies it will make some mistakes, but less than a human on average. The friendly fire rate for most militaries is no where near perfect.

  3. No pun intended by geekoid · · Score: 4, Insightful

    But shouldn't this thing have a kill switch? Seriously, my table saw has a kill switch.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  4. Riiight by Colin+Smith · · Score: 3, Insightful

    The biggest concern seems to be finding the glitches in the system instead of reconsidering automated arms altogether. Because human beings are so good at shooting down low flying supersonic aircraft.

    --
    Deleted
    1. Re:Riiight by Thaelon · · Score: 4, Insightful

      Maybe that's what they tell the grunts. Congratulations, you managed to shoot down large mock targets that weren't shooting back.

      Think you can shoot down supersonic missile flying below the horizon? No. They let the computer guided robots do that. You're not nearly good enough at it. Ok, maybe you get lucky and nail it. Now try thirty in five seconds all coming from different bearings. Didn't think so.

      --

      Question everything

  5. "But what if we want to have the windows open?" by HTH+NE1 · · Score: 4, Insightful
    From "Mostly Harmless" by Douglas N. Adams, Chapter 12:

    (It was, of course, as a result of the Great Ventilation and Telephone Riots of SrDt 3454, that all mechanical or electrical or quantum-mechanical or hydraulic or even wind, steam or piston-driven devices, are now required to have a certain legend emblazoned on them somewhere. It doesn't matter how small the object is, the designers of the object have got to find a way of squeezing the legend in somewhere, because it is their attention which is being drawn to it rather than necessarily that of the user's.

    The legend is this:

    "The major difference between a thing that might go wrong and a thing that cannot possibly go wrong is that when a thing that cannot possibly go wrong goes wrong it usually turns out to be impossible to get at or repair.")
    --
    Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
  6. No three laws safe here by MrKaos · · Score: 3, Insightful
    seems a bit stoopid

    By the time the gun had emptied its twin 250-round auto-loader magazines, nine soldiers were dead and 11 injured.
    was it neccesary to fill both magazines in a test fire, or for that matter in a live test fire perhaps have some sort of abort system ready - even if it just cut the power to the control systems?

    Maybe fill the magazines on the 5th live fire test???

    Just sayin, ya know.

    --
    My ism, it's full of beliefs.
  7. Re:Three Laws of Robotics by rossifer · · Score: 4, Insightful

    I respect Asimov, but the three laws are pretty naive.
    Well, sure.

    Asimov's three laws were meant to be a thought experiment in hubris and unintended consequences. They were sold (in the context of the stories) as the perfect control system for robots, and then there were always "problems" that the USR management couldn't understand and which Susan Calvin needed to figure out and fix.

    Asimov wasn't naive, but some of his characters were...

    Regards,
    Ross
  8. Acme no, South African aftermarket coding, yes by Kamokazi · · Score: 4, Insightful

    From here:

    Young says he was also told at the time that the gun's original equipment manufacturer, Oerlikon, had warned that the GDF Mk V twin 35mm cannon system was not designed for fully automatic control. Yet the guns were automated. At the time, SA was still subject to an arms embargo and Oerlikon played no role in the upgrade.

    It may just be me, but automating a machine that fires explosives that isn't designed to be automated just sounds like a Bad Idea(TM).

    --
    As our way of thanking you for your positive contributions to Slashdot, you are eligible to disable Slashdot 2.0.
  9. Re:ED-209 not available for comment by Skreems · · Score: 5, Insightful

    When you're talking about massive loss of life while testing armed robots that the military wants to turn loose on the world, sometimes humor is the only way to deal with reality.

    --
    Slashdot needs a "-1, Wrong" moderation option.
    The Urban Hippie
  10. Re:ED-209 not available for comment by Detritus · · Score: 5, Insightful
    If I stub my toe, it's a tragedy. If you get run over by a herd of elephants, it's funny.

    If you want really sick and twisted humor, try living in a war zone.

    --
    Mea navis aericumbens anguillis abundat
  11. Re:ED-209 not available for comment by jlarocco · · Score: 4, Insightful

    150000 people die every day. That's almost 2 a second. I'm sure the family and friends of these 6 are heart broken, but for the 6.5 billion people who don't know them, it's not all that remarkable.

    The only thing unique about these 6 people is that they died in a somewhat amusing way. If you want to mourn, mourn for the other 149994 people who died today that you'll never hear about.

  12. Re:Three Laws of Robotics by Cheapy · · Score: 3, Insightful

    I always find it hilarious that people will always post those "Laws", as if they were Universal Laws such as "1+1=2".

    They are a set of fictional laws made up by an author for his science fictional books. Are we seriously going to accept every and all Laws that appear in fiction?

    --
    Would you kindly mod me +1 insightful?
  13. Re:ED-209 not available for comment by delong · · Score: 4, Insightful

    Kind of like my response to Slashdotters objecting to an automated weapon designed to shoot down cruise missiles, which leave too little reaction time for human-controlled defenses to counter, which save lives of soldiers, airmen, and sailors from massive loss of life.

  14. Re:ED-209 not available for comment by Rich0 · · Score: 4, Insightful

    Honestly, from reading the article it isn't clear that a software problem was even the cause of this disaster. It could have been some kind of mechanical gun jam.

    Any time you are dealing with big guns, fast motors, high-speed fire, large rounds, and explosive projectiles there is a risk of disaster if things go wrong. These things aren't toys. Even if the fire button was completely manual things could still go wrong.

    I recall reading an article about a magazine detonation in a battleship which went into all kinds of detail about all the things that could go wrong - and this was a fairly manual operation. It did involve lots of machinery (how else do you move around shells that weigh hundreds of pounds?), but it was all human operated.

    Assuming the system is well-designed the automation actually has great potential to LOWER risk. Humans make mistakes all the time. They're even more prone to making mistakes when a jet is incoming loaded with cluster bombs.

    Another thing to keep in mind is that peacetime training disasters always make the news with the military. However, the military has a fine line to walk - on one hand they want to be safe in their exercises, but on the other hand they want to be able to handle combat operations. A 30 minute single-shot firing procedure that allows for all kinds of safety checks sounds great in theory, but in wartime you'd lose more people to incoming fire than you'd ever save from gun explosions. Sure, you don't want to kill yourself, but if you're so ineffective that the enemy overruns you it is all for nothing. As a result we tolerate some friendly fire, accidents, etc.

    Like it or not robotic weapons WILL be the future of warfare. Sure, one country might elect not to develop them, but sooner or later somebody else will, and once they work out the bugs they'll be overrunning everybody else...

  15. Re:ED-209 not available for comment by ghostunit · · Score: 5, Insightful

    Nope, unlike what tv may have taught you, people rarely, if ever, joke about something anything that affects and hurts them.

    Let's see you cracking a joke about the robot at the funeral if it was *your* son in the casket.

    Now, I don't see anything bad about us making jokes in this forum, since we aren't personally involved in the matter at all and can only feel sorry in an "abstract" kind of way (as in, accidents and human loss are sad but oh well I can't feel sad for *every* bad thing that happens in this world right?), and this won't be read by the affected people. But let's not go around pretending that we are "dealing" or "coping" with anything here. That's just hipocrisy.

  16. Re:ED-209 not available for comment by Nazlfrag · · Score: 3, Insightful

    Well, if you'd grown up all your life in the despotic, decadent corporate dystopia depicted in Robocop like those young'uns did, you'd be fairly oblivious too.

  17. Re:Testing before testing. by Al+Al+Cool+J · · Score: 5, Insightful

    That's funny, because as a human, with close to 40 years experience working with other humans, all *I* can say is "PLEASE DON'T KEEP GIVING *THEM* GUNS!!!"

    I would never want to be around a human with a gun, just too big of a chance for something to go wrong.

  18. Re:ED-209 not available for comment by Johnny5000 · · Score: 4, Insightful

    When you're talking about massive loss of life while testing armed robots that the military wants to turn loose on the world, sometimes humor is the only way to deal with reality.

    Seriously.. this thing was built with the explicit purpose of raining death down on people.

    And lookee, it apparently did the job it was built to do....
    Only on people we've all decided "deserved" to keep their lives.

    Unlike the people this thing was *intended* to kill.

    --
    The libertarian solution to the failures of capitalism is to apply more capitalism til the failures are fixed.
  19. Re:ED-209 not available for comment by Damarkus13 · · Score: 4, Insightful
    That's complete bullshit.

    My father is a paramedic, and some of the jokes that circle the station after a particularly gruesome scene would probably make you vomit. These men aren't deranged, dark humor is a very real way to deal with tragic events. These men are psycologically evaluated from time to time and the psycologists never seem to have any problem with dark humor. One has gone so far as to tell my father it is a COMMON coping mechanism, especially when one is trying to remain abstracted from the trauma.

    I'm not saying they make these jokes at funerals (that's just called tact) or in the presense of civilians, but pull your head out of your ass and realize that laughter is a powerful healing tool.

  20. Re:ED-209 not available for comment by plover · · Score: 5, Insightful

    Let's see you cracking a joke about the robot at the funeral if it was *your* son in the casket.
    I did. It was the only way I could react to my father's death. It's who I am. I hurt fiercely, I was crying hard, and when my mom and I stepped into her kitchen I had to say something, so I cracked a quiet joke. It broke the tension, and made us feel just a tiny bit normal.

    That's coping, using humor. It happens in real life.

    In this forum, however, nine South Africans are truly remote. They're about as far outside my monkey sphere as humans can get. You wanna joke about them? Fine by me. You want to complain about the jokers because you don't think people really deal with tragedy that way? You're quite wrong.

    --
    John
  21. Re:Government coders by Dun+Malg · · Score: 5, Insightful

    He had claimed that he had been involved in writing code for some kind of automated anti-missile defense system, though he had always insisted that he wasn't allowed to give details.

    If programmers like HIM are writing the code for these "smart" weapons, then I think we should just give the things to our enemies for free.

    Defense contractors frequently end up with bad products, but it's usually due to mission creep and gross mismanagement. Based on my experience*, I'd almost guarantee that this guy was lying about his experience. Pretending to have worked on a "top secret" project that you conveniently can't talk about is pretty weak sauce. In reality, there are two kinds of classified projects: mundane ones, where the engineers working on 'em can talk about the "what" of the program in great general detail, but the specific "how" is classified; and REALLY secret ones, which you can't talk about at all, the most you can say is "I work for Lockheed" or whomever. This "I worked on a secret anti-missile program" shit is a load of crap. It falls into the big fat liar zone between mundane and really secret.

    * I was an intelligence analyst in the Army. I dealt strictly with excruciatingly mundane secrets. Boring, boring, boring. My father was an engineer for Hughes (now Raytheon). He worked on things like the B-2 Spirit ground mapping radar system. For years he "worked at Hughes", and that was it. Later, he was able to say "I work on the B-2 radar system. You'd be amazed at some of the cool shit we do with it, but I can't say what it is."
    --
    If a job's not worth doing, it's not worth doing right.
  22. Re:ED-209 not available for comment by ghostcorps · · Score: 4, Insightful

    It really must be an Aussie thing. My mate is a cop, last month he had to tell a nun, that her wheelchair-bound brother had lost control down a hill and drowned in a duck pond.

    But when she asked how he died, he could barely hold a straight face so he told her to ask at the hospital.

    Later she saw him and said, "No wonder you couldn't tell me how he died". Seems, she nearly pissed herself laughing at the hospital. She also told him to practice more, he'd given himself away with a tiny lift at the corner of his mouth when she asked.

    Personally, I don't get what a period of mourning achieves. Losing someone leaves any empty place, but I wouldn't want anyone to waste a moment of their life mourning the loss of mine. Why is it that the west treats death as some kind of divine punishment, and the east tend to celebrate it?

    --
    axis discrepancy indicates hexagons beyond control anomaly
  23. Re:ED-209 not available for comment by jollyreaper · · Score: 4, Insightful

    I teach robotics (on a VERY basic) level to high school kids. I explain that there are some really peculiar people out there who watch movies like Terminator and think "Hey that's cool! I wanna build a killer robot" and who then spend their professional careers trying to build machines that will lower our position in the food chain. :( They just don't sense the danger. Just like those designing artificial brains, smart weapons, doomsday plagues, better nukes...... Yup. And I'm not even looking at it from a robot uprising perspective. Strong AI may or may not happen but I think it's going to be far, far off, like practical fusion power. But in the meantime, weak AI robotics is coming along nicely, predator drones and SWORDS robots, etc. Just look at the anti-democracy crackdown in Burma, that shows you the power of force when applied against the people. There were reports that some of the military units were wavering, having second thoughts about killing civilians and monks. An automated gun doesn't care. We've already got that level of distance with aerial bombing. We killed what was it, twenty civilians trying to take out Saddam the opening night of the war? We've got Marines on trial for deliberately raping and murdering civilians up close and personal but we gave medals to guys doing the indiscriminate killing from the air. We act like it's different, like accidentally killing dozens of people in an air attack is different from shooting them up close and personal. Wow, I'm sure their families will see that distinction exactly the same way we do. And when our cruise missiles go off-course and hit the wrong target, they're going to realize that's entirely different from when a suicide bomber does the same thing with two tons of explosive in a truck. "Sorry, my bad."

    Automated weapons are going to make the blood cost of war (to us) too low. We need casualties in the millions before our dumb monkey brains can figure out it's a bad idea, sometimes not even then.
    --
    Kwisatz Haderach
    Sell the spice to CHOAM
    This Mahdi took Shaddam's Throne
  24. Re:ED-209 not available for comment by Denial93 · · Score: 3, Insightful

    Huh? You mean on 9/11, 2.5% of fatalities worldwide were due to terrorism? And since then, terrorist deaths have practically flatlined, with rarely more than 0.01%, way behind pulmonary heart diseases, the flu, starvation, war, crime, work accidents, motorvehicle crashes and all sorts of other causes? You mean it doesn't make sense to throw terabucks into the War On Terror when relatively cheap nutrition programmes could save 27000 lives per day?

    What is this, a remaining pocket of common sense?

  25. Re:ED-209 not available for comment by ozgood · · Score: 4, Insightful

    Every army that wants to be good needs to be a well oiled machine. Otherwise accidents like this happen regularly.

    The parents "racist beliefs" broken down were:

    The post apartheid government is black. True
    Corruption is running rampid in SA, which has a black government. True
    HIV is climbing faster than curruption. True
    SA is now dangerous. True
    SA government (which again happens to be black) spends money on needless things rather than helping the people. True

    The facts are that in the post apartheid era, things in South Africa are in fact worse. I dont think it's a black thing vs. a white thing, but when anybody points out these above facts they are called racist.

    Your issue shouldn't be with the parent being racist, it should be with your government being accountable to the above issues, whether the government happens to be black or white it doesnt matter.

    Sadly, most of Africa seems to be following this trend which is a shame.