Slashdot Mirror


CIA Drones May Have Used Illegal, Inaccurate Code

skids writes "Coders hate having to rush code out the door before it's ready. They also hate it when the customer starts making unreasonable demands. What they hate even more is when the customer reverse engineers the product and starts selling their own inferior product. But what really ticks them off is when that buggy, knockoff product might be used by targeting systems in military unmanned drone attacks, and the bugs introduce location errors of up to 13 meters. That's what purportedly happened to software developer IISi, based on an ongoing boardroom/courtroom drama that will leave any hard-pressed coder appreciating just how much worse his job could get. The saddest part? The CIA assumed the bug was a feature. The tinfoil-hat-inducing part? The alleged perpetrators just got bought by IBM."

35 of 279 comments (clear)

  1. I think i understand by ifiwereasculptor · · Score: 5, Funny

    "The CIA assumed the bug was a feature." Are CIA agents being issued iPhones, by any chance?

  2. Why is the CIA attacking anything? by Anonymous Coward · · Score: 3, Insightful

    The CIA is involved in the collection and analysis of foreign data.

    Building an attack drone is, let's say, missing the mark.

    1. Re:Why is the CIA attacking anything? by Spazntwich · · Score: 5, Funny

      Maybe they need to analyze the effect of high-speed projectiles on foreigners.

    2. Re:Why is the CIA attacking anything? by amicusNYCL · · Score: 5, Funny

      The CIA is involved in the collection and analysis of foreign data.

      Building an attack drone is, let's say, missing the mark.

      You don't understand. Sometimes the foreign data they need to collect and analyze (mostly just analyze) is in a hardened bunker, or warehouse, or mud compound. They can't just land the drone and drive it into the mud compound very well, can they? The easiest way to expose the data they need to analyze is to remove the roof of the building. This allows the drone to take pictures of whatever used to be in the building, without landing, so that they can analyze it.

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
  3. Wow. by rcb1974 · · Score: 4, Insightful

    Out of all the hardware that is controlled by software, I would have thought drone software would be the most scrutinized. Unbelievable. Even more reason why we should not arm robots (even remote human operated ones) with weapons such as Hellfire missiles.

    1. Re:Wow. by Firemouth · · Score: 5, Funny

      Out of all the hardware that is controlled by software, I would have thought drone software would be the most scrutinized. Unbelievable. Even more reason why we should not arm robots (even remote human operated ones) with weapons such as Hellfire missiles.

      On the contrary, this is the reason why we should arm robots with BIGGER weapons! One's that it won't make a difference if you're off by 13 meters...

    2. Re:Wow. by Sonny+Yatsen · · Score: 5, Informative

      It's amazing that drone hardware is fairly well designed, but its software design and implementation is so slapdash. Just last year, it was revealed that the Drones broadcasted its video feed in unencrypted form and was being used by militants to spy on us.

      http://www.networkworld.com/news/2009/121709-drone-intercept-encryption.html

      --
      My postings are informational and does not constitute legal advice. Act on it at your risk.
    3. Re:Wow. by Ukab+the+Great · · Score: 5, Funny

      The bad news: If you use nukes, then coders will get even more lazy and feel they don't have to use asserts and end up being so off that the drones nuke New Jersey instead of Afghanistan.

      The good news: Such as catastrophe just be enough to take Jersey Shore off the air.

    4. Re:Wow. by srussia · · Score: 4, Funny

      Out of all the hardware that is controlled by software, I would have thought drone software would be the most scrutinized. Unbelievable. Even more reason why we should not arm robots (even remote human operated ones) with weapons such as Hellfire missiles.

      On the contrary, this is the reason why we should arm robots with BIGGER weapons! One's that it won't make a difference if you're off by 13 meters...

      Leave the weapon out altogether, just include a divide-by-zero error in the code!

      --
      Set your phasers on "funky"!
    5. Re:Wow. by amicusNYCL · · Score: 5, Funny

      Rumor has it that Jersey Shore is offensive to Americans.

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
    6. Re:Wow. by Sonny+Yatsen · · Score: 4, Informative

      Spying isn't limited to looking at the enemy's base. The patrol patterns of the drones, for instance, tells insurgents where US army forces are looking at. This allows them to move to new locations or hide if they notice the drones moving towards familiar territory.

      --
      My postings are informational and does not constitute legal advice. Act on it at your risk.
    7. Re:Wow. by xianthax · · Score: 4, Informative

      i don't think you understood the article or didn't read it.

      The software wasn't the guidance system for the drone, control it in anyway, or even run on the drone itself. Its running in some data center some where tracking where people are when they use a cell phone or an ATM, etc.

      Its just a mapping package for laying out data thats correlated to geography, its just "google earth - government edition".

      I doubt the 13m really mattered, your not getting 13m accuracy anyway when tracking a cell phone via tower transitions.

      The CIA was using it to find potential targets so they could send a drone toward them, they'd have to get more specific information as to the exact target location elsewhere.

    8. Re:Wow. by russotto · · Score: 4, Informative

      Asserts have one valid use: to wrap something you know you haven't completed and that you know (or are hoping) will break. And if you're releasing stuff you know will break I don't want to pay you.

      An assertion failure means something went wrong that, in the normal operation of the system, could not go wrong. The most likely reason for this is of course a programming error, but there are others: some memory got corrupted, your CPU is malfunctioning, some peripheral is malfunctioning, or some other similar sort of thing. This makes handling assertion failures tricky because you can't assume the state of the system is sane. When I did embedded stuff, assert failures would act similarly to watchdog failures -- the system would disable all interrupts, try to write the assertion code to non-volatile RAM, then reboot. For our application it made sense to do this. For other applications something different might need to be done. But the point is that an assert failure is different than an ordinary error. You can't simply handle the error condition; the whole system state could be bad. You might want to shut the system down completely (e.g. if there's a backup which will take over). You might want to attempt to completely reset your state. Or you might just want to report the condition (somehow) and continue as if nothing happened until someone intervenes. But in any case, assertions have their place.

  4. Salesmen promising too much by OzPeter · · Score: 4, Funny

    And sub contractor steadfastly saying that they can't deliver production ready software in the given time fame.

    Where have I heard that before? .. ah yes .. the current death march project that I am in the middle of!

    --
    I am Slashdot. Are you Slashdot as well?
  5. Off by 13 meters? by mandark1967 · · Score: 5, Funny

    No one will ever need more than 13 meters accuracy.

    --
    Sig Follows: "Suppose you were an idiot. And suppose you were a member of Congress. But I repeat myself." -- Mark Twain
    1. Re:Off by 13 meters? by geminidomino · · Score: 3, Funny

      Fuck You!

      -Signed,
      Princess Leia

      AMEN Brother!
      -Signed,
      The Womp Rats

  6. I think they buried the lead.... by jpapon · · Score: 4, Insightful

    to direct secret assassination drones in central Asia.

    The CIA has the authority to direct secret assassination drones? Inside of Pakistan and possibly other countries?

    Did we learn NOTHING from the Bay of Pigs, Nicaragua, the equipping of the Mujaheddin with weapons, etc... ? The CIA should not be fighting wars. We're supposed to be the city upon the hill. We shouldn't be fighting our wars in secrecy.

    --
    -- Let us endeavor so to live that when we pass even the undertaker shall be sorry. -- M. Twain
    1. Re:I think they buried the lead.... by frank_adrian314159 · · Score: 5, Insightful

      To quote many prominent Republicans, "9-11 changed everything."

      To be fair, it did. It gave cover for authoritarian assholes to do whatever they wanted to do. Fighting wars in secrecy is just the tip of the iceberg. Welcome to the large gulag, comrade.

      --
      That is all.
  7. ROFL by sir+lox+elroy · · Score: 3, Funny

    What did the CIA also think the Toyota "Bug" was a feature. Great car, drives it self. :-)

    --
    Kosh: "Understanding is a 3 edged sword, your side, their side, the Truth."
    1. Re:ROFL by srw · · Score: 3, Insightful

      Yup. And Therac-25 turned out to be operator error.

      Until later, when it became clear it was very badly designed software.

  8. IP theft by drone overlords! by skynexus · · Score: 5, Insightful

    Military drones, armed and dangerous, operating software resulting from IP theft?

    Heh... I'd love to see the Business Software Alliance go after these guys... :-)

  9. 13 meters? by gandhi_2 · · Score: 4, Interesting

    so what?

    hellfires are laser guided, not GPS. a predator reporting its position as being 13 meters wrong is basically nothing....and a non-issue with regards to missile targeting.

    if the predator was dropping JDAMS, i could see the issue. but even then, 13 meters is well within the CPE allowed for the JDAM.

    1. Re:13 meters? by mosb1000 · · Score: 4, Insightful

      If my understanding is correct, this software was used to determine the locations of people making phone calls. So if it's off by 13 meters, the operator may chose the wrong target. The missile being laser guided doesn't help you if you're laser guiding it to the wrong place.

    2. Re:13 meters? by jpapon · · Score: 3, Insightful

      In any case, 13 meters is nothing. Civilians have been watching too many movies to think war is fought on that scale.

      13 meters is a hell of a lot if there's a hospital or school ten meters from the target. This isn't warfare, it's assassinations. A 13 m discrepancy when you're trying to assassinate someone is pretty damn unacceptable.

      Also, the system was used to locate targets. So it might say the target is in one hut, when in fact, they are in a hut 13 meters away. The drone's pilot would then designate the wrong hut with the laser. The system is for target selection, not missile or drone guidance.

      --
      -- Let us endeavor so to live that when we pass even the undertaker shall be sorry. -- M. Twain
    3. Re:13 meters? by jpapon · · Score: 4, Insightful
      FFS, I served, and while 13 meters isn't all that much, bad intelligence is still bad intelligence.

      And while yes, being 13 meters away from a hellfire hit is still going to turn your brain to mush, a blase attitude towards the need to be as accurate and efficient as possible in target selection is what leads to blue on blue and death of civies. Once you start accepting 13 meter inaccuracies as "good enough" you're on a slippery slope. You want to be as accurate as your weapon system allows you to be, and you always want to strive to improve upon it.

      --
      -- Let us endeavor so to live that when we pass even the undertaker shall be sorry. -- M. Twain
    4. Re:13 meters? by AJWM · · Score: 4, Insightful

      For assassinating houses, 13 meters will most likely still give the remote operator the same house.

      In sparsely-built American suburbs, perhaps. Most places that's the house next door, or the car across the street or a couple of car lengths ahead or behind.

      --
      -- Alastair
  10. Re: Confounded by Yold · · Score: 3, Informative

    The Romans had plumbing and they were occupying Jerusalem at the time the New Testament was written... but please don't allow facts to stand in the way of your religion-bashing.

  11. Better idea... by countSudoku() · · Score: 4, Funny

    Capture these badly programmed drones, reinstall them with some sweet, sweet Linux goodness, use them for fun aerial combat play, and taking snaps of bikini-clad neighbors. Problem solved. Patent not pending. Come as you are. There you go.

    --
    This is the NSA, we're gonna geet U h@x0r5! Also, what is a h@x0r5?
  12. Re: Confounded by ooshna · · Score: 5, Funny

    Fine fine understanding that the stars are giant balls of burning gas just like the sun and like the sun could have planets and like the planet earth some of them could have light was too complex for the people that wrote the new testament.

  13. Re:Let me see if I have this straight by Ukab+the+Great · · Score: 5, Insightful

    Back when I was a lowly QA tester for a company that took DARPA contracts involving things specific to North Korea, it never ceased to amaze me that the entire programmer staff were H1B's from China, who just happens to be North Korea's main ally, who were hired solely for their utter cheapness.

    This is why I just can't take tin-foil hat people seriously.

  14. Re:Lest we forget by bsDaemon · · Score: 5, Insightful

    The greatest American general? Would that be Patton? Or Lee? Or the only man ever to get higher marks at West Point than Lee, Douglas MacArthur? Pershing was no slouch either. Eisenhower had actually been subordinate to both Pershing and MacArthur earlier in his career, and only a lucky break getting assigned to the General Staff in D.C. that allowed him some paper-pusher promotions got him to the head of the queue. He barely even had any combat experience.

    The war in Germany was limited because the Americans and British, while not pro-Nazi (except the people where were), weren't really anti-German. There are too many Germans in the US and Britain for that to happen, and the current set of British Royals are German. My grandfather on my mother's side fought in Europe during WWII, but before he shipped out they trained him for bayonet on dolls with Japanese features.

    The American people at that time probably would have accepted extremely high losses fighting the Japanese and wouldn't take anything less than unconditional surrender. If they hadn't given up after the two nukes, no one here would probably ever have heard the phrase "made in Japan."

    But what the OP was referring two was more along the lines of the fact that between the US, UK and Canada, we suffered over 10,000 casualties, with well over 2000 of those being actual battlefield deaths, just on D-DAY. Just D-DAY, not even the whole Normandy campaign. We have had a bit of 4,000 dead in all 7 years of the Iraq war, while we lost over 418,000 in WWII, or about 0.32% of our population at the start of the war.

    I'm not trying to diminish the feeling of loss I'm sure the families of the 4,000+ US soldiers who have died in Iraq must feel. However, the fact that in 7 years we've lost about twice the number of soldiers we lost trying to get ashore in France on 6 June, 1944, speaks volumes about what "limited" war might actually be.

    tl;dr you're wrong.

  15. In Soviet America, Zeroes Divide You! by copponex · · Score: 5, Insightful

    Oh and as to not arming robots? Too late really. We have been doing it for ever 100 years now.
    The Torpedo is a Robot. The first ones where really steampunk killing robots. Suicidal ones to be sure but still robots.

    This is not the root issue of using a robot. The root issue is that technologically advanced societies have been pushing the button from further and further away. The further away they are, the less incentive they have to make sure that their target is valid.

    First, you've got hand to hand combat. You're not going to engage unless you absolutely have to, and can deal with listening to someone gurgle and plead while they bleed out. Then you can move on to ranged weapons. In the early days, you had to get pretty close to hit someone with a musket, but you still at least had to watch people die. Then we got cannon. Rifles. Machine guns. Artillery. Airplanes. Satellite guided bombs. With each advance in military technology, you are taking less risk to your own life when you take the lives of others. That's why there are 6,000 dead "coalition" troops and several hundred thousand dead Afghans and Iraqis. It's not a war, it's a shooting gallery with political implications. If it were a war, like it was with the Japanese and the Nazis, there would be a front somewhere. The chances of Iraqis or Afghans crossing continents and oceans are not virtually zero, they are exactly zero.

    Now we're at the point where some militaries have the majority of their apparatus safely tucked away in a megabase or in the air or even back in their home country. Ninety nine percent of the military are good guys who sign up thinking they will be fighting for their country. For the military to work, when the guy with the most penises on their shoulder says "Kill" the command must be passed down until a trigger is pulled somewhere. But for that guy at the very end, it's still a human decision that can be overridden by natural desires to protect human life. He can make up something about the target being obscured. He can stop it if he really thinks it's not achieving an objective. He knows intuitively that he will pay a high price for taking this life, because he has to take that memory home with him.

    When the top brass are over your shoulder, you'd better click the button and blow up the house.

    And soon the top brass won't even need to issue a command. They will order the command, and the quasi-sentient robots (not some half assed definition that fits your argument) will kill, and the grunts will simply arrive to ID the body parts.

    The real problem with this technology is that there is no pushback for human life. If a politician wants it, and he can find someone in the military who will perform it, you can bet your ass that millions of innocent people will die as a result. The more humans you remove from the end of the equation, the less humane the result will be.

    1. Re:In Soviet America, Zeroes Divide You! by gknoy · · Score: 5, Interesting

      But for that guy at the very end, it's still a human decision that can be overridden by natural desires to protect human life. He can make up something about the target being obscured. He can stop it if he really thinks it's not achieving an objective. He knows intuitively that he will pay a high price for taking this life, because he has to take that memory home with him.

      I read an interesting article in a mainstream magazine about Air Force drone pilots. Basically, they sit in Nevada and control drones in Afghanistan. I was expecting to read about how jaded and eager they were to press buttons at the drop of the hat, but what I found was the opposite.

      The drones are capable of staying in the air for days at a time, monitoring a target (person). They have cameras running, and multiple shifts of human crews watching the video feeds and analyzing what's going on. In the process, they are able to ascertain with frightening accuracy that yes, this particular man is a terrorist: Here's the video feed of him buying some weapons, and here's the part X hours later where we just watched him create a roadside IED. Being able to keep someone under direct video surveillance (including thermal, if I recall correctly, so being indoors didn't help a lot) meant that for at least some targets, they were very sure that that person was a bad guy.

      We have people halfway around the globe pushing buttons to kill people about whom we have reams of (video) evidence showing hostile behavior. I think that's better informed killing than having combat teams need to go in and do the same killing on foot, with potentially faulty intelligence, and without (at times) being able to mount multi-day uninterrupted surveillance.

  16. Re:Lest we forget by AJWM · · Score: 3, Informative

    The Cold War arose because of the Russian fear of the nuclear-armed US [...] and their desire to create buffer zones in the West of the Soviet Union.

    You mean to the West of the Soviet Union. Places like Poland, East Germany, Czechoslovakia, and anywhere else they could roll in tanks and grab.

    --
    -- Alastair
  17. Re:Let me see if I have this straight by gestalt_n_pepper · · Score: 5, Interesting

    Sadly, I can top that story. I used to work for a government contractor that took blueprints and had them redrawn in AutoCAD in St. Petersburg, Russia.

    Our main client was Los Alamos National Labs. We sent them the blueprints for almost every building there.

    --
    Please do not read this sig. Thank you.