Slashdot Mirror


Pentagon To Crowdsource Weapons Software Testing

An anonymous reader writes "The Pentagon plans to fork over $32 million to develop 'fun to play' computer games that can refine the way weapons systems are tested to ensure they are free from software errors and security bugs, according to a Defense Department solicitation. The goal is to create puzzles that are "intuitively understandable by ordinary people" and could be solved on laptops, smartphones, tablets and consoles. The games' solutions will be collected into a database and used to improve methods for analyzing software, according to the draft request for proposals put out by the military's venture capital and research arm, the Defense Advanced Research Projects Agency."

80 comments

  1. Ender's Game? by Anonymous Coward · · Score: 1

    Mr. Card should be proud.

    1. Re:Ender's Game? by Anonymous Coward · · Score: 0

      [Insert repetitive and incoherent babbling about who is and is not a shill and/or troll here*]

      *Childish namecalling and replying to yourself as an AC optional

  2. The Last Starfighter by Scrameustache · · Score: 3, Funny

    If you get really good at the game, they give you a real spaceship to pilot!

    --

    You can't take the sky from me...

    1. Re:The Last Starfighter by stanlyb · · Score: 1

      But only if there are bugs to fight, oh wait, ROFL.

    2. Re:The Last Starfighter by Anonymous Coward · · Score: 0

      This was also used in the pilot of Stargate Universe.

    3. Re:The Last Starfighter by RobertLTux · · Score: 1

      note when a General says something that might be funny ITS NOT A JOKE (unless you see one of his staffers laugh first)

      --
      Any person using FTFY or editing my postings agrees to a US$50.00 charge
    4. Re:The Last Starfighter by Black+Parrot · · Score: 2

      note when a General says something that might be funny ITS NOT A JOKE (unless you see one of his staffers laugh first)

      "You can't fight in here -- This is the War Room!"

      --
      Sheesh, evil *and* a jerk. -- Jade
    5. Re:The Last Starfighter by Divide+By+Zero · · Score: 1
      Greetings, Warfighter!

      You have been recruited by the United States of America to defend the frontier against Iran and the Middle East Armada.

      --
      Dare to Hope. Prepare to be Disappointed.
    6. Re:The Last Starfighter by Anonymous Coward · · Score: 1

      Another useless attempt to be funny. Yay!

      So back on-topic, why would you want to help these assholes? It's amazing how much less military spending you need when you aren't trying to be the world's cops.

    7. Re:The Last Starfighter by Anonymous Coward · · Score: 0

      Yeah. Solving a puzzle and getting to pilot an ancient spaceship is awesome. Too bad you'll be stuck in another galaxy!

    8. Re:The Last Starfighter by ackthpt · · Score: 2

      If you get really good at the game, they give you a real spaceship to pilot!

      Indeed and you don't even know about it!

      This isn't the first time they've tried this Crowdsourcing thing - there's currently a Abrams tank at the bottom of the middle of the Atlantic, with a great hole blown in its side, which was supposed to be run around Fort Hunter Liggett, in California, based upon use patterns, moderation and metamoderation on /. Which should tell you something ... it'll all end in tears (and give several lucky tube worms a new home.)

      --

      A feeling of having made the same mistake before: Deja Foobar
    9. Re:The Last Starfighter by Anonymous Coward · · Score: 0

      How about the other way around:
      As-Salmu `Alaykum Jihadist! You have been recruited by the [insert your the name of your local organization] to defend the frontier against Israel and the Armada Americana.
      Ah, the irony. And pizza.

    10. Re:The Last Starfighter by Anonymous Coward · · Score: 0

      Reported to Homeland Security.

  3. Reminds me of... by Synerg1y · · Score: 1

    reading Ender's Game back in grade school.

  4. Does it matter? by Anonymous Coward · · Score: 0

    What does all the testing in the world do for you if you give your cheapo friends sweetheart bid-free contracts? That advanced Predator Drone XXI is still unable to get kitty from tree.

    1. Re:Does it matter? by PlatyPaul · · Score: 5, Funny

      Sure it can.

      Oh, you meant intact.

      --
      Misery loves company. Online misery loves unsuspecting random strangers.
    2. Re:Does it matter? by gnick · · Score: 2

      "Help! Help! Mr. Wiggles is stuck in that tree!"

      "Don't worry ma'am, we'll get rid of that tree for you." [BLAM] "That will be $90k. Here's your USAF lapel pin and novelty US flag for Mr. Wiggles's funeral and seven cap guns for his 21-gun salute - We'll bill you for those later. You're welcome, have a nice day."

      --
      He's getting rather old, but he's a good mouse.
  5. Need Hardware by Anonymous Coward · · Score: 1

    I'd love to work on the testing software, but I'm going to need some hardware to make sure it interfaces correctly. Just drop off a jet fighter and a couple smart bombs and I'll be set.

  6. Why release it outside the US military, at all? by G3ckoG33k · · Score: 2

    Why release it outside the US military, at all?

    Sure there are some ordinary people in the various branches of the military.

    Makes no sense.

    1. Re:Why release it outside the US military, at all? by Anonymous Coward · · Score: 4, Insightful

      I do weapons safety, including software.

      In short, no one in the DoD systems engineering group really gets the big picture here. When you see someone with stars/flag/O-8+ or an SES position touting safety in the DoD, they are always referring to operational safety. Safety as a weapons system design element is typically (70% in USN, 85+% in USMC, Army is even worse) considered red tape, and a waste of money. The exception to this is aeronautics development programs in all branches, with an exception within those groups for UAV's (despite their need for software safety more than anyone). So aero "gets it", except UAV's are still clueless.

      Since major contractors swap employees with the DoD regularly, even mature design houses have issues. This is also reinforced by the flow of money. If the DoD PMO doesn't budget for safety in the contract, the contractor isn't going to require it.

      Now, remember the above applies to all RDT&E safety. Given what you know of software systems, what do you think will bear the brunt of fielding an immature design: expensive to change HW or cheap & quick to replace SW? How many federal doD program end up short on their budget at the end of the development and integration cycle?

      There is the added problem that almost no one does safety research on weapon systems. Pharma, Nuclear, Aerospace, Civil Safety: yes. Weapons... sigh. One of the issues is that if you make explosives in the US you are typically only selling to the federal government. Thus, independent research doesn't happen, either.

      Should the information be released? Probably not. But the current state has major issues, and as software is more common in weapons and defense system, the resultant mishap is only going to get worse.

    2. Re:Why release it outside the US military, at all? by Anonymous Coward · · Score: 1

      Sorry for replying to myself, but:

      If the system is doing it's job right, it's software development process should be following STANAG 4404 / Joint Software Systems Safety Handbook. They might be handy references if you want to "win the game"

    3. Re:Why release it outside the US military, at all? by Anonymous Coward · · Score: 0

      Among (http://en.wikipedia.org/wiki/United_States_Armed_Forces) 1,466,545 active staff there must be hundreds of thousands potentially useful testers.

      Why not order those already employed overseas who typically spend their free time playing BF3?!

      Otherwise? The general public?! How do they know they don't get fake stats data from potential enemies? Go see "Tinker Tailor Spy".

      This is surreal.

    4. Re:Why release it outside the US military, at all? by chainsaw1 · · Score: 1

      Because you have to know what you are doing to actively edit software code and make a positive contribution. Those who are having countless amounts of free time are typically low NCO's and enlisted, they have little college education, and have to be ready for their next mission after their buddy's truck was blown up on the last.

      This DARPA grant is soliciting for a method of using those idle people to test software without those programming skills. It is not a direct outsourcing of those skills. I don't believe the published request equates crowd to the general public.

      --
      - Sig
  7. Stealth QA by Lashat · · Score: 2

    I doubt that the "games" or "puzzles" would be advertising "This is a DoD test for new software."

    Most likely the users will not be aware that it is a test at all.

    --
    For every benefit you receive a tax is levied. - Ralph Waldo Emerson
    1. Re:Stealth QA by Jah-Wren+Ryel · · Score: 2

      If they didn't spell it out, then they would be courting scandal if it ever got out. Lots of people have moral objections to weapons development - to secretly recruit their labor for something they are morally opposed to would be a huge deal.

      --
      When information is power, privacy is freedom.
    2. Re:Stealth QA by Anonymous Coward · · Score: 0

      > implying that war is a moral practice, and that furtherance of any warfare related activity requires a puny defenseless civilian puke's awareness or moral blessing

    3. Re:Stealth QA by Nidi62 · · Score: 1

      > implying that war is a moral practice,

      War can be moral. If a leader is slaughtering his people by the thousands, with millions more starving and on the verge of death, is it more moral to sit by and watch this happen, or invade and try to prevent the deaths of millions of innocents? If one state invades another state essentially unprovoked, is it not moral to come to the aid of the state being attacked? To go to war in the defense of another, especially of one who is an innocent, is one of the most moral things one can do.

      --
      The only thing necessary for evil to triumph is for it to be pitted against a slightly greater evil
    4. Re:Stealth QA by Anonymous Coward · · Score: 0

      War can be moral, but is usually not. It is fought for political and monetary gains, more often than not.

    5. Re:Stealth QA by Anonymous Coward · · Score: 0

      "Lots of people have moral objections to weapons development - to secretly recruit their labor for something they are morally opposed to would be a huge deal."

      They _know_ they pay for the weapons they're opposed to, are they refusing to pay taxes too?

  8. Crowdsourcing by Anonymous Coward · · Score: 0

    Works for Slashdot, works for Wikileaks, works for the Pentagon. Yay crowdsourcing!

  9. DARPA by Baloroth · · Score: 2

    DARPA is involved, so read this whole story as: this is a cool idea which we think might have some potential down the line but will probably never happen.

    On the other hand, this is a pretty cool idea. Not sure if you can make the puzzles strictly apply to real-life problems and still be fun, though. That in and of itself makes this an interesting idea. If they can overcome that hurdle, there is a lot of potential to this sort of thing.

    --
    "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
    1. Re:DARPA by artor3 · · Score: 1

      It's a very different set of problems, but people have had success getting players to solve protein folding problems for fun with Foldit. Such games take advantage of the enormous human capacity for rapidly finding patterns, compared to computers trying to enumerate all possibilities.

    2. Re:DARPA by DarkOx · · Score: 1

      Wetware still offers impressive performance for some workloads.

      --
      Repeal the 17th Amendment TODAY! Also Please Read http://www.gnu.org/philosophy/right-to-read.html
    3. Re:DARPA by Anonymous Coward · · Score: 1

      DARPA is involved, so read this whole story as: this is a cool idea which we think might have some potential down the line but will probably never happen.

      He says on the internet.

  10. You killed civilians! by Pope · · Score: 5, Funny

    Achievement "Collateral Damage" unlocked!

    --
    It doesn't mean much now, it's built for the future.
    1. Re:You killed civilians! by s_p_oneil · · Score: 1

      In light of the post I saw earlier about "achievements" being added to Visual Studio, Microsoft could make a DoD version and add special military achievements to it. Project types could be:

      * Create new weapons system project
      * Create new flight control system project ...

      Based on the Visual Studio project type, you unlock different achievements when Visual Studio catches you writing bad code.

  11. WTF? by nrasch · · Score: 2

    So let me get this clear: We help them improve the same weapons and other systems they'll be using on us for the NDAA, SOPA, and whatever other unconstitutional laws they have in the works?

    This shows how little respect for us they have as well as how stupid they think we really are.

    1. Re:WTF? by Jeng · · Score: 1

      This shows how little respect for us they have as well as how stupid they think we really are.

      I am fairly sure one cannot underestimate the stupidity of the general public.

      Think of the average person, now remember that half of everyone is stupider than that.

      --
      Don't know something? Look it up. Still don't know? Then ask.
  12. I'm doing my part! by elrous0 · · Score: 0

    Are you?

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
  13. Are you dead yet? by ddd0004 · · Score: 1

    Nope? Ok, wait for the next code release.

  14. Interesting, but DARPA is exaggerating the problem by finlandia1869 · · Score: 1

    I take issue with DARPA's assertion in TFA that formal verification cannot be scaled up to work on a modern weapon system. My office has done it for very long time and we are very software-intensive. We and our contractors just had to get smarter as the system became more complex and requirements became steeper.

    Nonetheless, I would be interested in the potential of such a process to find sneak circuits and latent problems. Use it during the development process prior to integration and verification.

  15. Dali meets Huxley by TaoPhoenix · · Score: 1

    I don't even know what to begin to think about this. The summary tried hard. So the Gov is going to ...uh... release fun puzzles that analyze how weapons are tested? So what are the licenses on the games themselves? Will they be all locked down by copyright or can we chop them up and do other things with the code and make forks?

    Is it all a honeypot?
    "Sir, Mr. X. used our game to hack into us."
    "Uh, well, we did ask him to look for attack points..."
    "Arrest him anyway!"

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
  16. Stupid. by Alex+Belits · · Score: 1

    On one hand, it strikes me as one of those "Let's make something really stupid but plausibly usable, so all our enemies will waste their time trying to duplicate it".
    On the other hand, this is just the kind of stupid I would expect from US military.

    --
    Contrary to the popular belief, there indeed is no God.
    1. Re:Stupid. by geekoid · · Score: 1

      That are using millions of people used to improve methods for analyzing software. That's stupid.

      And by "That's" I mean "You're".

      --
      The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
    2. Re:Stupid. by Alex+Belits · · Score: 1

      lol wut

      --
      Contrary to the popular belief, there indeed is no God.
  17. Stargate Universe? by denis-The-menace · · Score: 1

    Looks like someone has watched SGU episode 1.

    --
    Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
  18. Old School by sycodon · · Score: 1

    "Would you like to play a game?"

    --
    When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
    1. Re:Old School by Joe_Dragon · · Score: 1

      let's play global thermonuclear war

  19. Already Exists by Anonymous Coward · · Score: 0

    FarmVille anyone?

  20. Polybius was a test to see if they can make insane by Joe_Dragon · · Score: 1

    They wanted to see if they can use photosensitive epilepsy, motion sickness and vertigo as a weapon.

  21. you only think its a game by schlachter · · Score: 1

    You only think its a game, until you try to log off in mid battle, and some men in black show up at your basement abode and insist that complete the mission. Ender's Game, anyone?

    --
    My God can beat up your God. Just kidding...don't take offense. I know there's no God.
  22. farmville... by schlachter · · Score: 2

    The DoD will soon be partnering with Zygna to test weapons that placate the masses and keep them occupied and off the streets rather than trying to overthrow our friendly dictatorial regimes.

    --
    My God can beat up your God. Just kidding...don't take offense. I know there's no God.
    1. Re:farmville... by Anonymous Coward · · Score: 0

      You assume that has not already happened .. nor about a posting board.

  23. Re:Interesting, but DARPA is exaggerating the prob by geekoid · · Score: 1

    ".. just had to get smarter.."
    code for: We have deluded ourselves that we can handle it by throwing more process at it.

    And weapon system are far more complex and require far more rigor then your puny software.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  24. Didn't they do that years ago? by Anonymous Coward · · Score: 0

    Weren't they "crowd sourcing" the testing of software with the tomahawk cruise missile?...

  25. Acheivement "Take out Nuke Development Capability" by schlachter · · Score: 1

    I think they will be most interested in the novel ways in which people leverage different technologies and weapons that are available to them in the game to get one up on their enemies. They could even mock up future tech ideas to see how people use them in the game to determine if they are worth funding. Stats from the game can be leveraged to improve battle doctrine or tactical training scenarios.

    --
    My God can beat up your God. Just kidding...don't take offense. I know there's no God.
  26. Paranoia! by Remus+Shepherd · · Score: 4, Funny

    Anybody play the tabletop RPG Paranoia? The Computer (your friend, your boss, and the head of your government) was always crowdsourcing weapon testing to the player characters.

    "Congratulations, citizen. You have been selected to test this box of grenades. To study the optimal grenade design, these grenades have random fuse lengths from zero to ten seconds. Please report your findings with whatever remaining limbs you can."

    "Citizen, welcome to the world of high-tech weaponry. The ULTI-3600 assault rifle has a computer targeting system to maximize accuracy. Please note that to prevent friendly fire accidents, the targeting system will verbally ask for no less than five confirmations before taking any shot. To insure that you properly test this rifle it will now be welded to your arm..."

    "The new Duo-strike vibro knife is twice as deadly as previous models, because the hilt has been replaced with another vibro blade. Pick it up, citizen. Go on. Don't you want to help The Computer test new weaponry? Or are you a traitor?"

    I totally support the way our military is becoming like a dystopian comedy RPG.

    --
    Genocide Man -- Life is funny. Death is funnier. Mass murder can be hilarious.
    1. Re:Paranoia! by Anonymous Coward · · Score: 0

      uh, got any more of those? I need source material for my next game...

    2. Re:Paranoia! by roc97007 · · Score: 1

      > I totally support the way our military is becoming like a dystopian comedy RPG.

      I reluctantly agree, in the sense that at least it's entertaining.

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    3. Re:Paranoia! by DNS-and-BIND · · Score: 0

      The nuclear hand grenade. The blast radius was far, far greater than any distance you could throw the thing. You didn't test it? Traitor!

      --
      Shutting down free speech with violence isn't fighting fascism. It IS fascism!
  27. Angry Birds by Anonymous Coward · · Score: 0

    I thought those pigs had a distinctly Persian look about them.

  28. crowdsource? by roc97007 · · Score: 1

    How many people got a chill when they saw "crowdsource" and "weapons testing" in the same heading? I had missed "software" on first glance. That made it only a little better.

    --
    Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    1. Re:crowdsource? by Anonymous Coward · · Score: 0

      Count me in as a "no" to your question.

    2. Re:crowdsource? by roc97007 · · Score: 1

      Gamer?

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
    3. Re:crowdsource? by Anonymous Coward · · Score: 0

      Yeah, my first thought was they were testing new weapons on protesters.

    4. Re:crowdsource? by roc97007 · · Score: 1

      Exactly! I'm probably older than you; Kent State is what flashed into my mind.

      --
      Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
  29. So that is where Angry Birds came from! by Dareth · · Score: 1

    So that is where Angry Birds came from!

    --

    I only look human.
    My mother is a halfling and my dad is an ogre, so that makes me an Ogreling
    1. Re:So that is where Angry Birds came from! by Anonymous Coward · · Score: 0

      With 60% profits, they're a CIA drug money laundering company for sure.

  30. In Soviet Russia by Roachie · · Score: 1

    They test weapon ON crowd!

    --
    This sig is not paradoxical or ironic.
  31. Fuzzing? by InsertCleverUsername · · Score: 1

    I can kind of grasp how the amazing parallel computer that is the human brain can solve new problems for something like FoldIt, but I can't see how human gamers could improve upon brute force fuzzing and static code analysis of military software. Maybe I have a lack of imagination?

    Anyone care to share a vague guess how something like this might work?

    --
    Ask me about my sig!
    1. Re:Fuzzing? by Anonymous Coward · · Score: 0

      I can't see how human gamers could improve upon brute force fuzzing and static code analysis of military software. Maybe I have a lack of imagination?

      Anyone care to share a vague guess how something like this might work?

      Just think that way...

      in IT, the user ALWAYS DO things wrong... doesn't matter if the system was tested, homologated, if it WAS failproof. the user WILL find some way to get some absurd error...

      if they let "ordinary people" test the software, use the system in the wrong way... they will get many absurd errors, and they can improve it.

      It helps you to understand?

      Lars.

  32. Underway by SuperKendall · · Score: 1

    They wanted to see if they can use photosensitive epilepsy, motion sickness and vertigo as a weapon.

    Hence the push for 3D TV, to crowd source testing of said effects on the general population.

    Advanced weapon systems will consist of large-screen TV airdrops set to loop Discovery Channel shows on sharks and dinosaurs with large buckets of 3D glasses, said to incapacitate a small town in under 1/2 hour.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  33. Crazy Idea by Anonymous Coward · · Score: 0

    Imagine if we used this technology and idea to improve society instead of improving weapons..

    I am sure there are other useful applications of this, besides better ways to kill people

       

  34. Too Late... by Anonymous Coward · · Score: 0

    Valve's already done it:

    "The Enrichment Center promises to always provide a safe testing environment. In dangerous testing environments, the Enrichment Center promises to always provide useful advice. For instance, the floor here will kill you. Try to avoid it."

  35. what could possibly go wrong by dudpixel · · Score: 1

    so if everyone who played the game intentionally did everything wrong, or played badly, would they still use the results?

    --
    This seemed like a reasonable sig at the time.
  36. Call me by Anarchduke · · Score: 1

    When they start crowdsourcing hardware testing

    --
    who prays for Satan? Who in 18 centuries has had the humanity to pray for the 1 sinner that needed it most? ~Mark Twain
  37. I will refuse by xrayspx · · Score: 1

    This is one of the least ethical things I could think of to do as a gamer. If you wish to help you government, help them feed poor people. If I found out that a game I was playing actually helped my government kill other humans more efficiently, I don't even know how I would take that information.

  38. Got this from a slashdot comment by Anonymous Coward · · Score: 0

    so time to pay it forward. This short story was linked stating that military contractors use this book as a guideline to what the future of weapons testing can become.

    Military Diorama - By David Kitson
    http://www.smashwords.com/books/view/35490

  39. This is a sick joke. by Anonymous Coward · · Score: 0

    Aren't all weapons systems seen in the field ultimately tested on crowds already?

  40. Good crowdsourcing and Bad crowdsourcing. by thinkscout · · Score: 1

    There is crowdsourcing in which you look for exoplanets or translate ancient greek texts ( https://www.zooniverse.org/ ), crowdsourcing in which your computer folds protein models to better understand disease ( http://folding.stanford.edu/ ), and then there is crowdsourcing in which you test weapons systems to help kill people more effectively. I like how the Pentagon is skipping the recruitment propaganda part (We Need You! *pointy finger*) and just putting a gun in our hands (sic). Its bad enough that the American government spends as much as it does on "defense" without subversively enlisting people to test weapons systems for them. I won't be playing that particular game.