Slashdot Mirror
San Francisco Team Wins DARPA's De-Shredding Contest
New submitter karlnyberg writes with an update to the recently announced de-shredding challenge posted by DARPA: "The team 'All Your Shreds Are Belong To U.S.' has correctly solved all five puzzles, and the Challenge has now ended. You may view the winning team's submissions as well as the complete puzzle solutions by following the links on our homepage. We recognize that many of our participants have devoted countless hours to painstakingly piecing our puzzles back together, and we truly appreciate everyone's efforts. Hopefully you enjoyed the Challenge and learned something new along the way. We certainly did!"
Thanks for helping the government spy on me.
To offset political mods, replace Flamebait with Insightful.
Vernor Vinge's 2006 novel Rainbow's End explained how a library was being digitized by shredding all the books, thus destroying the analog knowledge.
One step closer...
Misleading titles? Inflammatory blurbs? Keep in mind that Slashdot is a tabloid.
Wake me up when they have the Ash Challenge.
It's not paranoid when they've established a consistent pattern of spying on citizens without cause in the wake of 9/11.
Dog is my co-pilot.
I don't see this being very useful for overseas operations. They mentioned before this would be good for recovering documents shredded by "warlords' operations" but that doesn't seem to make a lot of sense. Many of the warlords we are most concerned about right now have such a dramatically different sense of morality than our own that they use rape as a weapon - or tool, really - of war.
Why, then, would we expect them to use a shredder for their documents, when they can much more easily set fire to the documents? No amount of de-shredding is going to put back together documents that have been incinerated.
I suspect we are much more likely to see this used by the FBI than the CIA or DOD.
Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
Actually, it's not the "US government reading our stuff" thing that caused this whole contest. If The NSA wants your credit card info, they'll just ask Visa for it, pay the usual fees, then just get it mailed to them.
The government shreds a lot of paper. Probably more in a day than I generate in a lifetime. The Classified shit they shred when they're done (IAW DOD-WTF-1234) because it's easier than burning. Trust me, you don't want to burn Classified stuff.
Someone probably said, "hey, do you guys think that with today's video cards and CPU power, someone could unshred our shit?"
"Oh... aw fuck, Dave, I dunno. Let's ask DARPA."
Thus the challenge.
---
ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
The test was actually much simpler than any real-world application might be. Each puzzle was really only one or two (or a few) shredded pages, with various degrees of shredding and various bits of writing. It is a first step, but nowhere near what you would be dealing with in any real-world situation where hundreds or thousands of pages of shredded documents would be mixed together.
I participated (a bit) with the UCSD team that basically made a crowd-sourced jigsaw puzzle to do it - at last check they were in the top 5, but I don't think they got the last puzzle (yet). This approach seems reasonable for the relatively simple puzzles of the challenge, but it really wouldn't scale very well - requires a lot of labor.
It sounds like the winning team had a much better (and more scaleable) strategy, where an algorithm scores all of the pieces for fit in a particular place and then allows the user(s) to choose the best piece from a few high-scoring ones. While I still don't think this would work very well in a real-world scenario, obviously it would work better than depending on massive crowd sourcing.
Here's a nice explanation of the participant which reassembled four of the five documents, finishing in third place.
You should probably start burning your mail: What I learned from the DARPA Shredder Challenge.
NSA-approved shredders are good enough for destroying classified documents up to TS; the shredded remains do not need to be controlled. The shreddings are fine enough that no piece of output can contain a single glyph at any reasonable font size. The shreddings of even a single piece of paper are shuffled together by the action of the blades. These shredders aren't cheap, but I bet they'll stand up to state-level threats of reconstruction for the next 10 years or so.
If that's not good enough, some locations use burn-boxes - never trust a machine to do thermodynamic's job!