Computer Models Find Patterns In Asymmetric Threats
The Narrative Fallacy brings us a story about a project by University of Alabama researchers to develop a database capable of anticipating targets for future guerrilla attacks. Quoting Space War:
"Adversaries the US currently faces in Iraq rely on surprise and apparent randomness to compensate for their lack of organization, technology, and firepower. 'One way to combat these attacks is to identify trends in the attackers' methods, then use those trends to predict their future actions,' said UA-Huntsville researcher Wes Colley. 'Some trends from these attacks show important day-to-day correlations. If we can draw inferences from those correlations, then we may be able to save lives by heightening awareness of possible events or changing the allocation of our security assets to provide more protection.' Researchers reviewed the behavior signatures of terrorists on 12,000 attacks between 2003 and mid-2007 to calculate relative probabilities of future attacks on various target types."
Wow, is it just me or does this just sound like a total waste of money? The attacks are surprises and random, how are they going to try to extrapolate patterns with computers? Why not just hire a psychologist?
So predict the unpredictable?
I'm sick of following my dreams. I'm just going to ask where they're goin' and hook up with 'em later.
...past performance is no guarantee of future performance.
As lame as it sounds, it would be a step up from the current method my gov't(US) uses: treat everybody like a criminal.
It's all part of game theory. If your enemy doesn't randomize their tactics, then you can take advantage of any statistical bias or pattern. Soon anyone buying a geiger counter, thermal noise diode, or even a lava lamp, will be a candidate for the terrorist watch list.
Shortly after the study began however, the patterns began to match-up to something surprisingly familiar. We have determined that the terrorists are using Windows' random number generator to pick their targets.
Demented But Determined.
FTA
"This study considered two aspects of each attack: the target of the attack, and the time of the attack. Using careful statistical techniques, the team identified correlations between attacks on various target types as a function of time. For instance, if there were an attack on a government target, that somewhat increased the chance of an attack on a police target over the next several days."
Sounds pretty strait forward. If you have a brazen attack against, say, a base, you can expect a higher risk of attacks on other assets. Isn't that why after the 911 attacks there were Combat Air Patrol flights over every major city for days. This is just common sense...
I've read Slashdot for the last 5 years, and now I start posting... Go figure
They are not random, they are in Iraq. GTFO of Iraq, and attacks stop. Hmmmm... Could of just bought me a coffee and donuts for that one as opposed to putting how many billions dollars on my generations shoulders?
So the writers of "Numb3rs" found someone willing to hire them during the writers' strike?
What ever happened to spending more on hiring the best talent around and also spending more on intelligence gathering!
I have discovered the final solution:
They attack the weak point for massive damage!
Computer models are only as good as their data: Garbage In, Gospel Out. That's a problem with climate modelling. The climatologists keep tweaking the models until they get what they expect and are then smug because the models "prove" their predictions.
If terrorist activity is truely random, then this thing does not stand a chance. However, terrorists, like most people, likely follow some sort of pattern and if the signature "tell tale signs" can really be detected then perhaps attacks etc can be predicted.
Engineering is the art of compromise.
It isn't whether it is an optimal strategy, but whether these tools improve materially the effectiveness of intelligence. "Discovery" AI/Expert systems were finding new materials processes during the 1980s.
Oh ye of little faith. Still, trust in god but lock your car.
Verizon: Latin for "poor rural service".
Supposedly one of the better spies (I forget which) always carried a coin in his pocket that he'd flip every few minutes to make random decisions (get to a street corner: turn or go straight? Flip).
Engineering is the art of compromise.
touch me in my sexy spot
Using computers sounds far more scientific than reading tea leaves.
Engineering is the art of compromise.
I imagine a strong basis for correlation would be "target is a member of armed forces engaged in hostile occupation of foreign country invaded on false pretences for strategic reasons." E.g. America in Iraq, Vietnam, Afghanistan, Russia in Afghanistan, Germany in France.
In other words, the best way to reduce these types of attacks is to avoid invading other countries without (at least) the invitation of the citizens. Compare, for example, UN peacekeeping forces in Kosovo who are not subject to constant random attacks precisely because the general populace wanted them there.
America needs to learn to address the underlying disease, not the symptoms. Likewise terrorism: remove the underlying motivation (hint: it's not "terrorists hate freedom") and resolve the problem.
Read Pynchon.
If these models work out I'd say we might be seeing the beginnings of Psycho-history...
The people of Iraq have a right to resist their occupiers by any means necessary. If a government with a century-long history of aggression and crushing democracies were to invade your country, I'm sure you'd agree. That anyone would develop technology to aid the occupiers is shameful. If anything, try to come up with a computer model for ending the war and imprisoning its architects and enablers.
So if you do the threat analysis and modify your response, that causes the pattern to be disrupted -- kind of like making a measurement in quantum mechanics changes the underlying system.
Numb3rs
How about saving lives by not using air-strikes in densely populated civilian neighbourhoods? It doesn't take a computer model to tell you that bombing towns and cities is going to kill civilians and create a lot of very angry (and probably armed) people.
If you have enough data to make statistically significant observations for such a project, it might be time to get the f outta there...
Researchers reviewed the behavior signatures of terrorists on 12,000 attacks between 2003 and mid-2007 to calculate relative probabilities of future attacks on various target types.
All of which will change now because a)they may know about it because of the news story or b)if it works, US forces will behave differently.
The precalculated probabilities and patterns will be worthless. All it will take is the guerrilla fighters changing how they pick targets.
Please help metamoderate.
I love the terrorist-fearing pant-loads crying that the terrorists use women and children to fight off the people who have invaded and occupied their country. Do they really think American women and children wouldn't volunteer to help resist the Chinese, if they entered our nation and set up a puppet government?
All I can say about this conflict is that nobody I give a shit about was stupid enough to believe the government's lies and enlist to fight in Iraq. My deepest condolences for those who enlisted pre-2003 to defend their nation...these men and women are being misused.
Blar.
Sadly they have lots of data to work with.
I would predict that the worst attacks occur in crowded markets where there are lots of people.
The only pattern I can really agree on is the one where we see the US spending billions in research against something that a simple change of foreign policy could (still?) avoid.
And BTW, I thought you guys stopped relying too much on spy sats and computers an more on HUMINT?
Recently we discovered that some djihad groups are training 8 years old kids to be suicide bombers, that's were we are, the US wants to stop it? Then think with humanity.
I have a fool-proof method for completely avoiding any future attacks upon our troops in Iraq. Get the fuck out of Iraq. Stop invading countries for the purpose of lining the pockets of defense contractors and protecting the interests of oil tycoons and central bankers. Predictable idiotic responses to my idea: the terrorists will have won! The terrorists have already won a new recruiting and breeding ground, thanks to gw, cheney and rumsfeld. Iran will take over Iraq: let them have it. they're probably too smart to want the trouble though. there will be civil war and genocide. we already have that, pay more attention. we'll destabilize the middle east. we already did that.
The whole problem with guerilla tactics is that we don't know who to watch. If we could identify the attackers, don't waste time studying them. Just take them out.
OTOH, if this is an exercise in correlating past attackers behavior with patterns in the general population, it would require surveillance of that population the likes of which we are barely beginning to see.
If any anomalous behavior might get you labeled as a possible terrorist, you'd better think twice about switching from Windows to Linux.
Have gnu, will travel.
All you need to do is carry a coin etc around and flip it every now and then to randomise behavior. Good spies did this. So did good submarine commanders etc.
Heads we attack this week, tails we don't. Heads we turn at the next corner, tails we don't. Heads we turn left, tails we turn right etc etc. Heads we fly United, tails Continental.
FBI can try make a patern of that but all they'll do is burn CPU cycles
Engineering is the art of compromise.
Anti-terrorism efforts are always a bet against human ingenuity.
This is a perfect way of preventing any ingenuity on your own side, not that there is much of that in any gov effort.
Lew
"The Constitution, the WHOLE Constitution, and nothing but the CONSTITUTION."
The correct question is not "Why use computers"", or "Why not just hire a psychologist?". This is a government funding exercise. The correct answer is, "Why not do both?". We can frivolously blow twice the cash on white-collar welfare if we refuse to limit ourselves. Remember: the proper boolean operator is AND, not OR. /. time with these half-measures.
Now, Brian: proceed to your journal, write a post saying "AND, not OR" 500 times, and quit wasting valuable
Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
First, if they're using randomness to generate attacks, it's obviously impossible to predict. Yes, yes, small patterns may emerge, but it seems like a ridiculous idea to try and predict what a randomly connected network of people will try and do. Rather, assess *your* patterns - that's what they're doing anyway - and find your own vulnerabilities. In fact, we should be using predictive software to determine what we'll do, and then do something... random. Our best bet is simply to be unpredictable, not to predict them.
Moreover, our efforts towards prevention should be around large scale disaster response. We can assume bad things will happen sometimes, but it's the gigantic, unexpected thing, the Black Swan that's the real danger. Being mobile and responsive, preparing for the worst, we'll do a much better job of fending off attacks.
$.02
from invading a country that did not attack us, letting osama slip through tora bora into pakistan, didnt use enough troops in iraq in the first place, lets billions of dollars go unaccounted for and missing, .... where is the computer that is going to make decisions based on basic common sense and logic? where is that machine?
This crap has to stop if we are ever going to balence the budget or have a productive society.
In the early parts of the cold war there were "researchers" who got millions from the government for making charts and databases of who sat where during the Moscow May Day parade and similar bullshit, and analyzed and tried to predict "the Soviets are having problems with X missile program" based on the fact that someone coughed when a truck passed by or some shit.
Every few years the program would die off and be re-incarnated slightly different. In spite of the money spent, the cold war was characterized by the US being caught by surprise numerous times and generally vastly over estimating the enemy.
In the last few decades, a new twist on the scheme is to use "prediction markets" or betting pools, and some how devine the future from the numbers. If you talk to the proponents of those schemes, it is never clear where they think the information that Osama is about to attack will come from -- do they think that the billionaire cave-dweller terrorist himself will not be able resist investing in the market ? That one of his subordinates will do so ? That the CIA analysts who should know can't be trusted to tell the truth in their reports, but that for the sake of a couple of grand they will reveal their real opinions in a glorified office betting pool ?
Remember when experts used to get on Fox News and gravely announce that the "chatter" had risen in their captured communications ? Did they ever call one right ?
The fact is, there is a deeply embedded human instinct, to believe when presented with a bunch of random or semi-random data, there is some clue to be decoded. People spend their lives decoding hidden messages in Shakespeare, the Bible, the innards of sacrificed chickens, credit card transactions, stock market fluctuations, tea leaves, phone records, etc. Suppose these goddamn charlatans find that you can print out the data, turn it sideways and squint, and it looks even more like Jesus than the famous grilled cheese sandwhich. What then ?
There is likely little we can do to reduce the overall amount of research spending. But I believe that even ordinay people can effect the direction of it; and we can do that through mockery and redicule. Those eggheads may claim to investigate the truth for pure science and the advancement of knowledge useful to humans, but if every taxi driver, plumber, or student laughed in their faces when told what they researched, they'd write grants for something else. And since that something else might have a slim chance of being useful, that's what we ought to do.
For some reason the even the weather seems easier to predict than terror, yet we still get it wrong. It isn't like the wind and the clouds conspire against us.
"Now to Brenda, for this weeks terror forcast."
"3% chance of war."
No need to flee the country this weekend. Great.
I recently listened to a podcast about risk analysis using software. What I found amusing is the World Tower (9/11) attacks had a high prediction but the pointy headed ones called it an aberration so ignored it. You can have the best analysis on the planet even with a 99% certainty but all you need is some pin headed public servant to ignore it either for political or personal reason and the whole thing falls apart.
Asimov's Psychohistory was the first thing I thought if too http://en.wikipedia.org/wiki/Psychohistory_(fictional)
it's not exactly like we haven't seen the source o windows 2000.
God i hope it's gotten a lot better since then.
http://www.microsoft.com/presspass/press/2004/feb04/02-12windowssource.mspx
Just like backtesting stock trading strategies doesn't guarantee future success, this probably won't make anyone any safer than making us take off our shoes, or emptying our shampoo bottles, before we get on airplanes...
But, someone will make a fortune from it...
Here's what I propose...It will probably work just as well...
Send emails to half of the people telling them to stay home and to the other half, tell hem to act as usual...
Lather, rinse, repeat...Profit!
Goofy, Geeky Gifts and More!
The ENTIRE THING was preventable by not invading a sovereign nation and killing a messload of innocent civilians in the name of... what exactly was it again? I seem to have forgotten.
You reap what you sew. What we have sewn is to made a significant fraction of the world's population hate us, and our former friends distance themselves as we become the militarily aggressive nation that everyone fears. We've become the Germany of 1938, the Japan of 1936. In 2008, it's America. Small wonder the local population is giving their lives to drive an aggressive foreign power out of their homeland.
JEFFREY
Here's my theory on that. While I was
institutionalized, my brain was studied
exhaustively in the guise of mental health.
I was interrogated, x-rayed, studied
thoroughly. Then, everything about me
was entered into a computer where they
created a model of my mind.
They all stare, mesmerized, at the strutting JEFFREY. Is he
serious? Is he crazy? Doesn't matter -- he's charismatic.
JEFFREY (cont.)
Then, using the computer model, they
generated every thought I could possibly
have in the next, say ten years, which
they then filtered through a probability
matrix to determine everything I was
going to do in that period. So you
see, she knew I was going to lead the
Army of the Twelve Monkeys into the
pages of history before it ever even
occurred to me. She knows everything
I'm ever going to do before I know it
myself. How about that?
I love that idea that this information might help to save lives. What it really means is that the army gets to kill a lot more foreigners on their land, with less risk to themselves. More people will die, not less. But I forgot, brown people don't count as real people, especially if they don't speak English.
This work was done at the University Of Alabama in Huntsville (UAH), not the University Of Alabama (UA) like the main post says. UAH did start as a satellite campus of UA, but became a separate university a few decades ago. I guess some news travels slow.
"Luncheon meats make the sawdust in your stomach explode."
Perhaps the US could stop invading sovereign nations.
Nah, obviously I'm just kidding. Carry on.
Buckets,
pompomtom
"There's an exception to every rule. Except for some rules"
"These UAHuntsville scientists hope to help provide a better intelligence posture on these asymmetric threats by developing computer models that identify trends in the behaviors of the adversaries." the data is finally in after teraflop after teraflop of intense scrutiny. 100% of the random terrorist attacks have been carried out by members of the species that built the calculator.
The ENTIRE THING was preventable by not invading a sovereign nation and killing a messload of innocent civilians in the name of... what exactly was it again? I seem to have forgotten.
...
*sigh*
I hate it when people trivialize the reason the US went into Iraq.
It's a *very* complex, very powerful function of time. However, it can be simply summarized thusly:
Begin: Terrorists are hiding out in Iraq, and Iraq had something to do with 9/11
Month 1: Weapons of Mass Destruction
Month 2: Liberate Iraq from the tyranny of a dictator
Month 3: Bring democracy to the Middle East in order to stabilize it
Month 4: Them WMDs are still out there, and they're not going to destroy themselves, you know
Month 5: Iraq is going to flourish now they have democracy
Month 6: Mission accomplished!
Month 7: That dictator had help hiding the WMDs, but we'll find them once we're in complete control
Month 8: Iraqis are fighting back! They're terrorists! See? We told you they were there!
Month 42: Iran is building WMDs!
Know what I hate? It was so patently obvious Iraq had no WMDs, and no capability of developing anything more dangerous than mixing bleach with ammonia.
It's over 6 years since 9/11, and we're no closer to catching bin Laden than we were at the beginning. Didn't somebody famous vow he would bring the perpetrators of 9/11 to justice? Now, I know that vows don't mean a lot to everyone, but they *should* matter to the leader of the world's most powerful nation. But, then again, he vowed to uphold and protect the Constitution, as well.
Oh, well. Fuck it. I am trying to let go of my hate, so I may find peace.
Somebody on this planet should have peace, anyway.
Microsoft is to software what Budweiser is to beer.
...on why the USA is so hated that there have been TWELVE THOUSAND terrorist attacks in three and a half years?
Or is that just crazy defeatist talk?
John McCain wants to spend another century collecting data for this research project.
--
make install -not war
The recurring factor is douchebag with a vendetta.
It's not a waste of money, because humans are not random. They may seem random, but that's because you don't know what to look for.
This example explains it the best: if I'm on top of a building and you're at street level and I tell you "there's a red car coming, then a green car, then a yellow car and they should be near you in 2 minutes." Am I seeing the future?
You don't need to be a psychic to see the future. You just have to be able to look at things in the right way.
Remember the urban legend of "beer and diapers"? (If not, just do a search on the intarweb)... Seriously, Non-Hypothesis-Based Data Mining is all about removing pre-conceived ideas about how data should be extracted or may be interpreted from a given database of "seemingly random" information. For instance, let's say a study shows that for a given populated area, a high-number of Leukemia cases happen along a path which follows an overhead powerline. The natural hypothesis might be to assume that the powerline is (at least partially) at fault for those cancer cases; However, if you remove that hypothesis, your mind will be open to more possibilities for the illness numbers. An example can be that powerline trail housing tends to be less desirable, and therefore more affordable than those homes only a few blocks away. Maybe, because those lower cost homes draw lower income families, that their initial health care is not up to par, and other contributing factors and causes go undetected. Maybe those lower income families tend to eat more processed food and less ruffage, also contributing factors. Once again, remove the hypotheses, and the conclusive results will be even more profound that you could once perceive. ~m
"Yes, I have a Disaster Recovery Plan. It's called my Resume"
They could just use the programs that determine AI in video games. Line the streets with explosive barrels; terrorists ALWAYS duck behind those for cover.
counterintelligence realized most people do not flip when crossing the street.
No, I'm joking. Seriously though, one of the things the military does in Iraq when looking for the foreign jihadis is they watch for wrong turns off main thoroughfares. It is apparently pretty effective at sorting out people who aren't from around here -- if you know Main Street less well than the Americans, you just might be from out of town!
Help poke pirates in the eyepatch, arr.
"patterns" are everywhere.
http://en.wikipedia.org/wiki/Overfitting
The attacks only seem random to the uninformed; i.e. the US Army.
If the Army manages to correlate against the above factors the insurgents simply use the above analysis to improve their chances. This is not a system of independent variables. Any success that the Army has will be countered by a change in strategy by the insurgents. The data that you analyze becomes invalid when you attempt to use it.
Sure, that's why you have test sets to determine if the models the system learns from the data are useful or not. I think it's safe to assume that the scientists working on this are familiar with the basics of learning theory and modeling.
It is never safe to assume that people (and scientists) are capable of doing things "right". Incompetence and mediocrity are so pervasive that you can just rule this out, unless you see some evidence to the contrary
\
This whole exercise brings technical analysis to mind - extensive research into a huge waste of time, with the spectre of making $$$. Say, I wonder if this is some private firm trying to get research dollars for whatever half-baked idea they can come up with. Money is kinda like oxygen.
To be fair, I think an extensive detailed database system would be invaluable to crime fighting officials.
Like all pain, suffering is a signal that something isn't right
I, for one, welcome our new terrorist attack forecasting overlords
Sorry folks, I HAD to do that!
But hey, they should try finding some precogs http://en.wikipedia.org/wiki/Minority_Report_(film) .
So can we assume the 3 bald heads in a swimming pool aren't working as well as expected then?
Biomech
The American Revolution only happened because Americans had to use non-'noble' fighting techniques to defeat the better armed, trained and supported British. Also, only half the nation was into the fight anyway. I used China as an example, but I suppose Russians would be more acceptable, since they've begun their saber rattling.
Read a fucking history book, jackass.
Blar.
reportedly trying to acquire a nuclear-decay based random generator.
They had previously been using this
http://www.redorbit.com/news/display/?id=126649
But then there are other forms of terrorism, such as flying a B2 filled to the gunnels with high explosive munitions that rain down on the homes and hovels of innocent civilians.
Americans like to bark about terrorism as in the form taken by small groups of murderous assholes, frequently on a suicide mission. And they bark louder when a state gets involved in support of such efforts. But they refuse to take responsibility (much less blame) when they themselves act as State Sponsored and funded terrorists by bombing the living fuck out of innocent civilians. Whether it's a team of suicide bombers or a team of bomber flight crew, the results are the same: mass death of innocent civilians.
And don't go cracking a pantload over how the Iraqis attacked your freedom. WHEN did the boat filled with Iraqi soldiers float to the USA and attack your freedom? What day was that? I sure would like to know because I was taking a vacation in this lovely little place called REALITY. The USA is a terrorist nation. Its unwarranted and unwanted and utterly idiotic invasion of Iraq has resulted in the deaths of hundreds of thousands of people there. Whether it is death strapped to some delusional team of assholes chanting ALLAH, or some cynical assholes flying at 12,000m dropping ordnance all over a city and thinking it's a job well done, the results are the same: dead civilians at the hands of a team of assholes.
Here's a way to predict terrorists attacks: check the flying sortie records of the US Air Force.
RS
Shoes for Industry. Shoes for the Dead.
stop the wart crimes and pull out.
Nuff Said.
The only thing new in this world is the history that you don't know.[Harry Truman]
From the submitter's comment, it sounds like all they're doing is using undergraduate-level statistics. Finding correlations in 2 datasets is *FAR* from new; you can do it yourself with all kinds of data on Swivel.
/. reader should know that. A correlation in data does not mean there is any actual connection between them: there is surely a non-zero correlation between lobster prices in Maine and the number of prostitutes murdered in Thailand. But that does not mean they are in any way connected.
But correlation != causation; any
Social scientists have been struggling with this problem for decades, particularly that most-empirical of social scientists, the economist... Predicting human behavior can be broadly performed with simple statistical models, true. But to gain accurate, actionable information is quite a more challenging task.
That CS profs are treading on ground that social scientists have already, with dismal results, suggests one or both of two things: a lack of cross-disciplinary study on the CS profs' part (quite likely, given the insular nature of us CS people), and/or an over-fascination with statistical techniques they haven't experienced enough to realize just how limited they really are in their real-world predictive capability, given dirty, inspecific, inconsistent data...
Is Capitalism Good for the Poor?
You act as if the USA has never used these sorts of tactics and has some sort of high ground from which to disparage those who are defending their way of life against what they see as invaders and corrupt countrymen. What do you think the nuking of Japan was like?! Remember the civil war?
Whatever dude...I know it's just easier to accept what you are told about terrorists by your government.
Blar.