Slashdot Mirror


Spotting And Culling Terrorist Groups On Social Media: Pipe Dream, or Possibility? (nytimes.com)

An anonymous reader writes: Can Twitter Spot Terrorists and Put Them In Jail? Hany Farid, the chairman of the Computer Science department at Dartmouth University, thinks so. He told the New York Times that there's "no fundamental technology or engineering limitation" to spotting terrorists on the Intertubes. In other words, he's figured out how to tell the difference between bragging terrorists and kids who are just joking about being "da bomb." Can artificial intelligence make these distinctions? Or will it generate a ton of false positives? Or is Prof. Farid just trolling for more grant money to make Dartmouth the premier department for spying on social media?

38 of 69 comments (clear)

  1. Anything Is Possible . . . by tiberus · · Score: 1

    If Google and Facebook can target me with ads for male enhancement, breast implants and Elmo . . .

    1. Re:Anything Is Possible . . . by Greystripe · · Score: 1

      Caitlyn is that you?

    2. Re:Anything Is Possible . . . by laird · · Score: 3, Insightful

      Ads can afford a low 'hit' rate, because the cost of being wrong is very low. A good ad gets a 3% response rate, meaning 97% of the time it's a "false positive", but it's still profitable because ads are dirt cheap (0.5 cents would be high) so if you make a few dollars on the 'hits' you can easily cover the misses. In counter-terrorism, each false positive requires detectives to work the lead, making them extremely expensive to pursue. That's why every data mining approach to counter-terrorism has failed so far - the cost of pursuing the false positives gives data mining leads negative value, because they pull resources away from more productive approaches.

      But the government's non-technical management loves the idea, and keeps allocating money to it, and unscrupulous researchers will keep taking the money.

    3. Re:Anything Is Possible . . . by tiberus · · Score: 1

      Why do you ask? Looking for a date?

    4. Re:Anything Is Possible . . . by KGIII · · Score: 1

      Kinda? She's kinda hot. I already have a girlfriend. It's not gay if you have sex with a transgendered woman. I have this on good authority.

      --
      "So long and thanks for all the fish."
  2. Yes to one of these. by Anonymous Coward · · Score: 5, Insightful

    Or is Prof. Farid just trolling for more grant money

    If you want an infinite pool of grant money in electrical engineering in the UK, you go for something with clear defence applications. I expect similar applies for IT.

    What I find embarrassing in all this is that there is really nothing stopping thousands of people being shot every day by lone wolves except that people are generally not that shitty. And when there is propaganda to drive people to do horrific things that they would not normally do, it doesn't come from the DEEP DARK OMG WEB (you have to really want it in the first place to look hard for it there, by its very nature), but from regular media pounding the TV/radio/web sites with news about previous attacks and the threat of the enemy, marginalising and factionalising and dividing and conquering (while arms are sold to both sides, and politicians take great advantage).

    Here's the thing: terrorism is not a big threat in Western nations. In fact, world violence is at a relative low. What is at the highest of highs, however, is the ability to quickly set the narrative for news, getting people to panic about all the appropriate things, then turning their attention to some new event to stop them reflecting too much.

    1. Re:Yes to one of these. by fermion · · Score: 1

      It seems to me that when so white kid goes out and kills a bunch of kids or shoots up a movie theater, we look at their online activity and see that they were clearly deranged and should have under surveillance. That and he was from the Carolinas which are a hot bed of radicalizing terrorists. The problem is that separating those terrorists from the vast majority that are venting is a non trivial problem. Sure, we could require target every white male from North and South Carolina but that would not be a great use of resources, even though we know that it would have saved a large number of innocent lives of the past decade.

      --
      "She's a scientist and a lesbian. She's not going to let it slide." Orphan Black
  3. Anonymous Has Already Done This by Nova+Express · · Score: 5, Funny

    At least at a certain level, with Anonymous taking out thousands of pro-Islamic State Twitter accounts with Operation Tango Down. Now that's just one service, and nothing prevents them from signing on again. But you can slow momentum and make it harder for supporters of terrorism to broadcast their views to supporters without reprisals, and also limit or prevent coordinated action.

    Best of all, it's possible to do it merely for Terms of Service violation, without government action.

    Of course, to actually defeat terrorists, you have to kill them faster than terror organizations can create new terrorists, and to dry up their financial support (of which the Islamic State has plenty in "moderate" Sunni states...)

    --
    Lawrence Person (lawrencepersonh@gmailh.com (remove all "h"s to mail)

    http://www.lawrenceperson.com/

    1. Re:Anonymous Has Already Done This by Anonymous Coward · · Score: 4, Insightful

      Isn't that the game?

      If this man could identify terrorist speech (i.e. speech from terrorists), then you'd use his software and arrest the terrorists and there would be no Paris and no San Bernadino. He has a computer, he has an Internet connection, there is nothing stopping him writing his software.... yet he hasn't.

      Instead he (and you) define terrorists speech as different, e.g. "supporting or condoning groups you deem as terrorist", or speech from people you believe are supporter of terrorism.

      But that's basically saying "I can make a filter to select X" and "I define X as what my filter chooses". So he doesn't plan to filter terrorist speech, he plans on selected a group of texts in a filter and DEFINING THAT as the terrorists speech he wants to stop.

      Language is a funny thing, and language processing (e.g. for translation) is go awful, so of course he can't deliver on his promises, but he can define his promise to be what he delivers!

    2. Re:Anonymous Has Already Done This by Rei · · Score: 5, Interesting

      Unfortunately "violations for terms of service" is just as vulnerable to false positives. The other day I went to check out a video on Youtube and found out that it had been pulled for violation of the terms of service. Someone clearly glanced at it and saw screenshots all too familiar: a row of Daesh (ISIS) thugs in all black, their prisoners in orange jump suits before them forced to kneel, guns pointed to their head for an execution. Youtube has taken up a policy of banning such videos.

      Except, that's not what the video was. The video was not from Daesh but Levant Front, an anti-Daesh coalition. The people in black were Levant Front members and the people in the orange jumpsuits Daesh solders that they had captured. And rather than execute them, they all holstered their guns, took off their face masks, and walked away, while an imam showed up and gave a sermon to the Daesh prisoners about forgiveness and being fair and just in life. In short, it was precisely the opposite of the Daesh videos that Youtube is supposed to ban.

      False positives are a real thing.

      --
      Nothing says 'welcome to the neighborhood' like a gunny sack full of dead squirrels.
    3. Re:Anonymous Has Already Done This by Koreantoast · · Score: 1

      The much vaunted #OpParis has not been a success as advertised. The level of false positives has been massive, with many of the so-called IS accounts and websites being pro-Kurdish, pro-Palestinian, or even simply targeted because they happen to be in Arabic. Think about it, does Anonymous really have the depth of knowledge on terror networks, or even enough competent Arabic speakers, to vet thousands of Twitter accounts and websites? Do they know enough about Arab cultures to understand the nuances of whether or not these Twitter accounts are really pro-IS or simply just requoting IS for news or even trolling IS in Arabic?

    4. Re:Anonymous Has Already Done This by mrclevesque · · Score: 1

      " to actually defeat terrorists, you have to kill them faster than terror organizations can create new terrorists "

      That's never worked, didn't in Iraq, didn't in Afghanistan, won't here. Helping democracy grow is a long term process, especially after a population 's been bombed, profiteered, and overall, alienated.

      " and to dry up their financial support "

      First I think you need to look at why is it so easy for them to get so much financial support.

    5. Re:Anonymous Has Already Done This by 140Mandak262Jamuna · · Score: 4, Insightful

      See, terrorists WANT a war with the West. They WANT us to kill them - they have no fear of death because when they die, they are delusional enough to think that there is some sort of awesome afterlife when they die for their Jihad. It's religious fanaticism at its extreme. Every time the US or coalition forces kill terrorists, it is seen as an attack on Islam. And Muslims in other countries rush in to help their "Muslim Brothers".

      So them Muslims (moderate or otherwise) would not distinguish between West's attempt to kill terrorists and West's attempts to wage war on Islam. But the West is expected to very carefully distinguish between terrorists and non-terrorists. And every mistake by West is yet another round of moderate Muslims condoning/justifying/excusing/tolerating/accepting more Muslims turning terrorists. Why is this double standard?

      Even the moderate Muslims are not tolerating non Muslims doing things that are not binding on them. If someone draws the picture of Mohammad or Allah, the moderates are NOT saying, "that depiction is hurtful to our sentiments, please do not do it, but I do recognize your first amendment free speech rights to draw such pictures". They are saying "that depiction is hurtful to our sentiments, so some Muslims will kill you, they won't recognize your free speech first amendment rights, so please don't do it". What goes without being noticed is that the moderate Muslim is refusing to teach his extremist factions to recognize our first amendment rights.

      One thing the West can do is to show the Muslims how to earn the real deep respect from the West by avoiding violence and confrontation. Hindus and Buddhists and native religions and pagan religions are not engaged in a war with the West. If Americans go out of their way to show obvious, open, highly publicized respect to these religions it would draw a contrast. It would allow the moderate Muslims to tell their extremists, "See how that pagan deity or that Buddhist temple is being congratulated, praised and respected by the Christians and the Jews of America! Islam is drawing hatred and violence only because of your terrorism!".

      But even the atheists and secularists were showing extremely disrespectful depictions of Jesus, Moses, Ganesha and Abraham to show off the "tolerance" of these religions. What Muslim sees is not the "tolerance" of these religions but cowardice of them not defending their deities.

      --
      sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
    6. Re:Anonymous Has Already Done This by laird · · Score: 1

      Terrorism isn't a military contest, it is a political contest, taken by people who are committed to a cause that is clearly losing (islamic fanatics, christian fanatics, white supremacists). If you kill terrorists, you kill many non-terrorists as well, and that just makes more people hate you, aiding their recruiting. Layer on top idiot politicians (Trump) that spew racist broadsides that promote terrorist recruiting even more, and the situation never gets better.

      The way to defeat terrorists is to remove the desperation that makes people vulnerable to being recruited to do horrible things. If people have decent lives, jobs, schools, family ties, etc., they're not tempted to join crazy causes. That's why the millions of Moslems in Indonesia (for example) aren't terrorists.

    7. Re:Anonymous Has Already Done This by majid_aldo · · Score: 1

      the hindus got rid of their western occupier.. the british. muslims have dealt with and are still dealing with the effects of european colonialism, US meddling and support of dictatorships, and support for israel.

      --
      --- widget evolution: enhanced, plus, super, ultra, extreme, exxxtreme, ultra-extreme, ..etc.
    8. Re:Anonymous Has Already Done This by 140Mandak262Jamuna · · Score: 1
      I don't know if you are really a Muslim or some one pretending to be one to troll Muslims. But threatening violence against anyone for drawing any picture would put one squarely in the extremist/terrorist category.

      But we Americans do have the right to draw any figure we want, and our government has the obligation to protect it. This is our home, and this is the law of the land. Do not come to America if you are not willing to abide by our constitution.

      --
      sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
    9. Re:Anonymous Has Already Done This by tehcyder · · Score: 1

      Human communications all take place within a context. Without context, you cannot tell whether a person is quoting someone else, mocking them,a greeing with them or anything else at all.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
    10. Re:Anonymous Has Already Done This by tehcyder · · Score: 1

      I don't know if you are really a Muslim or some one pretending to be one to troll Muslims. But threatening violence against anyone for drawing any picture would put one squarely in the extremist/terrorist category.

      But we Americans do have the right to draw any figure we want, and our government has the obligation to protect it. This is our home, and this is the law of the land. Do not come to America if you are not willing to abide by our constitution.

      As a general rule, when someone on the internet says "I am a Muslim" they're lying. You can verify this by noting how they will invariably end their comment with the threat of extreme violence.

      In reality, most Muslims are not extremely violent, or else we'd have a 1.5 billion strong army of psychos ruling the world.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  4. So, Donald Trump had a good idea? by Nikkos · · Score: 4, Interesting

    The article below this one is full of 'Trump is an idiot' (and he is), but here in the next article we talk about using AI to cull posts.

    'Closing up the internet in some way' would be akin to spotting and censoring a group of people's comments, yes? Effectively limiting their internet use, yes?

    Potatoes, Potatos.

    1. Re:So, Donald Trump had a good idea? by Tomahawk · · Score: 1

      Interesting. However, Donald wants to close it up for everybody, whereas this is talking about identifying (but not actually blocking, yet that _could_ be a next step) certain types of speech behaviour. This is more about identification than obstruction.

    2. Re:So, Donald Trump had a good idea? by tiberus · · Score: 3, Funny

      Uh, not just no.

      There's an entire universe between the excrement that Trump spews and using AI, heuristics, machine learning, etc. to identify terrorists or more likely terrorist like behavior. If nothing else this would give humans searching for terrorists a place to start. It would be a constant arms race but, it is certainly worth the try.

    3. Re:So, Donald Trump had a good idea? by KGIII · · Score: 1

      A Libertarian would say that it is censorship in either case but only when the government does it (or forces it) is it wrong. Well, most would, I hope. However, we have our share of idiots in the party so you might be right.

      Censorship doesn't absolutely require it to be done by a government for it to be censorship. When a government does it by regulation or coercion it's generally a bad idea. Why? Well, in my humble opinion, prosecuting or persecuting thought isn't a good thing. Instead, we should prosecute actions that are cause harm to others in a meaningful fashion.

      I have no problem when a business does it. Why? It's their property and they get to make the rules (to some extent) on their property. If there are no other choices then it sucks to be you unless you've the means and wherewithal to create your own service but you've no right to insist another give you aid or a platform.

      If I make a forum and disallow the use of the word "viscosity" then I'm well within my rights to do so. You've no right to say that word on my website. If the government disallows the use of the word "viscosity" there's surely something amiss and we should probably oust those who'd suggest such. We might even need to resort to force if they refuse to give up their offices after an electorate indicates that they're obligated to do so. So far, in my country, we've not had that problem during my lifetime. One might stretch the US Civil War, War Between the States, War of Northern Aggression, into something along those lines but that's a topic for another day.

      --
      "So long and thanks for all the fish."
  5. Why would you do that ? by aepervius · · Score: 1

    One one hand that certainly slow down *a bit* recruitment, amount unknown, but that also mean they go underground are are much more difficult to spy on. Much better they stay up, FBI / GIGN /Whoever spy them on, and can catch recruitment attempt or anything suspect.

    --
    C. Sagan : A demon haunted world:
    http://www.amazon.com/gp/product/0345409469/
    visit randi.org
  6. Useless by crow_t_robot · · Score: 1

    How about working on something useful instead of pouring all this time and money into a solution for something that is more rare than getting hit by lightning while riding a dolphin?

  7. Re:The decision has already been made. by bill_mcgonigle · · Score: 1

    He is doing this to express his loyalty and connection to the US.

    Doubtful. I've had technical discussions with Mr. Farid before. He was at the top of his game in the graphics field in the 90's (my stupid MBA boss rejected a great offer from him to work on our project - I was mortified). Since then he's become the top expert in validating image authenticity; in doing so he's developed unique and innovative approaches to the problems of extracting signals from noise.

    In some ways, the idea of discriminating types of speech is along the same trajectory of the work he's done to date, if one abstracts the information theory from the graphics application. A broad class of work like that will have innumerable applications; I have my doubts about the value of this application, but if that's where the funding is, so much better for the science.

    aside: it's cool that he's chairing the department now - when I was taking classes there the people who actually applied the science were looked down upon. The only fun people were the grad students and the rogue profs who advised them. :)

    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  8. Answers by ZorroXXX · · Score: 3, Insightful

    Can Twitter Spot Terrorists and Put Them In Jail?

    No.

    Can artificial intelligence make these distinctions?

    No.

    Or will it generate a ton of false positives?

    Yes.

    Or is Prof. Farid just trolling for more grant money to make Dartmouth the premier department for spying on social media?

    Yes.

    As always, follow the money (or alternatively, he is incredible stupid and actually belives in it).

    There is always an easy solution to every human problem -- neat, plausible, and wrong. -- H. L. Mencken,

    --
    When you are sure of something, you probably are wrong (search for "Unskilled and Unaware of It").
  9. Clever line - but is it true by Bruce66423 · · Score: 1

    In the light of the San Bernardino and Paris attacks - as well as the random lone wolf attacks in Israel, let alone the ongoing civil wars in Syria, Yemen, Sudan, Libya and Afghanistan, it seems likely that more people are being killed by Islamists than by lightning, let alone whilst riding a dolphin. Which is a sad thought.

    However you are correct that terrorism is still a rare phenomenon in the West, and there are better things to spend money on in terms of return

    1. Re:Clever line - but is it true by mrclevesque · · Score: 1

      Yeah, various perspectives are informative

      How many civilians have been turned into "collateral damage" by US and allied forces in the middle east over past decades.

  10. Sure, spotting terrorists is easy. by hey! · · Score: 3, Insightful

    ... if you don't mind mis-identifying non-terrorists as terrorists.

    It should be so obvious that it goes without saying, but the people who cobbled together things like the anti-terrorist watch lists after 9/11 didn't seem to grasp this: the wider you catch your net, the smaller proportion of what you haul out of the ocean is comprised of fish.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  11. Hany Farid by PPH · · Score: 1

    Farid

    Match detected. Roll the SWAT team.

    --
    Have gnu, will travel.
    1. Re:Hany Farid by angel'o'sphere · · Score: 1

      But you missed Achmed ;D

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
  12. Re:Who profits from this push for pre-crime? by Joe_Dragon · · Score: 1

    pre-crime will have a hard time getting past the constitution.

  13. Re: Autocensorship never works by Anonymous Coward · · Score: 1

    Man I love 'retard'. The most funny and less offensive insult there is. If I had a Down child, I would call him/her when I come home: "where's my little retarded cutie?" :)

  14. Enough! by DriveDog · · Score: 2

    Didn't BASIC come from Dartmouth? Haven't they caused enough damage already?

  15. No: FBI/CIA/NSA hides well from social media by Thing+1 · · Score: 1

    They create sock puppets and use them to drown out dissent. They brought back the opium market in Afghanistan after the Taliban had destroyed it. They destabilize foreign countries (see John Perkins' "Confessions of an Economic Hit Man"). Paying taxes is adding to evil. I haven't yet decided to fight the IRS though. One approach would be to make checks to that collections agency "payable to the US Treasury", not to that illegitimate organization. And I've been studying other methods of escaping from the corporate matrix.

    --
    I feel fantastic, and I'm still alive.
  16. Re:Who profits from this push for pre-crime? by Joe_Dragon · · Score: 1
  17. Re:Who profits from this push for pre-crime? by mrclevesque · · Score: 1

    Point taken.

    But if you include the quotes with "charged with plotting" it returns 200,000 results, not 10,500,000

  18. He's trolling his balls off by Shoten · · Score: 1

    The problem with this is the "base rate." That's what decides your bias as to whether you will have more false positives or false negatives, assuming equal probability of both.

    If 1 person in 1,000,000 is a terrorist, and you have a 99.9% accuracy rate (for both false positive and negative), then that means roughly 1 innocent person in 1,000 will be flagged as a terrorist. That's 1,000 people per million...or, in the United States with its current population of 321 million people (as of July 2015, according to the Census Bureau), over 300,000 people. And while you're getting your legs shoved feet-first up your own ass for harassing that many innocent citizens, the 3,210 terrorists you should be chasing are probably slipping out of your grasp because you're so busy going over a third of a million people with a fine-tooth comb looking for evidence of radicalization and threat that you won't be able to find because they're innocent.

    So, let's turn the dials...let's say 99.99% accuracy rate. Great...so now you've only gone batshit crazy on 32,000 people. Still epic fail.

    99.999% accuracy rate...and it bears noting that I can think of no test that I've ever seen of any form that is even close to this accurate...and you're still bugging 3,200 people.

    This is patent bullshit, and it makes me nuts when academics think about playing God with real world this way. I know that research is the driver behind innovation, but the very concept of what he's pushing violates so many "this has been tried before" rules of thumb that I think it's irresponsible of him to approach it without keeping it quiet until he has something somewhat valid to work with.

    --

    For your security, this post has been encrypted with ROT-13, twice.