Slashdot Mirror


Researchers Developing An Algorithm That Can Detect Internet Trolls

An anonymous reader writes Researchers at Cornell University claim to be able to identify a forum or comment-thread troll within the first ten posts after the user joins with more than 80% accuracy, leading the way to the possibility of methods to automatically ban persistently anti-social posters. The study observed 10,000 new users at cnn.com, breitbart.com and ign.com, and characterizes an FBU (Future Banned User) as entering a new community with below-average literacy or communications skill, and that the low standard is likely to drop shortly before a permanent ban. It also observes that higher rates of community intolerance are likely to foster the anti-social behavior and speed the ban.

27 of 279 comments (clear)

  1. In other words by fustakrakich · · Score: 5, Insightful

    Automated censorship. Eh, saves us the trouble, I guess

    --
    “He’s not deformed, he’s just drunk!”
    1. Re:In other words by Kyogreex · · Score: 5, Informative

      The original paper doesn't seem to be about automatic banning at all; that seems to have been added to the headline and the article linked to here (and therefore the summary). The paper says this: "automatic, early identification of users who are likely to be banned in the future."

      While that identification could be used for automatic banning, I think it would be more likely to be used to flag potential problem users, which could be very useful in determining which reported posts to investigate first rather than dealing with all of the "I don't like this post so I'm reporting it" instances.

  2. This is fucking stupid. by Anonymous Coward · · Score: 5, Insightful

    Trolls are usually above average literacy and trying to skilfully cause a fight. It's easy to identify "illiterate" people and humans are way too quick to judge someone who cannot spell as having nothing to contribute or (worse) malicious, but these are not trolls. This is just another classist meme where the person is judged positively by the overcomplexity of their language and convolution of their sentences, as this must mean they have been educamated right.

    BTW I went to a £30k/year British boarding school, so I have no axe to grind, nor insecurity about describing things as they are.

    1. Re:This is fucking stupid. by Mr+D+from+63 · · Score: 4, Informative

      It is stupid to me because it does not solve a problem. Detecting trolls is certainly not a problem, dealing with them is. They need to work on algorithm for that.

    2. Re:This is fucking stupid. by marcello_dl · · Score: 4, Funny

      > Trolls are usually above average literacy.
      Your right.

      --
      ---- MISSING MISCELLANEOUS DATA SEGMENT --- [sigdash] trolololol
    3. Re:This is fucking stupid. by Mr+D+from+63 · · Score: 4, Funny

      No need. Remove anonymity from said sites and the problem is solved. Better yet, don't bother having user comments everywhere.

      posted by an AC. LOL.

    4. Re:This is fucking stupid. by Anonymous Coward · · Score: 4, Funny

      Douché.

    5. Re:This is fucking stupid. by plover · · Score: 4, Insightful

      While I believe that people who are less sensitive tend to thrive more than others, I don't agree that "thicker skin" is a workable solution. Too many people have fragile emotional states and simply don't have the neural hardware psychological capacity required to dismiss the hate and insults that often happen on line. There have been some high-profile suicides among teens who were attacked online, and who knows how many people remove themselves from public comment because of the hate they've received? For safety reasons I don't think society should completely abrogate the forums to the trolls.

      Does that not mean some people are overly sensitive? Sure. But just as we shouldn't velour-line the internet to cater to absolutely every person with a psychological disorder; we also don't have to tolerate the diarrhea that spews forth from the trolls. We don't have to draw a hard-and-fast line on the ground, either, and define "these words are always 100% bad in 100% of situations". Instead, we should be welcoming humans in the loop, asking them to pass judgment when needed. That gets us to a more fluid state than full automation. It also lets the user choose. Don't like the judgment process on Slashdot? Don't hang out on Slashdot.

      I know full automated filtering is the holy grail of internet forum moderation, but as soon as you deploy a filter it becomes a pass/fail test for the trolls, who quickly learn to adapt and evade it. Human judges can adapt, too, and are about the only thing that can; there are simply too few for the volume of trolls out there. A tool like this might help them scale this effort to YouTube volumes.

      --
      John
  3. Dear algorithm by ArcadeMan · · Score: 4, Funny

    I don't want to talk to you no more, you empty-headed animal food trough wiper! I fart in your general direction! Your mother was a hamster and your father smelt of elderberries!

    1. Re:Dear algorithm by Kyont · · Score: 3

      [beep] [boop] [churn] [beep] User 2766669 identified as Python quoter. All further posts automatically accepted. Add automatic +1 Funny for ID ending in 69. [beep] [whistle]

      --
      You shall see a cow on the roof of a cotton house.
  4. Unicorns, skittles, rainbows, etc. by pla · · Score: 4, Insightful

    within the first ten posts after the user joins

    So, this algorithm only needs nine more posts than a troll will actually make per throwaway account, then?

    That's some mighty fine police work there, Lou!

  5. I chuckled... by benjfowler · · Score: 3, Funny

    ... at the term "Future Banned User" (FBU).

    Isn't that just a nice way of saying "somebody our algorithm flags as a complete asshat"

  6. "Old" vs "new" trolling by RogueyWon · · Score: 5, Interesting

    Your mistake is in using the "classic" definition of "troll" - somebody who sets out to deliberately cause fights on a forum. Trawl through the archives of Slashdot and you will find many instances of this kind of trolling - and yes, the people doing it are often highly literate (and, when they do it right, sometimes very funny with hindsight).

    But the term "trolling" has gone political these days and is routinely used to describe any form of online behaviour that the speaker doesn't approve of. So everything from outright criminal behaviour (eg. threats of immediate violence) at one end of the scale through to disagreeing with a forum's established groupthink (however respectfully) at the other.

    And yes, it has become a favourite term of the intellectually insecure, whenever they want to shout down an opposing point of view without engaging with it. In fact, conflating those two extremes I mention above under the same term is outright beneficial for the easily offended, as it allows them to group polite dissenters together with the mouth-foaming loons.

    1. Re:"Old" vs "new" trolling by meta-monkey · · Score: 4, Interesting

      Back in my day, trolling meant something!

      Ten plus years ago I used to troll /. as "Fux the Penguin" (some of my favs) and it was great fun. The system was:

      1) Get in early on a new story. You don't want to get buried under 100 comments.
      2) Lists and quotes are good. Everybody stops to read something with HTML formatting.
      3) Start reasonable. The first paragraph should sound rational.
      4) The next paragraph should include minor errors of fact or logic, but still be mostly reasonable. Just...wrong.
      5) The minor errors of fact and logic in the middle paragraphs should lead to a completely ridiculous conclusion that /.ers would hate, like running Windows, or requiring government approval for encryption technologies.
      6) Watch the post go to +5 insightful because mods don't actually read comments.
      7) lulz at people who write 8 paragraphs dissecting all my mistakes.
      8) -1 Troll.
      9) +5 Funny.

      Today the media conflates "trolling" with "abusive asshole." I think they misunderstand the word "troll." "Trolling" meant "fishing." To dangle bait for newbs to take and work themselves into a lather, and then laugh at those who don't get the joke. It was performance art. Today they think "troll" is referring to monsters who live under bridges. But no, people who stalk others on the Internet and hurl insults at them (or worse) are not "trolls." They are abusive assholes. It's sad.

      And it requires no skill. Trolling is a art.

      --
      We don't have a state-run media we have a media-run state.
    2. Re:"Old" vs "new" trolling by itzly · · Score: 3
  7. Poof! by RogueWarrior65 · · Score: 4, Funny

    There goes Gawker.

  8. Re:This, if true, will utterly destroy by Anonymous Coward · · Score: 3, Funny

    Yes, well, they should definitely ban people who can't point a fucking camera, and probably have them arrested

  9. Re:What is a 'troll'? by Chrisq · · Score: 4, Interesting

    Anybody who tells the truth that the scum in power don't want you to hear, apparently...

    In days when someone can be attested for quoting from a published book by Winston Churchill I have to agree.

  10. Research by Sir_Eptishous · · Score: 4, Funny

    Researchers have detected researchers detecting an algorithm detecting researchers researching.

    --
    We play the game with the bravery of being out of range
  11. Oblig XKCD by Anonymous Coward · · Score: 3, Funny

    https://xkcd.com/810/

    Seems relevant.

  12. Uh Oh... by edibobb · · Score: 3, Funny

    Looks like my days on the internet are numbered.

  13. I run a feminist forum by spacefem · · Score: 3, Insightful

    and volunteer to help test. We have a steady stream of trolls available for review, a truly endless supply.

  14. How about state-sponsored trolling? by mi · · Score: 3, Insightful

    I can see, how this may defeat (ab)users trolling for fun and not suspecting automated detection before it hits them (though, with only 80% accuracy, I dread the thought of the methods expanding out of the virtual realm).

    But what about people "trolling" professionally — paid and/or otherwise compelled into it by a state or corporate actor pretending there to exist some kind of "grass-roots" movement? How would it deal with thousands of fake accounts mounting a coordinated assault, posting (while "liking" and "following" each other)?

    Some times you may be able to catch accounts posting identical things at the same exact time (and ban them all in bulk), but Russians seem to have fixed that bug in their bots now...

    This is turning into another battle like that, in which spammers have fought the best Information Technology minds into a standstill. I doubt, progress against forum-spammers will be much better than that — not when mere technology, however clever, is up against interests of a reasonably powerful state.

    --
    In Soviet Washington the swamp drains you.
  15. Re:This, if true, will utterly destroy by Stan92057 · · Score: 4, Insightful

    Your talking about racism, this article is about internet trolls They are not the same. A person with a different view is not a troll. A person with a different opinion then you is not a troll. Ive been tagged a troll because of my views a few times.Many here will post as anomoue because they know there opinions will be viewed and tagged as a troll.

    https://en.wikipedia.org/wiki/Internet_troll

    --
    Jack of all trades,master of none
  16. Re:This, if true, will utterly destroy by Immerman · · Score: 4, Funny

    Nonsense. Next you'll be suggesting that the technology might be intentionally abused to silently bias "unmoderated" conversations about [REDACTED], which would be a frightful step toward &^%- - -
    [REMAINDER OF COMMENT DISCARDED AS TROLLING]

    --
    --- Most topics have many sides worth arguing, allow me to take one opposite you.
  17. Trolling vs. Different Viewpoint by msobkow · · Score: 3, Interesting

    Unfortunately, many people think that if you express a different viewpoint or opinion than the masses that you're trying to start an argument or a fight. Why is society so hell-bent on crushing dissenting opinions? And not merely silencing them, but villifying them?

    I've often been tagged as "trolling" because I don't agree with the crowd. If you knew me personally, you'd know very well that I'm not trying to start a fight, just expressing my opinion. Just because it is not the popular viewpoint doesn't mean my views aren't valid.

    Here on Slashdot, I often see people flagged as being trolls just because they don't follow the masses. You'd think a site full of outcasts and oddballs like programmers and technologists would be more accepting of alternative views, but the exact opposite seems to be the case.

    --
    I do not fail; I succeed at finding out what does not work.
  18. Re:This, if true, will utterly destroy by Obfuscant · · Score: 3, Insightful

    yes, and now we get into the same sort of pointless useless territory as arguing about what "hacking" means

    Because both "troll" and "hacking" have been made into pointless useless words through the magic of "common use" by common people who have no clue what they were supposed to mean.

    "An algorithm that can detect trolls" is a meaningless statement. If it is an algorithm, it needs a definition to work from. That definition is not going to be based on historical or accurate usage of the term. In fact, the summary gives you a good idea what it will be based on:

    It also observes that higher rates of community intolerance are likely to foster the anti-social behavior and speed the ban.

    So, the "definition" of "troll" is going to be "people who display unpopular or angry behavior when confronted by an intolerant social media environment." Gee, anyone slashdotted recently? "Community intolerance" is not the problem, I guess, it's the reaction of people in a supposedly open forum to that intolerance.

    There will be no direct definition as such. It will be an empirical model based on correlation between use of angry or unpopular phrases and the subsequent ban of the poster. That's the new "troll". Say enough stuff that people don't like, you're a troll.