Slashdot Mirror


Reuters Built An Algorithm That Can Identify Real News On Twitter (popsci.com)

Reuters has built an algorithm called News Tracer that flags and verifies breaking news on Twitter. The algorithm weeds through all 500 million tweets that are posted on a daily basis to "sort real news from spam, nonsense, ads, and noise," writes Corinne Iozzio via Popular Science: In development since 2014, reports the Columbia Journalism Review, News Tracer's work starts by identifying clusters of tweets that are topically similar. Politics goes with politics; sports with sports; and so on. The system then uses language-processing to produce a coherent summary of each cluster. What differentiates News Tracer from other popular monitoring tools, is that it was built to think like a reporter. That virtual mindset takes 40 factors into account, according to Harvard's NiemanLab. It uses information like the location and status of the original poster (e.g. is she verified?) and how the news is spreading to establish a "credibility" rating for the news item in question. The system also does a kind of cross-check against sources that reporters have identified as reliable, and uses that initial network to identify other potentially reliable sources. News Tracer can also tell the difference between a trending hashtag and real news. The mix of data points News Tracer takes into account means it works best with actual, physical events -- crashes, protests, bombings -- as opposed to the he-said-she-said that can dominate news cycles.

64 of 122 comments (clear)

  1. "Built to think like a reporter"... by Anonymous Coward · · Score: 5, Funny

    Does it vote Democrat, as well?

    1. Re:"Built to think like a reporter"... by rdelsambuco · · Score: 1

      Fake comment.

      --
      I comment occasionally so that I can mod others -1 overrated or -1 offtopic.
    2. Re:"Built to think like a reporter"... by elrous0 · · Score: 2, Insightful

      Yeah, if it's from Reuters and "thinks like a reporter" then the algorithm will be quite simple

      IF (newsSource = conservative)
          THEN (fakeNews = true;)
          ELSE IF (newsSource = liberal;) THEN (fakeNews = false;)
          ELSE {SEND(story,DNC,vetting);}

      --
      SJW: Someone who has run out of real oppression, and has to fake it.
    3. Re:"Built to think like a reporter"... by LifesABeach · · Score: 1

      I'm thinking that Reuters working on anything AI is fake news. I think anyone that doesn't use a PAI, Personal Artificial Intelligence, as a filter on their favored news feeds enjoys the glory of Proud Stupidity. And ignoring on coming traffic is a mistake made only once.

    4. Re:"Built to think like a reporter"... by LynnwoodRooster · · Score: 1

      Unfortunately, true. Also interesting to note that journalism as a whole is sexist (many more males than females), racist (declining and way under-representative of minorities), and opposed to equal pay for equal work. So while they tend to champion such things as equality for all in theory - they really don't carry through in actions.

      --
      Browsing at +1 - no ACs, I ignore their posts. So refreshing!
    5. Re:"Built to think like a reporter"... by PortHaven · · Score: 1

      Very likely....does not vote. But it sure as heck campaigns Democrat.

  2. Amazing by Anonymous Coward · · Score: 1

    I bet all their news is the "real" news!

  3. The source code by Anonymous Coward · · Score: 5, Insightful

    if (article.agenda() != ourAgenda) article.fake = true

    1. Re:The source code by Xyrus · · Score: 1

      Actually its:

      if (Trump.isPissed()) article.real = true

      --
      ~X~
  4. Re:Sad to see Trump has forced... by Anonymous Coward · · Score: 2

    Nice try HUMA ABEDIN.

  5. No by phantomfive · · Score: 2, Funny

    Reuters Built An Algorithm That Can Identify Real News On Twitter

    Lies.
    I hope it flagged itself.

    --
    "First they came for the slanderers and i said nothing."
  6. Re: Sad to see Trump has forced... by Anonymous Coward · · Score: 1

    He's already creating jobs.

  7. The litmus test by ckatko · · Score: 5, Insightful

    Does anything on Huff, and WaPo pass?

    You know the funniest thing about everyone talking about "fake news"? They make it look like it's only a conservative rag problem. People's memories are so razor short these days, they've already forgotten that The Rolling Stone published literal, fake "news" about a campus rape story, ruined peoples lives, and were sued for 8 (reduced to 3) million dollars.

    If people here were half as skeptical as they claim to be, they'd have no respect for conservative AND liberal "journalists." Science demands proof. It doesn't care if the lack-of-data is coming from people you like.

    1. Re:The litmus test by fisted · · Score: 1

      Science demands falsifiability.

      FTFY

    2. Re:The litmus test by h33t+l4x0r · · Score: 1

      I remember that Rolling Stone story, it wasn't fake news but it was bad journalism.

    3. Re:The litmus test by Patent+Lover · · Score: 1

      Never mind that several journalists questioned the Rolling Stone article, and reported the doubts about it's credibility.

    4. Re:The litmus test by Xenographic · · Score: 1

      > I remember that Rolling Stone story, it wasn't fake news but it was bad journalism.

      How, exactly, do you distinguish those?

      And if anything, doesn't that imply that "bad journalism" is more dangerous because people are more likely to trust it when it comes from a supposedly-reputable source?

    5. Re:The litmus test by h33t+l4x0r · · Score: 1

      Real news gets it wrong sometimes. Everybody makes mistakes. That's what retractions are for. Fake news gets it wrong intentionally and that's what makes it dangerous.

    6. Re:The litmus test by ArylAkamov · · Score: 1

      They ended up getting sued over that? Good to hear.

      As for HUFFPO, I could never take them seriously, but this was a new low: http://imgur.com/a/tNYQS

      Rename from huffingtonpost to huffpaint when?

    7. Re:The litmus test by jedidiah · · Score: 2

      Not really. There's only confirmation bias. It can be on the part of the reader or on the part of the journalist but it's just as bad either way. People will even take OBVIOUS satire sites and take them seriously so long as it fits their internal narrative.

      "Journalists" do this too. They will ignore stories that don't fit their narrative. They will rush to judgement when it suits their narrative.

      --
      A Pirate and a Puritan look the same on a balance sheet.
    8. Re:The litmus test by evilviper · · Score: 1

      While I agree with everything you've said, you're making false equivalences... One (huge) mistake doesn't turn a legit news organization into a supermarket tabloid, just as a few lies on one side doesn't balance out a voluminous blatant and continuous intentional disinformation campaign on the other side.

      THAT is a perfectly valid reason why discussion on the topic tends to be one-sided, even if problems on the other side need to be resolved as well.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    9. Re:The litmus test by Xenographic · · Score: 2

      So when CNN has a lawyer employed by them tell us false statements about the law, what does that count as?

      Chris Cuomo on CNN -
      https://www.youtube.com/watch?v=_X16_KzX1vE

      An explanation of how badly wrong he is:
      https://popehat.com/2016/10/17/no-it-is-not-illegal-to-read-wikileaks/

      Chris' bio on Wikipedia showing he's a licensed attorney:
      https://en.wikipedia.org/w/index.php?title=Chris_Cuomo&oldid=752709245

      Also, we have a motive in that they rigged the debates with the DNC in DKIM-validated emails signed by both Hillary's mailserver and Google's with signatures that cover the body and body hash.

    10. Re:The litmus test by h33t+l4x0r · · Score: 1

      If it happens once it's a mistake. If he makes a habit of it then it's fake.

    11. Re:The litmus test by guises · · Score: 1

      That link is just an image of a joke headline. What were you actually talking about here? I tried searching for the image and the headline and came up with nothing.

    12. Re:The litmus test by bongey · · Score: 1

      Really bad photoshop, you covered up half the image with a white text background.

    13. Re:The litmus test by AmiMoJo · · Score: 1

      That image appears to be fake. The article isn't on their web site and no one seems to have archived it. Beyond that, it's a rather poor Photoshop, MS Paint quality really.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    14. Re:The litmus test by AmiMoJo · · Score: 1

      Do you understand the difference between an opinion that turns out to be incorrect as a matter or law, and just making up completely fake clickbait to enrich yourself at the expense of democracy?

      To put it another way, while occasionally CNN might get flagged by this, other sources would have 90%+ of their output flagged.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    15. Re:The litmus test by Xenographic · · Score: 1

      You assume, without evidence, that people actually believe clickbait. No, what people actually believe is when people present evidence. When they do real investigations, which have all but stopped for budgetary reasons.

      And no, this wasn't an understandable wrong opinion. That was horribly, badly wrong by someone who should have known better. Given that it tended to cover up CNN's own misdeeds, I'm not having an easy time writing that off as a mere mistake. As someone else put it, "false exculpatory statements are used for what?"

    16. Re:The litmus test by Xenographic · · Score: 1

      Also, what about CNN interviewing its own cameraman?

      https://www.youtube.com/watch?v=0_W5cDjy3uU

      Or editing what people said to convey the opposite message?

      https://www.youtube.com/watch?v=S-8Cn6boqcA

      Are these all accidents?

      Anyhow, my point would be to look at the actual facts in a story (if any) and totally filter out the opinion and predictions. The source of facts doesn't matter, what really matters is whether they're verifiable or not. Trying to rebut facts with opinions doesn't work. It just makes that person look dumb. This does require more actual thinking, though.

  8. Re: Sad to see Trump has forced... by Darinbob · · Score: 1

    By essentially blackmailing a defense contractor. Sure, it works, but you can't do this large scale. And threatening to take away some business with government if they don't do what they're told elsewhere is what many leftist/socialist governments do to force businesses to fall in line, which seems somewhat ironic here.

  9. "Reuters Built An Algorithm That Can Identify Real News On Twitter"

    No they haven't. Ask me how I know.

    --
    Just cruising through this digital world at 33 1/3 rpm...
  10. How news spreads? by R3d+M3rcury · · Score: 1

    [...] how the news is spreading to establish a "credibility" rating for the news item in question.

    I wonder if it takes into account the old saw about how "A lie can travel around the world while the truth is lacing up it's boots."

  11. Algorithms != Implementations by flargleblarg · · Score: 1

    I am really sick of people misusing the word algorithm.

    Reuters did not build an algorithm. They devised an algorithm and then built a system based on that algorithm.

    Algorithms are methods... processes... ways of doing things. Algorithms are not implementations. Algorithms are the conceptual steps, not the manifestation of those steps.

    1. Re:Algorithms != Implementations by Wraithlyn · · Score: 1

      You're using a very narrow definition of "build".

      Build (verb): 7) "to form or construct a plan, system of thought, etc"

      http://www.dictionary.com/brow...

      Completely valid use of the word.

      --
      "Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
    2. Re:Algorithms != Implementations by flargleblarg · · Score: 1

      You've completely missed the point. The point isn't misuse of the word "build"; it's misuse of the word "algorithm."

    3. Re:Algorithms != Implementations by Wraithlyn · · Score: 1

      Um whatever dude, you said this:

      Reuters did not build an algorithm. They devised an algorithm

      That's what I replied to.

      TFA says "Reuters has built an algorithm called News Tracer that flags and verifies breaking news on Twitter."

      Again, perfectly valid language here. This is not "misuse" of either "algorithm" or "build". Your complaint is asinine.

      --
      "Mind, as manifested by the capacity to make choices, is to some extent present in every electron." -Freeman Dyson
  12. Oh boy, the media is not bias by rsilvergun · · Score: 1

    they're going so far out of their way to not be biased that they're giving a voice to absolutely apeshit ideas. That's what got us Trump.

    What's the old joke? Reality has a liberal bias.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Oh boy, the media is not bias by elrous0 · · Score: 1

      Ha, you must be a time-traveler from the pre-SJW leftist era. These days the apeshit coming from the SJW left makes the old A.M. radio batshit coming from the right look positively sane.

      It's a pretty bizarro world where liberals are now the ones screaming for banning free speech and bullying their opponents into silence. They've even managed to one-up conservatives on their conspiracy theories. I remember laughing after Obama's election when pawn shops were reporting a run on gun-buying from gun nuts convinced that Obama was coming for their guns. The I read a story recently about how there has been a run on birth control from crazy lefties convinced that Donald trump is coming for their birth control. Lol, same crazy, different day.

      --
      SJW: Someone who has run out of real oppression, and has to fake it.
    2. Re:Oh boy, the media is not bias by guises · · Score: 2

      If you actually read that article you'd see that they're not afraid of Trump taking away their birth control, they're afraid of Trump taking away their health insurance. Something which he has explicitly promised to do.

    3. Re: Oh boy, the media is not bias by Bartles · · Score: 1

      No he hasn't.

  13. Re:Crying wolf... by Anonymous Coward · · Score: 1

    I agree, since the DNC has adopted Nixonian tactics, then they should arrested just like those assholes were.

  14. Official liars by manu0601 · · Score: 1

    I wonder how such a system can cope when US Secretary of State claims Iraq has weapons of mass destruction. True or false?

    1. Re:Official liars by Orgasmatron · · Score: 1, Troll
      --
      See that "Preview" button?
  15. So... by God+of+Lemmings · · Score: 1

    they wrote something which validates what the narrative is and what free thought is. I bet they don't tell you which is which.

    --
    Non sequitur: Your facts are uncoordinated.
  16. For propaganda definitions of "real news". by sethstorm · · Score: 1

    If this was as good as it supposed to be, it'd put nearly everyone at Reuters out of a job. Their primary product is fake news.

    The only thing this will do is use natural language to identify narrative-breaking articles before they can gain traction with the public.

    --
    Twitter supports and protects racists - by smearing their critics with the "Hate Speech" label.
  17. Re: in the context of tweets by darkain · · Score: 1

    Or you can simplify the forced boolean state in most languages for not-quite-boolean returns by using a double-not !! before the function name!

  18. Re:Just blacklist the keywords of a click bait by darkain · · Score: 1

    Also blacklist any article which starts with a number in the title. This will kill about 95% of buzzfeed bullshit right off the bat.

  19. Still searching by petes_PoV · · Score: 1

    The algorithm weeds through all 500 million tweets that are posted on a daily basis to "sort real news from spam, nonsense, ads, and noise,"

    Has it found any, yet?

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  20. Re:Crying wolf... by Sique · · Score: 1

    The DNC put millions of people in concentration camps and killed them?

    --
    .sig: Sique *sigh*
  21. That was not fake news again by aepervius · · Score: 3, Insightful

    Fake news are hoax news made especially to lie to people. The rolling stone stories was not fake news it was somebody which lied about being raped. That is not the same thing. Again, if I pretend I was raped by a NFL quarterback, and give an interview to CNN, it isn't fake news, because they do the interview in good faith. That is the hinging point : the publisher publish in good faith - at worst you can say they are a crap journal because they did not check properly. But if CNN start publishing a news that republican have a special club where they fiddle kiddies, and manage to get it spread, while fully knowing it is wrong, it is fake news.

    --
    C. Sagan : A demon haunted world:
    http://www.amazon.com/gp/product/0345409469/
    visit randi.org
    1. Re:That was not fake news again by Raenex · · Score: 1

      Fake news are hoax news made especially to lie to people.

      That's all well and good, but there's a spectrum between hoaxes, spin, and unbiased (as is reasonably possible) factual reporting. What the mainstream media is trying to do is conflate "fake news" with alternative, right-wing news sites that put their own spin on the news, but it isn't "fake".

      As should be obvious by now, the mainstream news has a left-wing bias and apply their own spin to stories, sometimes more blatantly than others. And there are plenty of blatantly left-wing sites to correspond with right-wing sites, but they haven't been scrutinized while sites like Breitbart have.

  22. Initial fake news story was so easy to spot by prolitariac · · Score: 1

    As far as I can tell this whole fake news thing started because of an article claiming Trump would end up with more popular votes in the election. I read that article and would probably fall within the category of people where it may reinforce their political biases. Yet, it was so obviously wishful thinking anyone with any degree of critical thinking would see it for what it was. Its primary source was twitter, and it said so right up front. If using twitter to determine popular vote counts makes sense to most people then we have some serious issues. It did use some common misunderstandings of how votes are counted in the case of absentee ballots, but these were all easily debunked a little later on. I think most people who read the article quickly figured it out. The problem (I think) was many people did not read the article. They just sent it along on their Social media feeds which tricked a bunch of other search algorithms. On Slashdot we sometimes don't even read the summary, why would you expect average Joe to dig into a headline that already confirms their world view.

  23. Re: I'm glad your comment by LifesABeach · · Score: 1

    Poor A/C FauxNews is a painless form of Lobotomization.

  24. Re:Crying wolf... by packrat0x · · Score: 1

    Concentration Camps:
            Japanese, German, and Italian Americans during WW2.
    and Killed Them:
            only the ones that enlisted in the military (Cannon Fodder).

    --
    227-3517
  25. Real News Definition by Dunbal · · Score: 1

    I'm guessing Reuters defines "real news" as anything reported by Reuters. Everything else is of course "fake news". Pretty simple algo, really.

    --
    Seven puppies were harmed during the making of this post.
  26. Re:Crying wolf... by LynnwoodRooster · · Score: 1

    Well, it was FDR who interned hundreds of thousands, it was Truman who dropped atomic bombs, so...

    --
    Browsing at +1 - no ACs, I ignore their posts. So refreshing!
  27. Re: I'm glad your comment by LynnwoodRooster · · Score: 1
    --
    Browsing at +1 - no ACs, I ignore their posts. So refreshing!
  28. Re:Just blacklist the keywords of a click bait by HiThere · · Score: 1

    I don't think that would suffice, though it's certainly a reasonable weighing consideration. And what they specified as the technique wouldn't suffice, either, though it would reduce the fake news considerably. And invite a "fake news" arms race.

    At some point verification requires somebody you reasonably trust actually going and checking. I suppose a video might count, but you need to consider that every video is going to provide you with a biased view, selected by the angles from which observation happens. And fake videos aren't unknown, so you need to start including ways to detect whether the video was altered...which invites another arms race.

    And you'll never be really sure. You shouldn't be sure of even things that you personally saw, because memory is fallible.

    So consider this program as something that improves the signal-to-noise ratio. If that's the goal there are lots of things that can be done, and the early versions should be succeeded by more advanced versions for a long time. And even the early things are useful.

    For comparison, consider the progress in e-mail filters. And the twin problems of false positives and false negatives. Now imagine trying to do without ANY e-mail filter.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  29. Re:So would this have identified by HiThere · · Score: 1

    Distinguish between fake and wrong. They don't mean the same thing.

    --

    I think we've pushed this "anyone can grow up to be president" thing too far.
  30. What is the criteria? by PortHaven · · Score: 1

    For this to be of any use, the criteria needs to be posted publicly. For example, very little proof has been proffered regarding Russia's supposed involvement in hacking the DNC. And many say it looks more like forces inside the U.S. intelligence community.

    So how does this Reuter's tool handle such a case? Claiming that a politically appointed security chief of the government states something, therefore it must be factual or true is a very poor measure. What if a Trump appointed security chief states something. Will that be substantial enough for proof? Or will this really just be a tool that says "those articles that think like us will be deemed true, and those that do not will be deemed false"

  31. EXACTLY!!! by PortHaven · · Score: 1

    This pretty much sums up the Al-Gore-ithm.

  32. WHAT GOT US TRUMP by PortHaven · · Score: 1

    Was having the Democrat party engage in the largest mass voter disenfranchisement and fraud in U.S. history in order to push the most corrupt and corporate connected politician to ever run for POTUS.

    THAT is what got us Trump.

  33. By this definition by PortHaven · · Score: 1

    We can label CNN, ABC, Fox, MSNBC, HuffPo pretty much ALL fake news outlets.

  34. Re: I'm glad your comment by LifesABeach · · Score: 1

    I am referring to the analysis where FauxNews made you more stupid than before you started listening to it; that is fact.