Slashdot Mirror


Google's Featured Snippets Are Worse Than Fake News (theoutline.com)

Adrianne Jeffries, reporting for The Outline: Peter Shulman, an associate history professor at Case Western Reserve University in Ohio, was lecturing on the reemergence of the Ku Klux Klan in the 1920s when a student asked an odd question: Was President Warren Harding a member of the KKK? Shulman was taken aback. He confessed that he was not aware of that allegation, but that Harding had been in favor of anti-lynching legislation, so it seemed unlikely. But then a second student pulled out his phone and announced that yes, Harding had been a Klan member, and so had four other presidents. It was right there on Google, clearly emphasized inside a box at the top of the page. "I understand what Google is trying to do, and it's work that perhaps requires algorithmic aid," Shulman said in an email. "But in this instance, the question its algorithm scoured the internet to answer is simply a poorly conceived one. There have been no presidents in the Klan." Google needs to invest in human experts who can judge what type of queries should produce a direct answer like this, Shulman said. "Or, at least in this case, not send an algorithm in search of an answer that isn't simply 'There is no evidence any American president has been a member of the Klan.' It'd be great if instead of highlighting a bogus answer, it provided links to accessible, peer-reviewed scholarship."

13 of 183 comments (clear)

  1. Rank reputable sources by ranton · · Score: 5, Insightful

    If sites like Google and Facebook want to let algorithms decide which information to highlight, they will need to spend more time doing human assisted ranking of various information sources. Crowd sourcing will be very helpful here, but you will still need some human moderators who can perform real research to help determine which information has credibility. I know too many otherwise intelligent people who are becoming so disenfranchised they just don't believe anything they read anymore, which is the ultimate goal of these misinformation campaigns.

    --
    -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
    1. Re:Rank reputable sources by pastafazou · · Score: 5, Insightful

      Yes, that's all we need is crowd sourcing to help determine the truth. Popular opinion should matter more than actual facts.

    2. Re:Rank reputable sources by ranton · · Score: 4, Informative

      Yes, that's all we need is crowd sourcing to help determine the truth. Popular opinion should matter more than actual facts.

      Crowd sourcing would not be the only source of data, but it can provide a great deal of help. Once you have rated a relatively small number of information sources as reputable or not, you can view which users are ranking those few sources correctly. You can then mostly ignore the users who are giving false ratings on the few sources you know are not reputable, and give more weight to the users who are ranking your control group more accurately.

      --
      -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
    3. Re: Rank reputable sources by Anonymous Coward · · Score: 4, Insightful

      While helpful, I still agree with pastafazou. Truth cannot be determined by consensus.

    4. Re: Rank reputable sources by ClickOnThis · · Score: 4, Insightful

      AGW is a proven fact, the Consensus Opinion of Scientists says so.

      Scientists don't just pull consensus opinions out of their asses. They do experiments and observations to check their hypotheses. And then they publish them, to allow their community to scrutinize and test them further. Consensus develops gradually over time, as ideas survive this treatment over and over again.

      Please note, I am not saying AGW is false,

      Except you are.

      I'm simply saying that consensus opinion is masquerading as "fact" in the biggest science debate, and yet nobody seems to notice.

      In science, the facts are not opinions. They are the experimental results. Your claim that nobody notices a supposed debate about conflating facts with opinions is just sloppy posturing and conspiracy-mongering.

      --
      If it weren't for deadlines, nothing would be late.
    5. Re:Rank reputable sources by Sique · · Score: 4, Interesting
      If you read the article, you will stumble upon another problem.

      Fake news often come as a statement, which has not been denied yet. At the moment the fake news is all the rage, there are no credible refutations. They just appear after the fake news leaves the bubble and someone is really determined to get to the ground and comes up with some evidence to the contrary. If Google (or any other news source) tries to algorithmically find the one true answer, all they have to build on are rumours spreading everywhere and thus apparently confirming the fake news.

      The starting point was the question if Warren G. Harding was a member in the KKK. If you look at the wikipedia pages, online biographies or other sources, no one explicitely states "No, there is no evidence that Warren G. Harding was a member in the KKK.". It will in general be that way, because otherwise the list of things Warren G. Harding wasn't would be infinitely long. He neither was a chinese mandarin nor a poisonous frog, he never went to the moon, and he was not made from steel sheets. He's nothing to eat, and none of his mollusculous appendicles ever touched the Earth's core.

      We have a new version of Russell's teapot here: You can come up with any random statement, and the probability is high that you don't find a debunking of that statement somewhere on the internet. So there is nothing online to prove that this random statement is false, and the attempt to find the One True Answer will confirm the statement, turning a not denied statement apparently into a true one.

      --
      .sig: Sique *sigh*
  2. Teaching moment by jbmartin6 · · Score: 4, Insightful

    I wonder if Prof took the time to review with the students the difference between a search result and a fact.

    --
    This posting is provided 'AS IS' without warranty of any kind, implied or otherwise.
  3. Unfortunately... by bluegutang · · Score: 4, Insightful

    It'd be great if instead of highlighting a bogus answer, it provided links to accessible, peer-reviewed scholarship."

    That scholarship is behind a paywall.

  4. Re:Who will algo the algos? by ancientt · · Score: 4, Insightful

    I'm more bothered by the implication that the results of an internet search engine should not return results representing what's on the internet.

    --
    B) Eliminate all the stupid users. This is frowned upon by society.
  5. DDG and Bing also gives fake news result by cs96and · · Score: 5, Interesting

    Typing the same search "presidents in the klan" into DDG also puts the same fake news result at the top (at least it's at the top if I set my location to UK. If I set it to worldwide it comes in second). Bing also puts the same story at the top. So this is not just Google's problem. It's a problem that all search vendors need to tackle collectively.

  6. Clickbait - You Reap what You Sow. by geekmux · · Score: 4, Interesting

    Tabloid trash used to be contained within that special group of "news" providers, and quarantined near grocery store cash registers.

    Unfortunately, the quest to extract revenue derived from clicks has pushed damn near everyone to publish and aggregate a similar flavor of clickbait bullshit.

    Hey Capitalism, stop rewarding Bullshit. Otherwise, You Reap what You Sow.

    1. Re:Clickbait - You Reap what You Sow. by Fire_Wraith · · Score: 4, Interesting

      Capitalism really isn't who/what you want to blame though. Capitalism just encourages taking the most profitable action/route. The underlying problem is that we, as humans, can't get enough of this clickbait bullshit.

  7. Peer reviewed by senatorpjt · · Score: 4, Insightful

    Maybe the problem is that the incorrect information is free and the peer-reviewed article costs $30 to read.