Slashdot Mirror


Daily Kos Pollster Made Up Numbers

jamie found a story up on Daily Kos revealing that the polling firm they had contracted with for 18 months, Research 2000 or R2K, apparently made up or at least manually tweaked its polling results. The blog published a preliminary report by a team of statistics gurus (Mark Grebner, Michael Weissman, and Jonathan Weissman), and it is an exemplar of clarity and concision. The team reports, "We do not know exactly how the weekly R2K results were created, but we are confident they could not accurately describe random polls." Daily Kos will be filing a lawsuit against its former pollster. "For the past year and a half, Daily Kos has been featuring weekly poll results from the Research 2000 (R2K) organization. These polls were often praised for their 'transparency,' since they included detailed cross-tabs on sub-populations and a clear description of the random dialing technique. However, on June 6, 2010, FiveThirtyEight.com rated R2K as among the least accurate pollsters in predicting election results. Daily Kos then terminated the relationship. One of us (MG) wondered if odd patterns he had noticed in R2K's reports might be connected with R2K's mediocre track record, prompting our investigation of whether the reports could represent proper random polling. ... This posting is a careful initial report of our findings, not intended to be a full formal analysis but rather to alert people not to rely on R2K's results."

5 of 546 comments (clear)

  1. the truth is, polling sucks by circletimessquare · · Score: 5, Insightful

    of course this will turn into a "bash the left" and a "bash the right" thread. when ideology isn't the point. polling is the idiocy in question

    and the guy who manipulated the numbers is clearly an amateur. the way you do proper poll manipulation is LOAD THE QUESTION. you poll people with a question with the proper turn of phrase to lead them towards the answer you want. then, when you present the answers to the poll, you also cage the results in such a way to lead the audience in the way you want them to interpret the results

    polling is fucking joke. all results from the left, or the right, is complete bullshit, and a waste of your time

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:the truth is, polling sucks by mea37 · · Score: 5, Insightful

      You're assuming the motive was to manipulate the outcome.

      Did it not occur to you that maybe the motive was to provide any outcome that would look real enough to get paid, while not doing as much work?

  2. Re:Give them credit. by Attila+Dimedici · · Score: 5, Insightful

    +1 on this.

    If Stephen Glass worked for a conservative rag like the National Review, he wouldn't have been fired, he would've been promoted.

    You mean the way that NYT promoted Jayson Blair several times even though his superiors were complaining about his inaccurate stories, until it became public knowledge that he just made things up?

    --
    The truth is that all men having power ought to be mistrusted. James Madison
  3. Re:To be fair... by Angst+Badger · · Score: 5, Insightful

    Nobody expects the Daily Kos to be accurate. It would be like trusting Ann Coulter, Rush Limbaugh, Sean Hannity, or anything ever aired on "Air America" before it went bankrupt.

    On matters of fact, they're pretty scrupulous, especially when it comes to owning up to their own mistakes, like hiring R2K.

    On matters of opinion and ideology, well, it's a political blog. What exactly is an "accurate" opinion?

    --
    Proud member of the Weirdo-American community.
  4. Re:To be fair... by skids · · Score: 5, Insightful

    Olbermann continued to close his show with the number of days since "Mission Accomplished" right up until a month or so ago, when he switched to the number of days since the deepwater horizon leak started. Much of the left does not pull punches against Obama for taking his time extracting us from these debacles.

    The far left idealists can get quite heated against Obama. Me, all I have to do is imagine how McCain would have responded, then after I've wiped off all the cold sweat and stopped gritting my teeth, I have no regrets about 08.