All of Nate Silver's State-Level Polling Predictions Proved True
kkleiner writes "For the last few months, the political pundit class has been at war with NYT/FiveThirtyEight blogger Nate Silver. Joe Scarborough of MSNBC called him a "joke," while an op-ed in the LA Times accused him of running a "numbers racket." But last night, Silver triumphed: every one of his state-level presidential predictions proved true. "
http://www.xkcd.org/1131/
Too bad the electoral system in the USA is a joke and doesn't represent the vote of the people.
http://xkcd.com/1131/
Once in a while, Randall really nails it.
As Nate Silver pointed out, many times, over the course of the campaign, predicting what will happen one day before the election is easy. Very easy. Most everyone gets that right.
Predicting what will happen in June is hard. And much more interesting.
The only ones who believed the race was a 'virtual tie' were those who had gains to be had by it being so, namely the media.
Are we going to see /. posts on the thousands of people whose predictions were false, or are we going full on confirmation bias here?
You can't really prove a probability wrong (unless it's 0% or 100%). While his most likely outcomes played out, it doesn't mean that he would have been wrong if a few of them hadn't.
This actually shows that Silver is poorly calibrated. if he were accurately calibrated, 80% of his 80%-confidence predictions would come true, 50% of his 50%-confidence predictions would come true, etc. But 100% of his >50%-confidence predictions came true. In the future, he should be more sure of his predictions.
GFA/M/S d-- s: a--- C++++ UBL++$ P+ L+++ !E- W++ N+ !o K- w--- !O !M !V PS++ PE Y+ PGP+ t+++ 5- X+ R tv@ b++ DI++++ D+ G
Joe Scarborough called someone else a "joke"?
Does MSNBC even cover Joe Scarborough's paycheck or do they let Starbucks foot the bill?
Not to say that he still didn't do a hell of a job predicting the outcome (just like last election), but to say 'all' at this point seems to be jumping the gun a bit.
Why does Nate get so much attention, when other sites like electionprojection.com and electoral-vote.com do a similar service, are open on their methods and have had almost perfect results for the past two elections. This past election, those two sites only missed on Florida and that one was truly too close to be 90% confident on one way or another.
See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
Some of the things people said about him were nuttier than that. This guy called him "a man of very small stature, a thin and effeminate man with a soft-sounding voice that sounds almost exactly like the “Mr. New Castrati” voice used by Rush Limbaugh on his program." So that is supposed to have some sort of effect on his analysis?
All he did was take polls that already existed--lots of them--and do statistical analysis on them. Just ran the numbers, and didn't speculate. Contrast that with sites like this one, which, although quite pompous, was stuck in its own alternate reality and ended up being quite wrong.
Baseball Prospectus had the Yankees and Nationals as PECOTA favorites to win almost every game they lost. even after the Yankees lost Jeter.
Giants vs Tigers you didn't need PECOTA to predict that SF would crush the kitties
i was actually expecting Romney to win
But, but, according to conservative pundits, he's too "effeminate" to be right
Je ne parle pas francais.
There are ample examples of how provable and testable facts are unable to trump belief and tradition. Belief and tradition are parts of who people are. Facts are independant of people and no one owns them. To have a fact conflict with belief is literally to loose a part of one's identity and most are far too egotistical to allow any part of themselves to be lost or cast into doubt.
One wonders if it is possible to draw the conclusion that the because his model was so accurate then the majority of voter suppression efforts must have been ineffective? Or the corollary, if his model had been wrong would that have indicated large scale successful voter suppression?
Pundits are there to draw people to a news organization, not provide accurate information. How many people would tune into the election if they said "Obama's got this one in the bag" (which we've known ever since Romney was nominated). Of course they will say you don't know who's going to win! Otherwise no one will watch their show.
Should go for a song now that its faith-based math was proven to be ineffective. At least they should get something out of the time and money they spent on the site. Sadly, I guess we never will know Romney's plan to lower taxes by 20% AND lower the deficit. He seems to be taking the details of *that* plan back to Utah with him without revealing them,
Pundits are entertainers they need no skill or brainpower; when they fuck up they just have to be entertaining to keep their job. They are just another form of a reality TV "star" and things have been so bad for so long an airhead pundit type character ran for VP in 2008... and is now with her people, as an airhead pundit.
I know a dittohead and he is a master at rationalization either from being wrong all the time or because his talent allowed him to live in a bubble without knowing it.
Democracy Now! - uncensored, anti-establishment news
The opinion polls entering election day and exit polls proved the Karl Rove and the GOP stole both the 2000 and 2004 presidential elections for George W Bush.
He missed 2 in the Senate (Montana and North Dakota) Both were projected to go Republican but ended up going Democrat. By the colors it looks like ND was 90% probability.
Nate was the most visible, to the point where his predictions were most vociferously derided by the pundits (well, mainly those who didn't like his conclusions.)
They are making a veritable God out of him: http://www.dailykos.com/story/2012/11/08/1158776/--NateSilverFacts-now-trending
sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
I'm not sure if this is legitimate crazy or faking it to make people you don't agree with look bad crazy, but you're crazy.
You had to cherry-pick polls to really think Kerry was going to win in 2004(and boy did I)
In 2000, on the other hand, Gore pretty clearly won the popular vote, and pretty much every state fell into predicted categories for electoral votes.
Silver should probably just retire now because the expectations of him in 2016 are going to be unrealistic. If he misses even one state, pundits will point out how flawed he is.
"The only normal people are the ones you don't know very well."
I'm going to make a plug for National Popular Vote (http://www.nationalpopularvote.com/), here.
Part of why the election prediction is tricky is because of the electoral college. It doesn't matter what the mean and standard deviations of the nationwide polls are, since the states aggregate their votes and (with the exception of Nebraska, I think) give all of their electoral votes to one candidate. So, people like Nate have to look at the probability curves for all 50 states (let's leave out Puerto Rico and military bases for this) and work through each probability of either candidate winning any of the states. Basically, they run through 2^50 permutations, starting with the probability that Romney wins all 50 and (since that would result in Romney winning the election) adding that probability to his probability of being elected. Add to that the probabilities of him winning 49 states P(Romney wins everything but Alabama), P(Romney wins everything but Alaska), etc. through to P(Romney wins everything but Wyoming), and then do that for all 1225 combinations of him winning 48, etc..
When you get down to him winning about 35-40 states, you have to just limit yourself to the combinations of states which would give him enough electoral votes, of course. Then, when you've added all that up, you've got his percent chance of winning (which is the number on the red line on the top graph on Nate's blog). Now, you go and do all that for Obama.
But this is all much more messy than it needs to be, and state-by-state electoral voting just leads to a few states getting a disproportionate amount of gov't pork (and political advertising) as politicians try to buy the votes of a few swing states. However, no state wants to switch to Nebraska's model of proportional electoral votes, because that would dilute the votes that go to their probable candidate. For example, California (which voted about 60% Obama, and usually votes Democrat) doesn't want to see 40% of it's 55 electoral votes go to a Republican. Same goes for Texas not wanting any of their electoral votes going to Democratic candidates. What you get is a stand-off where the red and blue states look at each other and say "You go first!".
So, some enterprising individual figured out a nice solution: ignore your own state vote and just give all of your state's electoral votes to whomever wins the national popular vote. Some states have already adopted legislation for this, but the legislation doesn't kick in until there are enough states on-board to give 270 electoral votes. Turns out that they're already half-way to the 270 target. At that point, the NPV-participating states will guarantee that the winner of the popular vote wins the election, no matter what the non-NPV states do.
Today it was that Obama suppressed the vote. Tomorrow it will be that Nate Silver suppressed the vote. Soon after, it will be that it was all conspiracy. Hopefully he then will attack the banks for making him waste 300 million.
You are being MICROattacked, from various angles, in a SOFT manner.
The dataviz in this one is pretty cool (with links to source data and R scripts): http://beechplane.wordpress.com/2012/11/07/the-95-confidence-of-nate-silver/ Basically, missed three (which is in line with expectations)
Mind the gap...
If by stolen, you mean gamed the electoral college system to get the magic number of EV votes (popular vote be damned), then yes, they stole it.
Of course, Obama did something similar in how he targeted certain states and left others alone. I don't have a problem with the method in either case (campaign-wise, not commenting on either president). It is the smart move, that's all.
If you want that to stop, don't blame the campaigns. Change the rules (no winner-take-all states, for example).
I applaud Nate's effort to use mathematics to effectively make fools of all the talking head "pundits" in the media. I have followed him since 2008 and am looking forward to many more years of his work. I hope he continues to be successful in the future.
Voting was a metaphor for warfare. The military with the largest army usually wins. Only men fought in wars back then. Landowners raised militias, food, and money for wars. Simply counting who had the most support was a good proxy for who would win in a civil war. With industrialization landowners became less important to war efforts. The side with the most solders and rifles would win.
I watched Nate on a Colbert episode. I found it funny when he basically said "just look at the polls, take an average, and...... It's not really that complicated, but people treat it like it's Galileo or something. It's not that complicated." Duh, but then again, I find increasingly a scary number of people that cannot do math of any kind. I guess we just call people who can actually do math now, nerds.
so when is he announcing his new branch of mathematics
the link the Jon Stewart interview. Two very smart men, one of them is funnier than the other, you can decide :-)
I start wondering (every 4 years when people talk about getting rid of the electoral college) if we still teach United States History in high school. Sure let's reform it, take the rubber stamp "electors" out of the process - but you still have the fundamental "big states vs small states" issue (the reason we have a bicameral legislature) and not to mention some other big problems
Nate Silver deserves all of the plaudits he is receiving, I have nothing bad to say about Mr. Silver. I'm going to hunt up a copy of his book. #prepareToDuckAndRun do you know the difference between Nate Silver and God? Nate Silver wouldn't get booed at the Democratic convention #duckAndRun
It ain't what they call you. It's what you answer to. http://mylyceum.us/
Joe Scarborough of MSNBC called him a “joke,” while an op-ed in the LA Times accused him of running a “numbers racket.” The Examiner dismissed him as a “thin and effeminate man with a soft-sounding voice.” Even the legendary David Brooks claimed that his work was “getting into silly land.”
I'm sure they will all apologize to Nate for their rude behavior and comments in 3... 2... 1... /sarcasm
It must have been something you assimilated. . . .
you're presuming he even had a plan
Discuss!
Republicans don't need facts they need to feel good about how things will turn out.
Reliable statistics brings reliable odds brings legal betting.
I'm watching the next election from the floor at the Wynn! See ya there!
Nate had Obama winning from the beginning. This is his first post unveiling the model. The mean result was 290 EV for Obama, as it would be if Obama had lost Florida and Virginia. As we know, both states were extremely close and the model did eventually come around to calling them for Obama.
Drew Linzer at Votamatic.org arguably did better than Nate, calling the electoral vote count essentially dead on in June and never moving far from that prediction. Just look at this graph. Linzer used a different Bayesian method that was more resistant to short-term fluctuations in the polls and didn't place as much weight on economic factors.
Not to rain on Nate Silver's parade, but Real Clear Politics's state by state average was also correct on every single state. So, you know.
That Democrats selected president D senators D local D House Ah well let me see R.
I know when I employ a carpenter I dont get him a cement truck instead of a hammer.
I think something is bullshit.
Professor Sheldon H. Jacobson Department of Computer Science at the University of Illinois also achieved stunning success with a Bayesian model. Those numbers were 50 out of 51 states (including DC) determined correctly. Reported here Here
Arithmetic and statistics are just lies straight from the pit of hell.
As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
Today, a national conservative radio talk show host, used Nate Silver's accuracy in predicting the election outcome as proof positive that there was enormous voter fraud, because otherwise how could Nate Silver have known in advance who was going to win each state.
By the time of the next election, I predict the American Right will start accusing Nate Silver of sorcery and satanic geomancy.
I am not joking.
You are welcome on my lawn.
I believe Five-Thirty-Eight just aggregates poll numbers then builds a pretty basic CDF from it. This is like stochastics 101. The credit should more go to the pollsters who are apparently good enough to produce accurate mean and error estimates.
It's great that Nate called all the states, but I'm more interested in how far off his estimates were.
For instance, he considered Florida very close, but just slightly Obama. Had it been won just slightly by Romney, Nate's model would have still been quite accurate.
However, if Nate's model was off by 10% in California, that would be quite inaccurate.
Has anyone done an analysis to see how far off Nate was on average when calling a state?
:(){
MSNBC is a fucking joke.
All the news microsoft sees fit to print.
This is the price of allowing 10,000 independent journalistic voices to be consolidated into 2 or 4 mega-media-conglomerates who's infotainment is supposed to pass for a free and responsible forth column.
You are badly mixing the "fourth estate" and "fifth column" metaphors, neither of which actually fit your claim. Your post is like watching David and Goliath paint the Sistine Chapel.
The funniest thing I've seen here. Bravo, AC. Bravo.
Generic News Network is all about ratings, but people like Karl Rove get paid immense amounts to provide information to their customers. There was a different failure mechanism at work for that set of pundits.
Ok, so he predicted the outcomes of two elections. A laudable achievement, to be sure. However, as the collapse of the financial system (due in part to exotic instruments) showed us, a model works until it doesn't.
I thought the whole deal is that he WASN'T predicting the outcome... he was merely stating the odds of candidates success.
In this way, no matter what happened, his statements could not be disproved by the outcome.
For instance. If Obama had a 85% chance of winning (or 95% which I think is what he stated), had Obama lost, that alone does not disprove his calculation. Because there is still a 15% (or 5%) chance of Romney winning.
The pundits hated this, not because he was making a bold prediction, but because they interpreted his statement as "a landslide" - while also using weasel words to hedge his bets.
If you understand logic, theory, and statistics, you'd probably go along with his hypothesis. Otherwise you were probably a Republican who distrusts liberals, numbers, and science.
-CF
The scary thing is not the fact that he was able to predict the outcomes for most scientists know that with enough accurate data statictical math provides very accurate results but that some blogger had access to that much accurate data about so many americans that that he was able to do this. Now this is the really scary thing: what are "they" doing with their more all encompassing and detailed collections.
Bill James of SABREmetrics is ... notorious for studiously not looking at clear indications of rampant steroid abuse during the Steroid Era of baseball. This included career bests by Barry Bonds in HR in his late thirties, when every other ballplayer equivalent had basically 1/4 or less of his mid twenties averages; the HR record single season being broken TWICE in the same year, buy guys having something like 2X their career bests ... in their late thirties. And an epidemic among those guys of backne, sudden rages, radical transformation of physiques, and giant heads, all in their mid-late thirties. At a time when performance declines. Roger Clemens comes to mind. You don't need to look at drug test results to see the obvious and say something is really, really weird and a major outlier.
NO President has ever won reelection with a lower percentage than his first election. No President since FDR has won reelection with unemployment over 7%. No President for the Democrats has won with a lower turnout than the prior election. No President has won when his opponent bested his party's prior performance in all demos. Latino voters have historically underperformed in turnout, and turned out poorly in 2010. Young people historically and every election but 2008, vastly underperform in turnout. Meanwhile all but one poll showed a slight Romney lead of 1/2 percentage points and that with a D overweighting of 6 points in the sample size compared to the 2010 turnout rate of even for both parties. Obama played to crowds 1/4 of what he did in 2008, Romney had record crowds. Exit polling (and internals from both campaigns) showed Romney victories in Ohio, VA, FL, NH, and CO. Exit polls had respondents give Romney a 30 point lead on the economy, and the economy as the number one factor in voting.
It costs, street estimate, about $50 a vote to get someone to vote illegally. Assume Obama needed about 4 million votes, that's a cost of about $200 million. Assume further that each illegal voter would vote five times, for a payout of $250, you'd need 800,000 illegal voters. That's definitely doable. Its cash basis and non-documented. You'd probably need about another 80,000 guys to supervise those street voters, at a ratio of 1 supervisor to 100 street voters. They'd probably demand something like $20,000, cash money, half up front and half upon delivery. That's about $160 million. Total cost to ballot stuff and win the Presidency: $360 million.
Considering that you could dole out hundreds of billions if not trillions of win/lose regulations, subsidies, enforcement actions, that's not trivial. Obama took no public money, faces no public audit, and raised reportedly $1 billion (CCV for web donation was turned off, testing people from the Republicans were able to donate under foreign IPs and addresses, with names like Osama bin Laden). Obama had a strange burn rate of spending money very early, opening offices in places like South Dakota, which his public campaign statements revealed.
None of this is definitive proof. But how much did you need in the mid 1990's to know that Jose Canseco, Barry Bonds, Roger Clemens, Mark McGwire, and Sammy Sosa were all on the juice? The backne, the domestic violence arrests, the sudden rages, the vastly altered physiques, the sudden giant heads? James sought actively not to see this. Just as Nate Silver has actively sought not to see the extreme unusual nature of Obama's victory.
Which is very likely more fraud than anything else. No one is that lucky or good consistently.
Silver's legacy will be like James. James failed to speak out on juicing, and now Baseball is just a contest to see who can evade testing the best, like the Tour de France. Its a joke, an exercise in chemicals. Silver's legacy is that in failing to say hey, "my guy is likely cheating" he ensures that it will be a simple matter of whoever is the most efficient at stuffing the ballot box (or shredding opposition votes).
Voting in America is now forever something akin to that of the late Roman Republic. With the same results. And yes, Silver knowing and keeping his mouth shut like Bill James is a disgrace. All James did was help ruin baseball. Silver's the bigger crime.
because 50.4% to 48.x% still seems close to me. I know know...electoral college dynamics...still, it was close.
Maybe I'm only playing this 10 D chess in 8 dimensions, but please enlighten me how this helps Karl Rove's position for him to help stage the appearance that he's a delusional moron who wasted 400 million dollars on his PR campaign?
I didn't see you observing the deliberations in Philadelphia.
Confucius say, "Find worm in apple - bad. Find half a worm - worse."
He did.
In three, obviously.
Confucius say, "Find worm in apple - bad. Find half a worm - worse."
The best clown of a clown show is still a clown. Yet they got 48% of the popular vote. Seriously, what kind of victory did they throw away by not running a serious candidate? By running a serious candidate they could have had a major landslide.
Beta is broken and the link to classic doesn't work. Stop wasting our time or there won't be anybody left here.
The article really should say that he was correct on which way the states went. But if you read 538 they will talk about how a 5 point swing but still the same party is a failure of the math, even though it doesn't change the state result. And the same deal that a half apoitn change that swings D to R to vice versa isn't something big when it comes to the math.
The article is cheering the thresholds - was the highest for which party. But to really cheer for Nate's ways, you need to praise the accuracy of the %s. I haven't checked 538 today, yesterday they said they were taking a break and then interested in just that - to see the accuracy, not just a simple which-had-more.
LITTLE GIRL: But which cookie will you eat FIRST? C. MONSTER: Me think you have misconception of cookie-eating process.
Then they should get used to being wrong.
This is seriously missing the point.
People like this, for whom tradition and emotion are more important than fact, will not "get used to being wrong"—because they're not wrong. Ever. There's some other explanation for why the things they believed would happen did not. Many of them (who are of the die-hard conservative stripe) simply revert to the old standard "liberal conspiracy" theories.
This wouldn't be nearly as much of a problem if there weren't now a large media faction dedicated to telling people that these theories are true.
Dan Aris
Fun. Free. Online. RPG. BattleMaster.
I predicted that Obama won in August
Barely twenty minutes prior to this post, you stated in another post
No, when you put your money where your mouth is that is when you can call something a prediction.
Prediction can come true or it can fail to materialise, but if you are willing to put a bet down, then it's a prediction and not just running off the mouth.
However, you never put any money on your prediction. Hence, you are "just running off the mouth".
The rest of your comment is the usual nonsense:
Romney decided to declare himself a bigger Democrat than Obama.
You are exactly backwards there. Obama is the most conservative president the US has had in generations. Obama has moved so far to the right that he left very little room for Romney.
And if you want a prediction - and I'm willing to put money on this one - I'll give you one. I predict that the fascist dream state that you keep preaching for with your ron paul videos would lead to the restoration of human slavery in the US. That is what happens when you take away all the rights of the working class as you propose. Of course they have hardly any in the US currently, but you propose taking away what few they have left.
One other option is that he has a source of information from the people who rig the elections (you don't think they're real do you?) and so his predictions appear to be right. He may well have called it all correct, but since there is so much election fraud going on (multiple voting, voting machines switching votes, etc.) it might be somewhat hard for even the best mathematical formulas to take into account the rampant fraud. Using math to predict the election may well be possible without the fraud, but wouldn't the fraud make it damn near impossible to predict accurately?
https://en.wikipedia.org/wiki/Nate_Silver
Casteism
And the idiotic thing about ALL other pundits is they only needed to increase their polling sample size to increase the confidence intervals if they were 1) so sure of their own interpretations of the their favorite polls, or 2) wanted to disprove Nate Silver's predictions objectively.
Oh, but that would be science again. Basically most pundits are post-modern, neo-medeval hacks who failed even high school algebra and want the world to conform to their pet theories by shear will. This is why pundits are worth even the shit-stain on underwear.
(Well, except for the partisan ones who were driven by wishful thinking, and broke down in tears at the outcome. Glenn Beck, looking at you.)
The ones who kept claiming the race was "too close to call" knew exactly what they were doing. Do you think they get paid for being right? They get paid for being watched. If all news commentators come to a consensus in early October and say "Romney can pack it in", then that's an entire month of people bored of following the Electionbowl on TV. The ratings would have plummeted.
The only idiots in this case were the Republican campaign managers, who bought so deeply into their own propaganda that they failed to see where their campaign was headed.