Slashdot Mirror


World Cup Forecasting Challenge For Quants

databuff writes "As a break from projecting the strength of subprime mortgages, credit default swaps, and other obscure financial instruments, quantitative analysts at Goldman Sachs, JP Morgan, UBS, and Danske Bank have modeled the 2010 FIFA World Cup. Now Kaggle has set up a forecasting competition, allowing statisticians to go head-to-head with these corporate giants. The challenge is to predict how far each country will progress in the tournament."

74 of 111 comments (clear)

  1. What's the x-bar by Misanthrope · · Score: 3, Interesting

    For somebody falling to the ground clutching their leg long enough to get a card thrown?

    1. Re:What's the x-bar by Buelldozer · · Score: 2, Insightful

      My son plays competitively on a travelling team at the 11 year old level and there is one team that they frequently play who uses this tactic. It's unbelievably infuriating that they get away this bullcrap at tournament after tournament! My son's team plays ultra clean and we play 85% or more of our games without a roughness call, but when we play this other team there will be at least three against us!

      I'm a calm soccer parent, the kind that's telling the loudmouths to sit down and shut up but when we play this team I want to charge the field and twist the ref into a pretzel! It's so blindingly obvious that this other team is acting, and poorly at that, that I'm stupefied at the referees who give them call after call.

      We played the aforementioned team at a tournament this weekend and I witnessed an elbow to the solar plexus so vicious that it left my son gasping for air and unable to move for lack of breath. No call for that since my son isn't a part time actor. 10 minutes earlier though when he used a shoulder to push off a player the ref was all over it, resulting in a PK for a goal. Players who go down screaming and crying in apparently agonizing pain but who are up and ready to take a PK 30 seconds after the ref runs over? How does this happen time after time in the same game without the ref figuring out that they're being played for fools?

      In my opinion players who ham it up and pretend to be hurt, at any level of play, in order to gain advantage are cowards who should be booed by the fans and ignored by the referees.

    2. Re:What's the x-bar by severoon · · Score: 3, Funny

      It's obvious to me with smart people like this behind the analysis, we should bet big on the correctness of their projections. Perhaps we should tie our economy to their analysis in some way that will potentially result in a large windfall? Who's with me?

      --
      but have you considered the following argument: shut up.
    3. Re:What's the x-bar by Anonymous Coward · · Score: 1, Informative

      recreational soccer is serious business

    4. Re:What's the x-bar by awol · · Score: 1

      Naah, the correct punishment is for the offender to be offered the oppurtunity to repent their acting or else the offending team is actually allowed to hurt them as much as they are acting. I reckon diving would be out of the game in a minute. Particularly if teams started picking a "specialty" player who was say 2 metres tall and 125kg with a side line in debt collecting.

      --
      "The first thing to do when you find yourself in a hole is stop digging."
    5. Re:What's the x-bar by captain_dope_pants · · Score: 1

      "Football isn't a matter of life or death, it's much more important than that." - attributed to some UK football manager if my memory serves me correctly ;)

      --
      while (true != false) process_more_stupid_code();
  2. Bias by bloodhawk · · Score: 4, Insightful

    There are numerous problems here.

    Firstly is very few fans of football can truly consider themselves independent enough to do this well. I will try, but I just know my bias's will in the end have some effect on the outcome of my selections.

    Secondly it isn't just about stats at something like the world cup where there are very few second chances and It is a game where you can completely dominate the opposition and still lose to a single error or bad ref decision.

    1. Re:Bias by TheKidWho · · Score: 5, Funny

      They're Americans, they're most likely not football fans to begin with!

    2. Re:Bias by BeardedChimp · · Score: 1

      I'd be interested to know if they do any better than those who play fantasy footaball. My guess is no.

    3. Re:Bias by digitig · · Score: 2, Insightful

      Secondly it isn't just about stats at something like the world cup where there are very few second chances and It is a game where you can completely dominate the opposition and still lose to a single error or bad ref decision.

      How does that differ from what the quants usually deal with?

      --
      Quidnam Latine loqui modo coepi?
    4. Re:Bias by MichaelSmith · · Score: 1

      Firstly is very few fans of football can truly consider themselves independent enough to do this well.

      Yeah one year where I work a French manager cleaned up in the office Aussie rules footy tipping competition using just football statistics and a copy of excel. The losers always bet their team to win.

    5. Re:Bias by umghhh · · Score: 1

      On the face of it is as silly however the damage done to the real economy is much smaller if predictions do not cause collapse of economy (yes I know they are not guilty or not alone) or at least a small melt down so there is a difference albeit not the one suggested.

    6. Re:Bias by Yetihehe · · Score: 2, Interesting

      I recommend Terry Pratchett's book 'Making Money'. One "quant" essentially created a glass model of economy which was so good, that he moved some money by manually moving liquids inside. It looks like our quants are beginning to have such influence on current economy.

      --
      Extreme Programming - Redundant Array of Inexpensive Developers
    7. Re:Bias by adamofgreyskull · · Score: 2, Interesting

      Of course, the two groups (Quants & those who play (& succeed) at fantasy football) are not mutually exclusive.

    8. Re:Bias by zippthorne · · Score: 1

      I think you should *read* that article on fantasy football. Hint: it's not about predicting games between actual, real teams.

      --
      Can you be Even More Awesome?!
    9. Re:Bias by Starcub · · Score: 2, Insightful

      Secondly it isn't just about stats at something like the world cup where there are very few second chances and It is a game where you can completely dominate the opposition and still lose to a single error or bad ref decision.

      When I was in college, my buddies and I would frequently bet our money on the dog races. They published detailed stats for every race and you could compile a statistical profile of each performer. In fact, I wrote a program that attempted to predict the position of each dog in the race as the race progressed. However, what was not provided and could not be predicted is what dog would lose it's footing and go tumbling to the far rail and which part of the pack he would take with him.

    10. Re:Bias by eharvill · · Score: 1

      Secondly it isn't just about stats at something like the world cup where there are very few second chances and It is a game where you can completely dominate the opposition and still lose to a single error or bad ref decision.

      This. World Cup 2002, US loses to Germany. http://news.bbc.co.uk/sport3/worldcup2002/hi/matches_wallchart/germany_v_usa/default.stm

      --
      At night I drink myself to sleep and pretend I don't care that you're not here with me
    11. Re:Bias by aBaldrich · · Score: 4, Insightful

      Here in Argentina we use to say that statistics are like miniskirts: they give you a nice idea, but hide the most important things.

      --
      In soviet russia the government regulates the companies.
    12. Re:Bias by Anonymous Coward · · Score: 1

      Here in Argentina we use to say that statistics are like miniskirts: they give you a nice idea, but hide the most important things.

      Like Maradona's hand?

    13. Re:Bias by Dog-Cow · · Score: 1

      You may want to reread the book. The gold was discovered to be missing by looking at the model, not the other way around.

    14. Re:Bias by Hognoxious · · Score: 2, Informative

      I recommend Terry Pratchett's book 'Making Money'. One "quant" essentially created a glass model of economy

      As ever, truth is stranger than fiction. Saw it on a BBC documentary/OU program once, it's quite possible that Sir Terry saw it too. - although he probably doesn't remember...

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    15. Re:Bias by mallydobb · · Score: 1

      and I predict Argentina will go far :)

      --
      --- b2b.mallaidh.org | www.mallaidh.org | www.kidsalive.org/article/kahlil-pfaff/
    16. Re:Bias by TheKidWho · · Score: 1

      However, what was not provided and could not be predicted is what dog would lose it's footing and go tumbling to the far rail and which part of the pack he would take with him.

      Of course it can be predicted.

      You may not be able to, but that doesn't mean it's not possible.

    17. Re:Bias by SoVeryTired · · Score: 1, Offtopic

      Tasteless.

      --
      Slashdot: news for Apple. Stuff that Apple.
    18. Re:Bias by russotto · · Score: 2, Funny

      Of course it can be predicted.

      You may not be able to, but that doesn't mean it's not possible.

      In fact, it's easy to predict when you're the guy with the control for the remote shock-collar.

    19. Re:Bias by Yetihehe · · Score: 1

      And it was later brought back by tweaking the model.

      --
      Extreme Programming - Redundant Array of Inexpensive Developers
    20. Re:Bias by cHALiTO · · Score: 1

      Maradona wouldn't need to hide his hand under the miniskirt, he can just openly throw his hand in, it'd just give the press more to write about ;)

      --
      "Luck is my middle name," said Rincewind, indistinctly. "Mind you, my first name is Bad." -- Terry Pratchett
    21. Re:Bias by Geirzinho · · Score: 1

      Football is a simple game; 22 men chase a ball for 90 minutes and at the end, the Germans win.
        -Gary Lineker

    22. Re:Bias by SoVeryTired · · Score: 1

      "it's quite possible that Sir Terry saw it too. - although he probably doesn't remember"

      Pratchett has Alzheimer's disease.

      --
      Slashdot: news for Apple. Stuff that Apple.
  3. Considering how well they did in the past... by Bysshe · · Score: 2, Informative

    I wouldn't put too much stock in their predictions. You know its fishy when they forecast Angola as a "team with strong fundamentals and underlying security". (I'm not even sure Angola has a team).

    --
    Read what I mean, not what I wrote.
    1. Re:Considering how well they did in the past... by databuff · · Score: 1

      Worse than that, JP Morgan picked Slovenia to finish fourth. Ahead of teams like Germany and Slovenia.

    2. Re:Considering how well they did in the past... by Traxton1 · · Score: 1

      That does sound worse.

    3. Re:Considering how well they did in the past... by royallthefourth · · Score: 4, Interesting

      Worse than that, JP Morgan picked Slovenia to finish fourth. Ahead of teams like Germany and Slovenia.

      ...that's basically how credit default swaps work.

    4. Re:Considering how well they did in the past... by Hognoxious · · Score: 1

      It could happen - you know how these Balkan countries are...

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    5. Re:Considering how well they did in the past... by ciaohound · · Score: 1

      Actually, he said Slovenia "ahead of Germany and Slovenia." Now, the team of Germany and Slovenia does not exist, so we could form the vacuous statement, "If Slovenia and Germany and Slovenia play in the tournament, Slovenia will finish ahead of Germany and Slovenia." Vacuous statements are considered to be true in formal logic. Therefore, Slovenia will finish ahead of Germany and Slovenia. QED.

      --
      Oh, yeah, it's not easy to pad these out to 120 characters.
    6. Re:Considering how well they did in the past... by CaptnMArk · · Score: 1

      It's nice to see someone confuse Slovenia and Slovenia in the right direction for once.

  4. Nate Silver, by hoytak · · Score: 1

    we at slashdot would appreciate it if you showed those big banks how to work properly with stats.

    --
    Does having a witty signature really indicate normality?
    1. Re:Nate Silver, by AHuxley · · Score: 1

      http://finance.yahoo.com/banking-budgeting/article/109725/fast-traders-new-edge
      They will just spend their time making sure "latency arbitrage" is part of the competition.
      That time-delay wrinkle between the real results and hacking the data they presented.

      --
      Domestic spying is now "Benign Information Gathering"
    2. Re:Nate Silver, by databuff · · Score: 1

      Did you see this? http://www.fivethirtyeight.com/2009/12/world-cup-2010-advancement.html Would be nice if he entered. Or else it looks like there's enough info for somebody to enter using his behalf.

    3. Re:Nate Silver, by eharvill · · Score: 1

      Interesting. At a high level I can mostly agree with the stats. I am surprised that it has Ivory Coast with a higher percentage to advance than Portugal. Even with a healthy Drogba (not sure if he's going to play yet anyway) I don't see that happening.

      --
      At night I drink myself to sleep and pretend I don't care that you're not here with me
  5. Thanks, but I'll stick to my current system by Rogerborg · · Score: 1, Funny
    --
    If you were blocking sigs, you wouldn't have to read this.
  6. Don't they have other things to do? by Anonymous Coward · · Score: 3, Interesting

    I mean, the financial market is still a mess and I'd rather have them working on the real issues we face. Or is this a quick glance at what actually always goes on at those companies? Are they nothing more than professional gamblers and don't care about their responsabilities?

    1. Re:Don't they have other things to do? by Hognoxious · · Score: 2, Insightful

      I mean, the financial market is still a mess and I'd rather have them working on the real issues we face.

      I'd say anything that distracts them is a good thing. Of course I'm saying that based on their previous performance, which is exactly the kind of thinking that got us into the mess.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    2. Re:Don't they have other things to do? by AndersOSU · · Score: 1

      Past performance is no guarantee of future results.

      They could get lucky this time...

  7. For the record... by SoVeryTired · · Score: 5, Interesting

    For the record, quants rarely try to predict things in the market. That's left to people who work in econometrics. The main job that a quant does is to price financial instruments in a way that is consistent with the market prices of other liquidly traded assets. I'm being deliberately vague about what precisely is meant by "consistent" because that often depends on the choice of model, but there are also model-free results which require certain asset prices to obey certain relations: put-call parity, for example.

    --
    Slashdot: news for Apple. Stuff that Apple.
    1. Re:For the record... by AK+Marc · · Score: 1, Interesting

      For the record, quants rarely try to predict things in the market.

      I'm not sure the distinction you are using. Quants predict nothing. They are used to see which companies appear undervalued, and thus would be good values (and not in the sense of a value vs growth company). They are also used to determine which appear overpriced. Then, if you hold shares in an overvalued stock, you sell it and buy the undervalued one. Of course, Google has perpetually be "overvalued" even while rising in value greatly, and many companies with troubles have been "undervalued" while their stock dropped.

      But it's true that quants are never used to "predict" anything like a specific target price. They are used as an indicator to the relative valuation of a stock based on numerical data to determine whether it is expected to go up or down in value in the future. But then, that sounds a lot like a prediction, even though everyone working with them will say they don't predict anything. Or, to more plainly state my opinion on the matter and your statement, they don't actually predict anything, but they are often used in order to predict things.

    2. Re:For the record... by SoVeryTired · · Score: 4, Insightful

      I'm not sure the distinction you are using. Quants predict nothing. They are used to see which companies appear undervalued, and thus would be good values (and not in the sense of a value vs growth company). They are also used to determine which appear overpriced.

      I think that's more like a financial analyst. A quant typically works one level of abstraction away from the stock market itself, calculating prices and hedging strategies for stock options or credit default swaps, say.

      I know there's a lot of anti-quant sentiment around at the moment, and this being slashdot, I'd like to add a disclaimer: I'm just trying to describe the job that a quant does in theory. I'm not making any statement about whether the methods they use at present are effective. Please keep that in mind before flaming me.

      --
      Slashdot: news for Apple. Stuff that Apple.
    3. Re:For the record... by InbredTom · · Score: 1, Interesting
      Just to furnish your comment with some more detail. Quants calculate the risks attached to financial instruments. So they can tell you, statistically, what losses may be incurred on an asset in a given time frame or how you should hedge the risks attached to a complex financial security with simpler, more liquid securities. Now, of course quants can't predict the future, but they can (or at least should be able to) prepare you for future eventualities by assigning future eventualities with a probabilistic distribution.

      So quants are well accustomed to considering future events, designing models of the future and identifying critical factors that future outcomes are particularly sensitive to. So by considering future dependencies and what-if scenarios, and then attempting to measuring these outcomes, quants are well qualified to model what may happen in the world cup. Now we know there is major unpredictability in sport--this is particularly true for football (soccer), and more so in a cup-format tournament--so much like their analysis of CDOs and other funky products, don't be surprised to discover they are all wrong!

      Just my tuppence worth.

  8. Re:We all know how good these guys are at predicti by Anonymous Coward · · Score: 1, Insightful

    You're not as clever as you think you are.

  9. Stats game... by Dicky · · Score: 2, Interesting

    <spam>If you think you're good at this sort of thing, you might want to join the free online prediction game I run. There's a US$50k prize up for grabs, if you're better than these guys...</spam>

    (Yeah it's spammy, but check my account ID - it's not like I just signed up recently or anything)

    --
    Paranoia isn't an infectious condition, it's a way of life
    1. Re:Stats game... by frenchbedroom · · Score: 4, Funny

      STFU spammer !

      *looks at parent's UID*
      *gasps*
      A 4-digit prime UID !
      *slowly backs away from parent's lawn, sweating profusely*
      Ha ha, my mistake, carry on...

    2. Re:Stats game... by Stormie · · Score: 1

      (Yeah it's spammy, but check my account ID - it's not like I just signed up recently or anything)

      Hey noob, stop spamming!

  10. How is this different? by Clayperion · · Score: 1

    How is calculating odds for gambling/sports forecasting any different from calculating odds for gambling/the stock market?

    1. Re:How is this different? by Calinous · · Score: 1

      Because a company's bad 10 minute, or one man having a bad day, isn't usually leading to the demise of that company (things that could easily happen in sports, like overturning a 2:0 score to a 2:3 score in the last 10 minutes of a play). Or self-inflicting a goal, or taking a suspension (a red), or even colliding with a team mate (like the goalkeeper) and be taken out of the field on a stretcher.

    2. Re:How is this different? by Hognoxious · · Score: 1

      Or a crooked referee.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
    3. Re:How is this different? by AndersOSU · · Score: 1

      Yes and no.

      In 10 minutes a company could be responsible for a giant oil spill which causes billions worth of liability.
      In 10 days massive accounting fraud could be discovered taking down an energy trading company and a storied auditor.
      In a day the markets could realize that a investment bank that's leveraged 40:1 primarily in MBS isn't worth a 10th of what it was last week.

      etc. etc.

      The fact that banks are engaging in this challenge strikes me as an admission that their expertise is fundamentally no different from bookmaking.

  11. Just use the odds from any sportsbook to beat them by webplay · · Score: 1

    Just go to Vegas or look up the current World Cup odds at any online sportsbook and it is very likely that these odds are better predictions than whatever they came up. These sportsbook odds are based on actual money bet by people who know something about sports betting instead of financial types. If these quants were actually confident that they had some sort of an edge, they would put their money where their mouths are (and affect these sportsbook odds). Of course, these sportsbook odds are also affected by amateurs, but the same is true with almost anything else, like the stock market. Another issue is the smaller liquidity compared to the stock market, but the amount of money bet on the World Cup should be large enough to make it less of an issue.

  12. A cheaper proposal: by fuzzyfuzzyfungus · · Score: 4, Funny

    For just $10,000 in unmarked and nonsequential bills, Vinnie "the kneecap" is willing to venture a prediction as to when any particular team is going to drop out.

    "When yous got a problem, pick Vinnie. We don't predict; we Promise."

  13. Markov Chain Monte Carlo Online WorldCup Simulator by dcmouser · · Score: 2, Interesting

    I've written an online Markov Chain Monte Carlo simulator where people can experiment with pairwise team predictions in order to not just predict tournament winners, but more interestingly, to evaluate the most profitable expected payoffs from current betting odds (which are almost never the most likely teams to win). The page goes into the statistical basis of Markov Chain Monte Carlo (MCMC) quite a bit, and the simulation is all done client-side using javascript. Might be interesting for those who like this kind of stuff. http://www.donationcoder.com/wcp

  14. You got it in one by Viol8 · · Score: 1

    "Are they nothing more than professional gamblers and don't care about their responsabilities"

    Stock markets are nothing more than casinos for the more "respectable" end of the social spectrum.

  15. For what it's worth... by Anonymous Coward · · Score: 1, Funny

    Spain or Brazil - the same as the bookies. So what do the brokers say?

    Banks are using other peoples money to make money for themselves, then claiming it's all down to such highly skilled workers (what a joke).

    Brains / intelligence has NOTHING to do with the amount of money you earn. I mean am I really supposed to believe that a nurse that wipes other peoples dirty asses are worth less than a gambler? Or a surgeon that saves lives?

    Banks that use other peoples money SHOULD be paying dividends back, not cashing in and paying their bosses six figure salaries. It's not as if a clerk gets a share of that whopping bonus pot. Oh and has anyone actually been charged with fraud yet because that is exactly what happened, on a grand scale!

  16. Marked sequential bills will also work by nroets · · Score: 1

    Why hire Vinnie when the locals are so much better at it ?.

  17. Crowd source by symes · · Score: 1

    This is a classic case where the mean crowd response is likely to have greatest predictive success - in which case just looking at global betting markets will give the most accurate prediction.

    1. Re:Crowd source by Hognoxious · · Score: 1

      Crowdsourcing is so last year.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  18. Knowing how they like to do business by ComputerGeek01 · · Score: 1

    Are they releasing these "odds" to the public while betting against them?

  19. lmao by Alinabi · · Score: 2, Insightful

    Who knew JP Morgan had a sense of humor? I mean, England World Champions? Hilarious!

    --
    "You can't allow somebody to commit the crime before you detain them." [Condoleezza Rice]
    1. Re:lmao by Myrddin+Wyllt · · Score: 1

      I think if you look at qualifying performance and squad strength, you have to give England a reasonable chance. They are still a slightly false price at 8.6 on betfair, but that is nowhere near as overbet as they usually are for international tournaments

      I wouldn't be surprised if they made it to the semis, at which point they would probably have to win two matches as slight underdogs (depending on the opposition) - not an overwhelming possibility, granted, but nowhere near hilarious; you'd have to tip someone like Switzerland or USA for that.

      Speaking as a Welshman, I'd love England to get to the final - then get beaten by Argentina (with an Aguerro goal that had more than a hint of hand-ball :-))

      --
      [ ]Half Empty [ ]Half Full [x]Twice as big as it needs to be
  20. Not too new by KGBear · · Score: 2, Informative

    15 years ago, when I was working as a Systems Analyst at a Brazilian bank that shall remain nameless, it was common knowledge that trading desks all over the country were engaging in this kind of thing. They would create "financial products" tied to World Cup statistics and use all the technology, corporate and individual knowledge at their disposal to try to predict the outcomes and win or lose huge sums of money. Individuals bet with their own money and the corporations they worked for (and who provided the infrastructure for this) tended to look the other way. One such "product" I remember well was the so-called "GDC" ("Gols Da Copa" - Cup Goals) which created a market around the total number of goals to be scored during the World Cup. I knew one trader who payed for his house with his GDC money. Most of the time it was a mostly harmless hobby (if you discount the fact that gambling is illegal in Brazil) but as the World Cup final approached, I was very aware that the resources who were supposed to be working on models of commodities, foreign exchange and other markets did little else than model the World Cup; this included both people and computational resources. I wonder if some of my old colleagues in Brazilian banking ended up finding positions in Wall St.

    1. Re:Not too new by AndersOSU · · Score: 1

      I would think that if I were running an investment bank I would encourage my employees to engage in this sort of behavior - use company resources, but not funds. I think this sort of thing would make for remarkably good training for predicting actual financial markets. This fact is also why I think the economic utility of investment banks is wildly overstated.

  21. For Americans: World = World ;-) by fantomas · · Score: 2, Informative

    For American non-football fans, the "World" in "World Cup" means that lots of different countries from around the world participate. Different kind of "World" from "World Series Baseball" which I believe has a different interpretation of what the word means ;-)

    Sorry, couldn't resist it ;-) Hey, you're in the football world cup too, and you're not too bad at the game either!

    (yes I know it might just mean the name of a newspaper rather than a particularly limited view of how many countries there are out there...)

    1. Re:For Americans: World = World ;-) by huckamania · · Score: 1

      Major League Baseball attracts the best talent from the entire world. Japan has a Professional Baseball League, but the best players still come to the US to play in the Majors. Japanese players that come into the league are considered rookies, the same as some one coming up from Scranton AAA (minor league).

      The same could be said about the NBA or the MLH. I'm sure there are enthusiasts for Russian Hockey or Italian Basketball, but try finding results in your local paper.

      Here is my algorithm, starting with the final...

      If (team.name = "brazil")
            Losses = 0;
            Goto End;
      If (team.name = "germany")
            Losses = 1;
            Goto End; ...

  22. Re:One word... by treeves · · Score: 1

    What is "The country where pizza was invented, Alex?"

    --
    ...the future crusty old bastards are already drinking the Kool-Aid.
  23. Another sophisticated _free_ contest by juosukai · · Score: 1

    http://bit.ly/a5OAnH

    (usenet, rec.sport.soccer).