The Perils of Simplifying Risk To a Single Number

A few weeks back we discussed the perspective that the economic meltdown could be viewed as a global computer crash. In the NYTimes magazine, Joe Nocera writes in much more depth about one aspect of the over-reliance on computer models in the ongoing unpleasantness: the use of a single number to assess risk. Reader theodp writes: "Relying on Value at Risk (VaR) and other mathematical models to manage risk was a no-brainer for the Wall Street crowd, at least until it became obvious that the risks taken by the largest banks and investment firms were so excessive and foolhardy that they threatened to bring down the financial system itself. Nocera explores the age-old debate between those who assert that the best decisions are based on quantification and numbers, and those who base their decisions on more subjective degrees of belief about the uncertain future. Reliance on models created a 'false sense of security among senior managers and watchdogs,' argues Nassim Nicholas Taleb, who likens VaR to 'an air bag that works all the time, except when you have a car accident.'"

Comments

It's simpler than that

[joss]

Risk models are largely irrelevant because the only risk anyone in the financial sector is really interested in minimizing is the risk that they will get fired. The way to do that is to do almost exactly the same thing as everybody else, no matter how mind blowing stupid it is. Plenty of people realized that banks etc were not nearly as sound as commonly believed years ago. Those that tried to act on this were fired long ago since they weren't making as high a ROI as those willing to invest in dodgy hedgefunds etc. Rational market my ass.

Model accuracy wasn't the only problem

[EdwinFreed]

A friend of mine is a risk assessment quant who was working at Lehman right up to the point where they declared bankruptcy. I asked him about this article the other day. He said that their models started telling them something was very wrong back in 2007. The problem was that Fuld (the CEO) refused to believe what the models were saying.

The most accurate model in the world won't help if you don't pay atention to the results it produces.

There's also apparently an issue with the classical VaR models depending on transparent pricing, which these real estate instruments lack. So some of the most troublesome assets apparently weren't in the model.