Coding Flaws Caused Moody's Debt Rating Errors
An anonymous reader writes "The Financial Times has the story that billions in incorrect AAA ratings given out by Moody's were the result of a coding error in its computer models. 'Internal Moody's documents seen by the FT show that some senior staff within the credit agency knew early in 2007 that products rated the previous year had received top-notch triple A ratings and that, after a computer coding error was corrected, their ratings should have been up to four notches lower.'"
Cue the onslaught of economists and generally math-illiterate people saying that computer models just can't be trusted. They can, ya morons, just not when they're implemented by penny-a-day visual basic dolts.
Great... sounds like my girlfriend
I say don't drink and drive, you might spill your drink. Before you get behind the wheel just stop and think.
In any case, it sounds like they found a new scapegoat and they're going to take it for a test ride.
A coding error.
Deleted
this is probably more a feature than a bug --- those instruments are rated by multiple agencies, each of which use their own risk evaluation methodologies and software. i find it highly unlikely that s&p would make mistakes, independently, that would cause it to give the same junk paper the same AAA rating that moody's gave.
can you spare a stock tip?
+1 fashionably cynical
Think maybe Moody's would like to finance my FT subscription?
This is another example of how good news in the economic field can easily go unchecked because it is beneficial for everyone involved (in the short term) for the world to believe them.
My favorite, and perhaps the most drastic, example is how the US government grossly misrepresents employment stats, the consumer price index, and the GDP. This creates another bubble; not for the New Economy or for the housing market, but for the US as a nation. As long as people keep believing in the "world's strongest economy", investments pay off much as they do in a pyramid scheme - but the point where they won't becomes ever more dangerous the longer the scheme holds.
I for one prefer investments in Europe if only for the seemingly more reliable numbers they have there. Investing in the US is a way too dangerous gamble right now.
blow your mind already
Total B.S. The ratings were wrong because various companies needed these AAA rating to stay in business. (And if you need a AAA rating to stay in business, you don't deserve a AAA rating.)
..isn't a bug, it's a feature. Of fraudlent behaviour from management.
As an industry, we really need to start growing up and using the tools the mathematicians have provided us, just as other engineers do in other disciplines, to show our programs actually work as advertised.
The competent have nothing to fear from formal verification and anyone who is not capable of doing such verification should not be writing software anyway.
Simon
How about that, a coding error that makes lots of money. These are so rare so I think we can say this was a simple mistake.
The corrupt bastards are going to "shoot the programmer" on this one?
I want a federal investigation.
10 Print "Hello World!" 20 GOTO 10
I'm a rabbit startled by the headlights of life
Someone tag the article with scapegoat.
Some poor IT guy's head's currently careening down the halls in Moody's.
Yeah right, a coding error. Made by someone no longer with the company I'm sure...
Or more likely the model was completely incorrect because they assumed low levels of defaults based on the default rates from when lenders actually required some money down (skin in the game from the borrower), didn't just just trust you when you said "yes I earn $200,000 a year, no I don't have any tax returns or pay stubs or bank statements", and occassionaly actually said "no" to a request fort $600,000 to buy a one bedroom apartment in the middle of the desert.
But let's go with typo.
if ($debt_owner_paid_off_moodys == 1) {
$rating = "AAA";
}
else {
$rating = "Junk";
}
Suuuuure... a coding bug is to blame! Nevermind that the agencies selling this financial toxic waste *paid* Moody's, S&P and others to provide good ratings. Software bug or no, there is fraud all around within the US economy--and no one was complaining as long as people at the top were raking in billions of dollars in profits.
This entry at Calculated Risk openly wonders if Moody's jiggered its model expressly so that it would line up with whatever the Standard&Poors ratings were.
Personally, I'm concerned this revelation will result in a concerted effort to blame the whole mess on a computer error, rather than the profoundly bad judgment exhibited by fund managers and investment banks. Expect some hapless programmer to be located and pilloried.
Schwab
Editor, A1-AAA AmeriCaptions
honest guv, it was the magic black box with a screen that made the error
If the errors are as large as it seems they were, wouldn't one or more human analysts notice? When your software says "Buy SCO" you should know that something is wrong.
To err is human, to really screw things up takes a Spreadsheet.
If you read the FT a lot, or want to, here is a good greasemonkey script
IT folks should realize that they've been bureaucratically set up to take the fall for these sorts of things. CYA, obviously.
They're depending on us believing their media stories to escape responsibility; anyone who thinks about this situation would quickly realize that for a company full of financial analysts to not realize that an error of this magnitude was happening - well, it beggars the imagination.
What almost certainly happened is that they played the same game that so many other financial institutions did during the real estate bubble. But when the bills came due, they chose to deny responsibility and pass the blame on to someone else. The real crime here is that they'll be allowed to get away with this...
And I am not referring to Briggs & Stratton either.
Them boys at moodys need to open a farm, they sure got a lot of fertilizer on hand!
coding error..hehehehehehe...I think this story comes from the Jon Lovitz school of excuses...."ya...that's the ticket! It was a coding error!" uh huh
I don't think their story is going to fly with investors and lawyers around the world who are the proud recipients of all the creative "write downs" and other sorts of negative profits this year from all those wall street loons trying to push worthless junk paper on each other and actually *believing* their own fantasies that they can just keep coming up with different names for IOUs and keep reselling them back and forth to each other. You can't printing press your way to wealth creation, whether what you are printing up is called "money" or a "collaterlized debt obligation" or whatever other fancy crap term they think up. Not for very long anyway.
The Financial Times has the story that billions in incorrect AAA ratings given out by Moody's were the result of a coding error in its computer models.
So one of the top financial services companies in the world, staffed with MBA's and finance professionals, and none of them noticed a coding error that changed debt ratings by that big of a margin? That strains credibility to the breaking point. And on the other side of the table, none of the financial institutions buying collateralized debt instruments ever looked at those ratings and thought they were a little optimistic? Come on. The entire sub-prime mortgage mess was a computer glitch.
Guess that means cocaine use is alive and well on Wall Street. Because you have to be really, really high to field a whopper like that.
That's our life, the big wheel of shit. - The Fat Man, Blue Tango Salvage
According to one of the Financial Times reporters on the story, interviewed on my local NPR station, the rating was unchanged AFTER Moody's supposedly found and corrected the error, because they "changed their methodology" between the original flawed rating, and the discovery of the flaw.
This guy didn't sound especially convinced, and no one's mentioned any kind of due diligence requirement on the rating agency to actually make sure that their ratings are correct. Apparently whatever gets spit out of the formula is accepted as official, and in this case, they had a lot of incentive to fail to get around to any due dilligence.
You're right. They all got paid big money to come up with these bogus ratings. They got paid the same money and came up with the same ratings. "Programming error" is the new "cat ate my homework". The fact that the ratings business is a cosy oligopoly doesn't help either.
The competent have nothing to fear from formal verification and anyone who is not capable of doing such verification should not be writing software anyway.
How can I keep unvalidatable requirements out of my system? In my field, validation is used to show that the software satisfies requirements, not that the requirements are in any way correct.http://michaelsmith.id.au
You can already buy systems like this. You can buy systems that absolutely have to work all the time, no downtime, no crashes, etc. However, there are some major stipulations:
1) It isn't cheap. There is going to me some major engineering to design it, and it will require some major redundancy in hardware to protect against faults. As such, you are going to pay a lot for it.
2) It isn't fast. No you can't have it today, you can't have it this month, you can't have it this year even. The development and testing will take a long time. This can't be rushed, it simply takes lots of time and lots of testing to make sure there are no faults.
3) You can't add features to it. Once the system is in place, it can run only what it was designed for. You can't go and install new software or anything. If you want any changes made, those will have to go through a full set of testing. No unverified code can be running.
4) It must be accessed only in approved ways. You can't just hook it up to the Internet and go wild, input will need to be properly regulated to make sure it doesn't cause an unforeseen problem.
5) You can't mess with it. Your people will not be screwing around trying things with it. It'll be maintained under a support contract only by certified personnel.
If that's not ok with you, well then some bugs are something you have to accept. This idea that programmers should be able to easily engineer perfect, bug free software quickly and cheaply is just amazingly ignorant. Especially when people come up with false analogies "Oh well people would sue if cars were made as badly as computers!" No, you'd get arrested (or killed) if you tried to use a car like people use computers. If people treated cars like computers they'd expect to be able to run in to a wall at 80 miles an hour and suffer no injuries to themselves or the car.
Cars work well if an ONLY if they are operated properly (and even then not always). You have to do things like obey proper driving regulations, maintain the engine, and so on. If you don't, well shit is going to go wrong, maybe catastrophically wrong. Yet people do just that with their computers all the time. They install random shit, never perform any maintenance, and expect that the computer will magically protect them from all problems.
They won't go after some low-profile wonk. The French bank with billions of losses from a couple of months ago is trying the same thing. It's not plausible.
This is very quickly how the scam works:
The way bond agencies survive is by acquiring new business. Let's say a utility issues a bond for a new water project. They shop the issuance around. Highest rating gets the business. The higher rating means (roughly) less "insurance" they have to carry and the more they can use free cash to do other things.
The bond agencies are as "financialized" as a low-end broker sweat shop. No one seemed to care when the money was flowing. It's easy to take shots after the fact.
Few people follow the Fed's TAF's and its junk-filled balance sheet. It's worse than the credit agencies situation. Who knows if that will ever blow up like the credit markets.
http://www.maxineudall.com/2010/02/should-economists-be-sued-for-malpractice.html
Any dev worth his salt would be blaming, in order:
1) The Firewall
2) The Load Balancer
3) The Firewall
4) The Network Routers
5) The Firewall
6) The Network Cables
7) The Firewall
8) The Network Engineering Team
long before they figured out it was a Layer 8 issue in the code.
http://www.bloomberg.com/apps/news?pid=20601203&sid=aDGkiET1_Y7w&refer=insurance
The Singularity is closer than you think
Quant
Calculated Risk believes this is a case where S&P decided not to believe their own models and tweaked them to match the results derived by Moody's, which spit out the wrong results in the first place. Call it bug-compatibility, but it's also clear that there were plenty of financial incentives at the time for the rating agencies to deliver results in step with their peers lest they lose out on lucrative "second opinion" business.
Dog is my co-pilot.
Confusing summary aside, this is the biggest load of crap I've read in a long time. The financial world made a really bad guess on just how much "money" was really in the US economy and now they are paying for it. They can't actually be held accountable because then people might catch a glimpse of the fact that the financial wizards who run our lives are really full of shit. So instead of taking responsibility for their mistakes they are blaming it on a computer bug. How effin convienent for them.
"Hey everybody, we aren't fucking idiots. You see, it was the computer! I just told you what it told me on my screen. Hold on... my third trophy wife is on the phone... she's telling me that her and the Lamborghini are stuck in traffic somewhere between my multi-multi million dollar home and the club house where I spend multiple tens of thousands of dollars a year. I'll get back to you right after I blow a few more rails of coke!"
How the hell did these people get to be in charge of society?
Sure, a coding error may have resulted in some incorrect ratings, but I suspect that a good chunk of the ratings mis-hits on mortgage deals was also due to their not fully understanding the risks involved, in a very material way.
This entire story is bullocks, and your analysis is accurate. We aren't talking about a trivial error here. The models were spitting out obviously false results, and Moody's (and everyone else) gladly accepted those bad results. For at least 3+ years now, several analysts have pointed out ratings were too high and that they didn't pass the "smell test". If Moody's is not responsible for their models, then why shouldn't I write some half-assed model of my own, demonstrate to lenders how in the short term it will make them money, and then when I get caught, just point out that I never claimed my models were accurate.
Actually, that's not a bad idea.
To put it in a language slashdotters will understand.
1. Invent model.
2. Lie about model's accuracy.
3. (Sell model)???
4. Profit.
Go have a look at how expensive it was for NASA to verify the Shuttle's software. Mathematical verification of software is not trivial, standard "software engineering" testing is not anywhere close to mathematical verification.
Also most Engineers in other disciplines don't use mathematical verification to prove their over all design. They prove the critical bits and stuff in enough of a safety factor that full verification shouldn't be needed.
Plenty of "Engineered" systems end up with bugs and flaws as a result. Formal verification is only normally done for the most critical of systems.
========
CINC, 4th Penguin Legion
Read the last two paragraphs of this paper (p26). It states that the credit ratings shouldn't have been relied on for certain types of CDO's because they had hidden risk that wasn't obvious.
The interesting part... the paper was written in 2004.
http://www.federalreserve.gov/Pubs/feds/2004/200436/200436pap.pdf
http://www.businesspundit.com/sub-prime/
That was really good.
I hate me-too posts, but I'm going to cast my vote in agreement that the explanation is too simple. This stinks of scapegoating.
'He who has to break a thing to find out what it is, has left the path of wisdom.' -- Gandalf to Saruman
S&P first publishes the ratings and (maybe?) senior staff at Moody's don't stick to their guns when their own models didn't agree with S&P. Given that institutions are pushing hard for those credit derivative products, Moody's yields to pressure. The only game outcome that makes everyone look good is to give AAA's away together, despite common sense, otherwise they risk breeding a credibility crisis throughout the ratings industry.
Then the market comes down. Both S&P and Moody's are pressured to defend their credibility, but they do so in different ways: Moody's acknowledges the error, but it causes them to look bad, as S&P still insists their models are good (despite all the evidence to the contrary). The only outcome that makes everyone look good is either to acknowledge the error or defend it together.
And now, because no one defends their own position, the public will demand regulation of the industry, but the topic itself is so abstract (after all, all you're selling is an expectation of a certain outcome - i.e. "default" vs. "not default" - which one cannot truly guarantee if their life depended on it) that any regulation, by default, cannot be effective here. It's like demanding regulation of weather forecasts. There are quality parameters but, ultimately, how should the government punish a forecaster if he said it would rain but actually it was a sunny day?
Maybe the only fact is that the structure and governing logic behind commercially-sold ratings is just broke. There are so many vested interests that it's nearly impossible to be impartial.
... from the lenders to the credit-ratings agencies.
Yes folks, it was the purveyors of the toxic-waste that *purchased* the ratings rather than the consumers - so naturally the ratings were good, bug or no bug.
There were other lesser known agencies at the time rating the same shite at 4 points lower, but then they were rating it for buyers, not sellers.
See here for more.
Is there a AAAA and AAAAA rating as well? - after all I would not consider "as good as a US government bond" all that good.
Martin
All of you guys that are now boasting here that you actually knew what was going wrong, but not one of you decided to open your mouth before it became a major disaster. Apparently the fact that the world economy has gone to shit over this means nothing to you, or the fact that thousands upon thousands are now homeless.
What I read here are admissions of guilt: you knew of a very serious crime with very serious consequences (and helped commit those crimes sa well) and chose to remain silent. It is both stupid (to admit to it now) and pathetic.
A Bloomberg article says: "Banks created at least $4 billion of CPDOs".
... (which shouldn't happen, but can happen).
"Created" not rated. So noone knows for sure how many of these 4 billion have been rated by Moody's, but I guess a big chunk.
But this relativly small sum (compared to the amount of mess the credit crisis has produced) is not the heart of the problem. The big question now is "can we trust the rating agencies at all". Because this story has the smell of fraud. And that's (of course) much worse than overpaid MBAs that make some errors
-- "As a human being I claim the right to be widely inconsistent", John Peel
But it sounds so much cooler saying "tranche" because then people arn't 100% sure what it really means. Its designed to obfuscate to people not in the know like a lot of the financial system.
It seems to happen in a lot of markets. I remember about a year ago, my friend went to buy a new truck. She didn't think would be approved, but surprisingly was. However, when she checked over the paperwork, the dealer was definitely fudging the details (stating she had "vehicle X" to trade in when there was none, etc) to get the credit approval. In the end she ended up walking out on the whole thing because she had sense enough to put together that "a dealer who is willing to cheat and lie to his credit agency is likely more than willing to do the same to me."
The so-called hockey stick - a temperature "spike" of a half degree at the end of the 20th dentury happened to be a statistical error in the data analysis program. The program de-averaged (found baseline) of different temperature datasets incorrectly, magnifying the effect of a new 1990s dataset. The warmest years in the 20th century were the 1930s, not the 1990s.
P.S. Other data probably points to global warming, but this most-touted example is incorrect.
Why is the only reporting of this issue through FT and NPR.
Try finding this info on the CNBC site...
This goes deep.
One thing to understand here is that there were very obvious cases of blanket fraud going on sometimes with management knowing and sometimes not. The point though is the Loan Officer is the person communicating with the client and SHOULD be ultimately responsible. If someone in a company caught wind of a problem and told the DOC (Department of Corporations in California) or the DRE (Department of Real Estate in California) then the company would be fined but the Loan Officer would be under no direct liability. Sometimes the LO would be fired. Guess what they did next. They went to the next company, got hired and did the same damned thing.
Now Presenting: Deflation!
other deflation articles from Mish.
HAND.
Learn the rules so you know how to break them properly.
www.teslabox.com