Slashdot Mirror


JPMorgan Rolls Out FPGA Supercomputer

An anonymous reader writes "As heterogeneous computing starts to take off, JP Morgan have revealed they are using an FPGA based supercomputer to process risk on their credit portfolio. 'Prior to the implementation, JP Morgan would take eight hours to do a complete risk run, and an hour to run a present value, on its entire book. If anything went wrong with the analysis, there was no time to re-run it. It has now reduced that to about 238 seconds, with an FPGA time of 12 seconds.' Also mentioned is a Stanford talk given in May."

26 of 194 comments (clear)

  1. Ah, progress... by fuzzyfuzzyfungus · · Score: 4, Funny

    It fills the heart with inspiration to watch the best and brightest constructing advanced computers to solve the problems of mankind...

  2. More math, faster... by seanadams.com · · Score: 5, Funny

    That will fix our banking system for sure!

    1. Re:More math, faster... by c0lo · · Score: 2

      That will fix our banking system for sure!

      GIGO at tremendous speed.

      --
      Questions raise, answers kill. Raise questions to stay alive.
  3. Re:Pictures of the rig by blair1q · · Score: 3, Informative

    Do not click. Some sort of phony coprophile spam.

  4. Garbage in, Garbage out by ka9dgx · · Score: 2

    Information asymmetry makes even the fastest analysis on the planet irrelevant as the data input is garbage. It is this lack of transparency which resulted in the housing bubble, etc.

    The "too big to fail" banks regularly hide data from customers, regulators, and other branches of their own organization.

    This is interesting because of the speedup of FPGAs, but don't be fooled by a second that it addresses an actual business need, other than PR.

  5. Absolutely! More golfing, less bankrupting! by zooblethorpe · · Score: 2

    That will fix our banking system for sure!

    I can't agree more. An increase in the number of golf matches and accelerated round-robin tournament configuration would go a long way to keeping those pesky bank officials occupied on the links and safely out of their offices. The Florida Professional Golfers' Association will benefit while also helping protect our nation's assets from executive malfeasance.

    ...

    Wait a minute, what are we talking about here?

    Cheers,

    --
    "What in the name of Fats Waller is that?"
    "A four-foot prune."
  6. Re:Could they not use GPUs? by Anonymous Coward · · Score: 2, Informative

    It seems unlikely that they're doing anything that would prevent them from doing it significantly faster with less power draw on a GPU, and with lower initial hardware costs to boot.

    No, FPGAs use significantly less power and provide greater performance than GPUs. The initial capital cost is higher though. Here's an article that gives a bit more detail: http://www.xilinx.com/publications/archives/xcell/issue74/FPGAs-speed-computation-complex-credit-derivatives.pdf

  7. im less impressed by the by nimbius · · Score: 2

    performance of the system, its architecture or its value to the company
    and more impressed that one of the worlds largest financial service providers
    partially responsible for the worlds second largest economic collapse has found, despite their
    prior record with the concept of 'risk', the objective, quantifiable definition of the amorphous and
    highly elusive concept of said 'risk.'

    --
    Good people go to bed earlier.
  8. Maxeler's partially owned by JP Morgan by ecner · · Score: 2

    Note that Maxeler sold 20% of itself to JP Morgan earlier this year.

  9. Re:Pretty stupid approach. by yodleboy · · Score: 3, Insightful

    well as someone earlier posted, it's about making decisions faster than the competition. If they can analyze a transaction, assign a risk and make a decision faster, they make the money. If the competition also takes 8 hours to do an analysis, doing it in 3 min is huge. Who cares if it's outdated in 5 years? You build another with a fraction of the profits this one helped you earn you and keep chugging along.

    sometimes, in some industries, first post IS important.

  10. Re:How fast would a bitcoin server process the ban by HateBreeder · · Score: 2

    1 Virtex-6 SX475T could give you about 1 billion SHA-256 hashes/second clocked at 200MHz., will use 20% the power of the ATI GPU. but will cost about 4 times as much.

    --
    Sigs are for the weak.
  11. C++ to Java? by zill · · Score: 2

    For the new Maxeler system, it flattened the C++ code down to a Java code.

    I hope to God that's a typo. C++ -> Java -> Java Bytecode -> Native code almost sounds like a programming language Rube Goldberg machine.

    How would the pointer operations even translate?

    1. Re:C++ to Java? by Anonymous Coward · · Score: 5, Informative

      That's not how it works. The Maxeler FPGA compiler is actually a Java library for describing dataflow machines. They call it "stream computing" - basically just very deep pipelines. You describe your algorithm in the dataflow/streaming style, using the Maxeler Java library, then when you run your program the output is an HDL design to load onto the FPGAs. There's no automatic conversion from a serial program (in C++ or anything else) to a dataflow/streaming program. The developer reimplements the algorithm manually.

  12. Baloney by bill_mcgonigle · · Score: 2

    The devs are going to run jobs while the machine is idle to corner the Bitcoin market.

    But, wow, from the perspective of getting the Boss to buy awesome hardware for your pet projects - hey, we're not worthy.

    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
  13. Weep, USA, weep! by Anonymous Coward · · Score: 2, Insightful

    This technological breakthrough is an important milestone on the downfall of the mighty USA. When the brightest of a country are engaged into a completely nonproductive activity and wastes important resources (in terms of education, knowleddge and to some extent money) to achieve nothing which benefits the society, it's a high-mark - it's all downhill from here.

    Let's come back here after 20 years and see how this comment stands up to time.

    Weep, USA.

  14. Re:The best and brightest by dakameleon · · Score: 2

    For me, it was pretty straightforward: Money, and opportunity. Software companies here in Australia tend not to gamble so much on fresh graduates, so the majority of opportunities that were attractive financially were in the consulting (Accenture, IBM, Infosys) or Financial space. As a poor student coming out of university, when I'm given the offers of $45k/yr vs. $60k/yr, plus bonuses, it's a pretty easy decision. Work hours tend not to be onerous, workplace conditions good, and the majority are in the main CBD. After a couple of years, experience and recruitment policies tend to railroad you into the industry unless you take a major step sideways.

    That said, I'm always curious what "more productive areas" of work people consider to be out there for the average software engineer.

    --
    Man who leaps off cliff jumps to conclusion.
  15. Engineers solve problems by Weaselmancer · · Score: 4, Insightful

    I would positively love to do something like this. The purpose of an engineer is to solve problems. That's what makes me happy at work. Solving problems. So here you have a very specific problem that required the construction of a custom computer made out of banks of FPGAs. Tell me that's not sexy! Who cares if it's for bankers. That is a damn nifty gadget to work on building.

    Imagine building it yourself. Switching networks, Linux on ARM cores peppered here and there coordinating and dumping program code to the FPGA banks, writing the drivers to grab the data once the run is completed...

    And at the end of the day a problem solved: What once took all day now takes a couple of minutes.

    This would have been a thoroughly nifty machine to work on.

    --
    Weaselmancer
    rediculous.
    1. Re:Engineers solve problems by Anonymous Coward · · Score: 2, Interesting

      Who cares if it's for bankers. That is a damn nifty gadget to work on building.

      Replace "bankers" with "the Third Reich" and you would no doubt find some IBM engineers in the 1930s thinking exactly the same thing about the computers they were building.

      Just because the technology is cool doesn't mean you're absolved of any moral or ethical dilemmas that may arise from working on it.

    2. Re:Engineers solve problems by hjf · · Score: 3, Informative

      Well, why don't you? The beauty if VHDL is that it's really, really basic. The rest is up to you to implement. Come join us in ##vhdl at irc.freenode.net or try fpga4fun.com. $100 should get you an FPGA training board which you can use to learn.

    3. Re:Engineers solve problems by other-different-nick · · Score: 2

      The purpose of an engineer is to solve problems.

      Engineers solve real-world problems: when they make simplifying assumptions, they try to avoid transparent falsehoods like "a market functions with perfect transparency," and "all players in a market behave rationally." Hell, there's no way to even check the latter statement for truth: destroying a major company to build your relatively minor personal fortune may or may not be rational. If any solid engineering had been invested into the mortgage market of the past decade, the ultra-rich would not have cleaned up by throwing the economy into turmoil. Yet somehow, they have been able to do so, and if anybody ever goes to jail for this type of fraud, it will be a pawn like you.

      Occasionally, engineers do fuck up [[http://en.wikipedia.org/wiki/Tacoma_Narrows_Bridge_%281940%29]], but when you look at major economic events from the eighties [[http://en.wikipedia.org/wiki/S%26L_crisis]], nineties [[http://en.wikipedia.org/wiki/Enron]], and today [[http://en.wikipedia.org/wiki/Credit_default_swap]], it seems slanderous for you to mention your particular brand of snake-oil in the same sentence as "engineering."

  16. Their risk metrics are less than worthless by decora · · Score: 2

    JP Morgan, along with every other mega-bank, has no idea what is actually on it's balance sheet, and hasn't for 10-20 years.

    The Shadow Banking system is too big, too complicated, and too interconnected for any of these risk metrics to mean anything.

    JP Morgan did the same business as Goldman Sachs and the others, loading up with CDOs and credit default swaps and CLOs and the rest of it. JPM is portrayed as 'wiser' than the rest in the books and the articles about the crisis, but its not really true. They were less stupid than the stupidest people, that doesnt make them smart.

    They got bailed out just like all the other megabanks. Why? Because they had no idea what was on their books. They are running a black box. All the supercomputers in the world cannot make up for a complete and utter lack of transparency. And that is what the world of Credit Default Swaps (invented at JPM no less) are. A gigantic black box. The rest of the Shadow Banking system is the same, and JP Morgan (and the rest of the big banks) are up to their necks in it.

    Just because you can calculate lies faster, doesnt mean they aren't lies.

  17. imagine helping JPMorgan destroy the economy by decora · · Score: 4, Insightful

    there have been articles about the computer guys who were working inside the CDO machines of wall street in 2000-2008 before the whole thing came crashing down.

    the only people who could hold their nose and not-care what their work was being used for are complete pscyopaths, who went through some kind of personality-cracking process so that they can act like normal people while they help destroy the planets economy.

  18. Deutsche and Goldman almost bit the dust by decora · · Score: 3, Insightful

    if Morgan Stanley hadn't got bailed out by a Japanese bank, and if Bank of America hadn't bought Merrill, then Merrill would have failed, the Morgan, and Goldman and JPM would have fallen because of it.

    Goldman's credit default swap business with AIG was also basically 100% bailed out by the taxpayer. Goldman would have lost massive amounts of money if it hadn't been for the deal the government gave them when it took over AIG.

    .

  19. Re:Objection. It's not math. by MachDelta · · Score: 2

    Mathless software?

    That's like salt-free seasoning-salt, right?

  20. Re:hahaha by Nursie · · Score: 2

    Not that this justifies it, or that I disagree with you, but here in Australia the cost of living is vastly higher than the united states.

    The US and AU dollars are at rough parity, but it goes a hell of a lot further in the US.

  21. Re:Absolutely! More golfing, less bankrupting! by KingAlanI · · Score: 2

    I think it was basically a pun on another meaning of the FPGA acronym.

    --
    I listen to both RIAA and non-RIAA stuff if I like the music, tangential business/politics nonwithstanding.