JPMorgan Rolls Out (Another) FPGA Supercomputer
An anonymous reader writes "JP Morgan is expanding its use of dataflow supercomputers to speed up more of its fixed income trading operations. Earlier this year, the bank revealed how it reduced the time it took to run an end-of-day risk calculation from eight hours down to just 238 seconds. The new dataflow supercomputer, where the computer chips are tailored to perform specific, bespoke tasks (as explained in this Wall Street Journal article) — will be equivalent to more than 12,000 conventional x86 cores, providing 128 Teraflops of performance."
So they can project how much money to borrow from the Federal Government the next time they have lent beyond sane limits to property speculators or invested in schemes even Mandelbrot wouldn't be able to simulate.
A feeling of having made the same mistake before: Deja Foobar
These banks aren't just siphoning money, they are also siphoning talent away from more important projects. The people working on these things could be brilliant physicists or engineers, if they weren't sucked into the dark side.
using FPGA's instead of x86 would probably consume a significant amount less electricity. using manpower is good in terms of the many men being paid for their efforts instead or a few ceos just pocketing the money as extra bonuses
It's been envisioned, implemented, and commerialized a long time ago. You can buy a duel socket AMD board, and put in an AMD CPU in one socket and a FPGA co-processor in the other socket. That was 5 years ago.
Quite a few supercomputers on top500 have the above mentioned configuration. JPMorgan is very late to the party.
You're probably wondering why every desktop, laptop, and smartphone doesn't come with this wonderful technology already, and there are many many reasons for that:
- FPGA programming is difficult, and it's a much rarer talent than software programming
- The FPGA industry is currently a duopoly and combined that with the small market of FPGAs means that the price is too high for consumer electronics
- Specialized functionality can always be more cheaply implemented in ASICs (cryptographic co-processors, new instructions in CPUs, H264 decoding ASICs)
- The chicken and egg problem. Developers won't start hiring FPGA programmers en masse until there are enough machines out there with FPGA co-processors installed. And people won't start buying FPGA co-processors until their favorite program supported co-processor acceleration.
The problems the risk analysis team faced even in the 2000 era was such a tough nut to crack that they had to limit the complexity of the algorithms they used just because there wasn't hardware powerful enough.
Look, the problem here is the black swan. You can't model a black swan unless you can simulate the entire world economy down to the last neuron in some farmer's brain in a rural Chinese village. Right now we can't model a single human brain let alone all of them.
The world economy didn't melt down because some spreadsheet only calculated 12 decimal places when it should have calculated 325. It melted down because everybody decided to leverage themselves 100x on the bet that housing prices wouldn't ever go down, and they did. Now the world governments are starting to leverage themselves in small multiples on the bet that nobody would ever stop buying their bonds, mostly to bail out the bankers who bet on housing prices. I don't need arbitrary precision arithmetic to tell you where that is going to end up if it doesn't change FAST.