Blue Gene/L Tops Its Own Supercomputer Record
DIY News writes "Lawrence Livermore National Laboratory and IBM unveiled the Blue Gene/L supercomputer Thursday and announced it's broken its own record again for the world's fastest supercomputer. The 65,536-processor machine can sustain 280.6 teraflops. That's the top end of the range IBM forecast and more than twice the previous Blue Gene/L record of 136.8 teraflops, set when only half the machine was installed."
lets put folding@home (http://folding.stanford.edu/) on that mother!
What useful utility has top sports athletes contributed to society? We probably pay the top athletes the cost of several super computers and all they do with all this money is throw orange plastic balls pumped with air into little string baskets hoisted on a pole. Sometimes I wonder what is the purpose of paying some man to hit a tiny ball with dimples into a hole far far away on a grassy playing field. And every time someone breaks someone else's record of hitting the tiny white ball, they get large sums of cash. But when these super computer people break records, all they get is a little pat on the back. BlueGene/L should be signing contracts with Nike and Pepsi.
On something like this, they would probably be programming in High Performance Fortran or Fortran w/ OpenMP -- or some similar dialect that supports massively parallel execution. I'm sure IBM develop an in-house compiler for the language.
Tubal-Cain smokes the white owl.
That probably only means that they have optimised the architecture over time as would be expected. Things like improved resource management, a slimmer kernel for each CPU, a better compiler, etc. can easily make up for that small performance gain.
Just because the summary says when the machine was halfway done at 138 GFlops, that definitely does not mean the other half was just putting in the other half of the processors. They probably also meant that the optimizations were not finished as well. Pure linear growth is a dream enough already. If I saw exponential growth I'd crap my pants.
Linux is substantially more scaleable now than it was even just 6 months ago (not the vanilla, but quite well tested scaleability patches). This could account for the improvement. I suspect if they ran just half of it now, they'd get a little bit over half the performance (but not much over half - that is how good Linux is these days).
Sorry, but I have to disagree with your conclusion that this represents exponential growth.
The effect you speak of (doubling the number of processors giving less than double the final "power") is due to additional overhead - various processors coordinating their work with each other, deciding things like "Should I split this 2 ways or 4?" and so on - and that sort of stuff inevitably increases with the number of processors.
You can use improved algorithms, special-purpose hardware, etc, etc, to minimize this "friction", but it will always exist, and the percentage of processing that is "overhead" will inevitably climb as you increase the number of processors.
It's far more likely that either the earlier number resulted from some inefficiencies that existed then (due to it not being built as designed yet, perhaps), or there have been improvements in the algorithms or infrastructure which give greater efficiencies.
If it's the latter case, if you unplugged the 2nd half of the CPUs and made the measurement again, you'd probably get 150 GFlops or so.
Basically, you could write the equation for total power something like:
X - O - i**x, where X is the number of processors, O is the basic overhead (for doing things like I/O, for example), and c is the incremental cost of adding each processor.
To have what you describe would require that i**x be a negative number, which is like saying that you can have 10 individual conversations in less time than you can have five. Ain't gonna happen.