Slashdot Mirror
Fastest-Ever Windows HPC Cluster
An anonymous reader links to an eWeek story which says that Microsoft's "fastest-yet homegrown supercomputer, running the U.S. company's new Windows HPC Server 2008, debuted in the top 25 of the world's top 500 fastest supercomputers, as tested and operated by the National Center for Supercomputing Applications. ... Most of the cores were made up of Intel Xeon quad-core chips. Storage for the system was about 6 terabytes," and asks "I wonder how the uptime compares? When machines scale to this size, they tend to quirk out in weird ways."
Enough power to run vista.
But does it run linux?
"Your cluster has just finished downloading an update, would you like to reboot now?"
Just disrupt the deflector shield with a tachyon burst.
The Windows Server 2K8 code base must be better than previous versions of Windows. From what I understood, Windows didn't scale for clustering due to problems with file locking (IIRC, the overhead for tracking locks grew quickly enough that the performance was marginalized past about 4 nodes). Unless they're using an iSCSI SNS server that handles the locks over a clustered file system. Still, this is leaps and bounds beyond previous versions of Windows WRT clustering!
If I mod you up, it doesn't necessarily mean I agree with what you've said, sorry.
So does everyone else.
You are using English. Please learn the difference between loose and lose; they're, there, and their; your and you're.
And with the easily affordable CALs, up to 11 users will be able to use it at the same time! (well 8, 2 CALs will prolly be used by junior admins, and one for "test")
If you don't know what AltaVista is (was), get off my lawn.
Clustering in the sense I think you are discussing is the HA-clustering stuff. HPC clustering is a tad different.
XML is like violence. If it doesn't solve the problem, use more.
How does a Windows HPC cluster present itself? Do you submit batch jobs from a GUI?
. . . maybe with a tossed chair . . . ?
Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
Such a powerful cluster should get from power-up to BSOD instantly!
McCain/Palin '08. Now THAT's hope and change!
Yes, #23 a Dell cluster for NCSA. You can download the results in XLS format and then do a sort to quickly find data like that =)
There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
Actually... When America tested it's first fighter jet it had a dummy propeller.
Sure, just pop in a Rocks cd and hit the power switch. That will format the harddrives for you as well.
So.... six terabytes... isn't that horribly small by today's standards ? I mean, our small backup server here is 2 teras, it's just a cheap PC with a bunch of SATA drives in it.
Does that mean my gaming rig and media server, when combined, constitute an "HPC Cluster" worthy of the top 100 ?
Ghey.
-Billco, Fnarg.com
I don't, but there's a lot of information at the home page. Including links to case studies for NASCAR, Daresbury, etc., etc.
Including FAQs. And, finally, the answer to the burning question: will it run Linux?
"It looks like you're breaking into the top 25 fastest supercomputers. Would you like me to fix that?"
stuff |
and I have a very hard time believing most of the claims of fact in this story.
"When we deployed Windows on our cluster, which has more than 1,000 nodes, we went from bare metal to running the Linpack benchmark programs in just four hours,"
Hmmm. And what installer was this? Is it available commercially? How much is the license for the version with this mythical four-hour installer?
"The performance of Windows HPC Server 2008 has yielded efficiencies that are among the highest we've seen for this class of machine," Pennington said.
What "class" would that be? I imagine it would explicitly exclude Free clusters.
One should question whether the efficacy of any institution/research project using their grant money wisely given the amount of money required to fulfill Microsoft's licensing requirements.
Furthermore, If research projects are actually considering wasting their grant dollars on Microsoft licenses, then the outlook for American R&D is grim.
http://www.maxineudall.com/2010/02/should-economists-be-sued-for-malpractice.html
It looks like Microsoft engineers have been working with the NCSA and a beta version of Microsoft HPC server 2008 as part of a Microsoft marketing push for this software. The marketing pdf is here. Microsoft want to increase their foothold in HPC, it's a growing, high margin market.
But the statistics for the top500.org show that over 9000 processors is way above normal for a supercomputer cluster up there. In fact less than 5% of machines in the entire 500 have more than 8000 processors, with the majority around the 1-4k mark. Oh, and 85% run Linux-only with an amazing 5 (not percent, actual projects) running Microsoft-only. So it looks like MS did this through hardware brute-force, not some amazing feat of programming. But then, that's true of them all. Although being in the top500 list is "good PR", it doesn't mean that much.
I wonder what the licensing is like for a 9000-processor Windows Server, though?
Should be enough for everyone.
Is this euphemism for "botnet"?
Can someone explain why anyone could possibly want Windows on a scientific computing cluster? What does Windows offer that Linux doesn't?
Much of my work involves running molecular dynamics simulations. By HPC standards these are tiny calculations (in my case, usually 32 CPUs at a time). All science HPC software I'm aware of is Unix-oriented, and everything runs on Linux. At my institution we have an OS X cluster and we are in the process of purchasing a Linux cluster. We didn't even consider Windows - given the difficulties we've experienced administering Windows on the desktop, a Windows cluster just seems like an expensive exercise in frustration.
A Windows MSCS cluster is essentially for fail-over/HA purposes. This is for high-performance purposes, and explictly excludes use as an application or database server. From the FAQs (although this is for 2003):
It's growing yes but its actually a very low margin market. The whole idea of an HPC cluster is saving money.
Somehow I doubt it's the margins so much as the fact that Linux dominates it and they are afraid Linux will use that to gain a foothold elsewhere.
There is a difference between super computing and HPC. Up till now Linux has had little to compete with in scaled out HPC rigs. Allot of that has to do with node pricing and the fact that Sun has been asleep at the wheel (no pun intended - if know SunOs you should be laughing). However, priced right this and Solaris are a real competative threat for Linux. Linux is not a great platform for HPC. The kernel doesn't scale to extreme levels (total througput pegs early) and Tx latencey gets pretty wide at the top end. You have to over-scale to flatten the latencey curve and this causes other problems that can affect throughput like locality of data. Solaris is a great platform because it provides low latency spread, good througput and solid reliability. Windows (believe it or not) provides the highest total throughput under a given load with a given hardware set but it's latencey is not as good as Solaris.
/LabMonkey09
While I don't agree that Microsoft Windows HPC Server is the best software to manage a supercomputer, the linux diehards out there should pay attention to a problem that Microsoft is trying to tackle: accessible supercomputing. See one of their case studies as an example.
The bottom line is, these days pretty much anyone has access to a few TFlops of compute power, but the learning curve for getting something running on these machines is pretty intimidating, especially for non-CS based disciplines. I've had to take a 1-2 day class, plus futz around with the clunky command-line tools for a few days or so, on every supercomputer I've used, just to get simple jobs running. In my experience, people learn to game the various batching and queuing systems such that their jobs run faster than everyone else's, further shutting out the newcomers.
HPC vendors would be wise to focus more attention on the tools and interfaces so that Joe-researcher can set the number of nodes and go, rather than having to manually edit loadleveler text files, sending them to the queue, and then coming back next day to find the job failed due to a typo in the startup script.
On multi-TFLOP systems, not everyone needs 99.5% efficiency with all the implementation details that requires. These days, many people just want their job to run reasonably quickly, with no fuss.
The same thing happened several years ago with the move to high level languages like Python and Ruby. Sure, they're slower than C++ and FORTRAN. But for the vast majority of applications, you wouldn't know the difference on modern processors. And the turn around time and user-friendliness on these languages is so much better, using them is a no-brainer.
Hopefully Microsoft can spur the industry in this direction.
now see how fast the identical hardware runs with Linux on it... bet it goes way faster...
Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
There's an obvious application to run on a Windows cluster.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
From your case study:
"""
In addition, it is investigating ways to allow users to connect remotely to the cluster. It expects to complete the project and move the cluster into production by March 2009.
"""
By time the cluster in the case study allows users to remotely log in, the hardware will have lost at least 1/2 of its value.
While more work is needed to make things user friendly, you have to remember that the funding is there for CPUs; not many folks are forward looking enough to realize researchers really need funding into making stuff easier.
Whereas Server 2008 and Vista share a tad more of their code base.
and *that* is relevant.
And could be humorously be alluded to because of the mis-detection of some software.
"Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
"Microsoft is trying to tackle: accessible supercomputing"
..
.. are accessible to people interested in pursuing science, simulation or modeling"
.. :)
Assuming MS was responding to this imagioned problem
"The contest showed that supercomputers
"but the learning curve for getting something running on these machines is pretty intimidating, especially for non-CS based disciplines. I've had to take a 1-2 day class, plus futz around"
You actually programed a supercomouter - cool. What type and where exactly? How does HPC Server differ in respect to other solutions?
"the Blue Gene family of supercomputers has been designed to deliver ultrascale performance within a standard programming environment"
"Hopefully Microsoft can spur the industry in this direction"
You mean like continually inventing Apple, badly
davecb5620@gmail.com
However, MPI itself has serious issues. The master copy of the program starts/stops slave programs vis SSH, although some implementations also support inetd-style starts. Messages sent to multiple machines are sent sequentially, rather than via a reliable multicast, wasting bandwidth and wasting CPU cycles.
It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
Read the summary for TFA, it "debuted in the top 25". Look at the link I provided, it is #23.