Slashdot Mirror


Open Blade Servers?

Greg Smith points to this ZDNet story on new Intel chips aimed at blade servers, writing "Proprietary blade servers are coming on strong from IBM, Dell and HP. Where are the open blade servers? How did Google roll out 10,000 servers at such a low cost?"

37 of 196 comments (clear)

  1. Amusing... by flewp · · Score: 5, Funny

    I got an ad for AMD server solutions for that story..

    --
    WWJD.... for a Klondike bar?
  2. The inevitable comment by Devil's+BSD · · Score: 3, Interesting

    Imagine a beowulf cluster of those...
    Really, though, the fact that this blade server consumes so much less electricity would be very meaningful to me. The server room at our school was not intended to be a server room. The wiring also is lacking, and every once in a while the breakers go pop!
    BTW, is it possible to use this in a laptop? Just imagine the power (or less consumption thereof) if you packed two processors in parallel on a laptop...

    --
    I'm the Devil the Windows users warned you about.
  3. blade server by rob-fu · · Score: 5, Informative

    If you're too lazy to read the article and don't know what a blade server is...

    Server blades got their name because of their design. A blade server typically resembles a circuit board more than anything else. They're made to be stacked vertically. These types of servers are growing in popularity for more mundane tasks such as delivering Web pages or housing protective firewalls because they use less floor space and electricity than racks of traditional servers. Server blades also share a power supply, cables and memory, which further cuts down on costs and space. Although the down server market has dampened sales, analysts believe blades will eventually form a substantial part of the market.

    Maybe I'm retarded, but I didn't immediately picture exactly what a blade server was when I saw the name...so there it is.

    1. Re:blade server by whereiswaldo · · Score: 3, Interesting

      Server blades also share a power supply, cables and memory

      Normally, redundancy is a high priority. Is the savings in hardware and electricity worth the risk of losing (say) 10 machines because one power supply failed?

    2. Re:blade server by John+Paul+Jones · · Score: 5, Informative

      Normally, redundancy is a high priority. Is the savings in hardware and electricity worth the risk of losing (say) 10 machines because one power supply failed?

      Blade servers are akin to modular switches and routers. All servers share a backplane, delivering power and network connectivity, both within the chassis and to network patch panels. Some solutions have break out boxes that permit KVM access to individual blades, while others run that through the backplane as well. Redundant power isn't the issue, since the backplane usually has redundant power; the issue is that these servers usually don't have multiple hard drives, so redundant disk isn't possible per blade. There are some that do have mirrorsets, they are less dense than the single-disk models.

      The use of blades is normally for webserving, thin client servers, etc, where the failure of a single blade simply decreases the capacity of the overall farm, rather than rendering a service unavailable.

      The best designs implement SAN HBAs into the backplane, providing common disk to all devices, and with netbooting, the devices won't need local disk at all. That's probably going to be the future of compute farms...

      -JPJ

      --
      Feh.
    3. Re:blade server by ncc74656 · · Score: 3, Informative
      Normally, redundancy is a high priority. Is the savings in hardware and electricity worth the risk of losing (say) 10 machines because one power supply failed?

      I'm sure there's still more than one power supply. You just don't have 42 of them, like you would in a rack full of 1U servers...instead, you'd have maybe two or three (like you do in some conventional servers with redundant power supplies).

      --
      20 January 2017: the End of an Error.
  4. Open What? by coene · · Score: 5, Insightful

    A blade server is a hardware product, it really has nothing todo with software, outside of the Operating System Clustering/Scaling functionality.

    Google does not use blade servers, last I knew it was just a large amount of x86 boxes running Linux.

    Open Source hardware? Does that even make sense? Either have drivers (or release the specs) that allow your hardware to be used on an Open Source operating system, or dont.

    Want an "Open Source Blade Server"? Yeah, thats called an HP with Clustered Linux on each blade...

    1. Re:Open What? by Istealmymusic · · Score: 4, Informative

      What, you mean like Open Hardware?

      --
      "The lesson to be learned is not to take the comments on slashdot too literally." --Vinnie Falco, BearShare
  5. Pentium IIIs? by SexyKellyOsbourne · · Score: 3, Interesting

    The usage of Pentium IIIs for these monsters of serious computing only goes to show how much of a badly designed marketing ploy the Pentium IV is.

    1. Re:Pentium IIIs? by coene · · Score: 5, Funny

      Not really...

      Intel knows that they cant get the P4's power consumption low enough to hit the numbers, so they use a P3.

      Blade servers are already marketed by everyone that makes them as "a tad slower, but much more energy effecient", and the main goal is better density, to allow more power in the given space. The Pentium III fits this bill perfectly.

      Intel is smart enough to know that the P4 isnt everything. Engineering > Marketing, whenever that happens, its a good thing!

    2. Re:Pentium IIIs? by silentbozo · · Score: 5, Informative

      While I won't argue about the Pentium IV being designed around the need to advertise a higher clock speed (irregardless of what that means in terms of actual computing power), the Pentium III is a more mature design, and benefits from lots of improvements to its power consumption. In a blade server, power consumption is one of the main issues, thus using a PIII doesn't necessarily mean that they wouldn't use a Pentium IV if they could get away with it - they just can't afford the power/heat issues.

      Now consider that fact with laptops using the P4 - that's one area where they can get away with it, at the cost of battery life...

    3. Re:Pentium IIIs? by Moridineas · · Score: 3, Interesting

      As a side note, from talks I've heard given by Intel engineers, their goal was definitely to up the megahertz AND overall speed. To do this, they needed to design a totally scaleable architecture. Looks like they got it right too--what's the fastest P4 today? Somewhere in the 3.0GHz range (just below I believe, and with overclocking success well about), whereas Athlon's have yet to break the 2.0GHz barrier afaik. No question mhz-for-mhz the Athlon is faster, but when it's outpaced by over 1GHz, the advantage moves back to the p4's court.

  6. open blades? by Anonymous Coward · · Score: 5, Funny

    That could be dangerous. Over 50 people* die per month in server blade accidents. Sadly, these needless deaths could've been prevented by simple server blade cover kits.

    Only YOU can prevent fatal server room mishaps.

    Keep those blades covered, kids.

    This is a public service message brought to you by Sally Shark, official mascot for server room safety.

    *note: statistics may be fictional.

  7. Google - Free Servers by puto · · Score: 3, Interesting

    Well, I am sure free advertising has a lot do with the Google roll out.

    The <insert powered by DELL,COMPAQ/YOMAMA) tags will start appearing all over google.

    I also reckon they were free or at pretty much close to cost. Companies know what there doing. Cost on that kinda margin is probably at 200 bucks a pop straight outta the factory when you consider markup is about 500 percent on computer parts. Remember buying in bulk is power.

    Example, you can get a pc on pricewatch with a 20 gig drive, 256 megs of ram, and a giga or more processor for, 250, so think about it.

    Puto

    --
    The Revolution Will Not Be Televised
    1. Re:Google - Free Servers by Ferrule · · Score: 5, Informative

      500 % markup huh? I would still be in the hardware business if it was. You're way off.. Mod -3 uninformed and wrong.

      Basically the entire hardware industry runs off slim margins.

      I heard Dell runs at about 6%. Most distributors run a 1-2% margin, computer stores anywhere from 5-10%.

      As for the manufacturers, I haven't a clue, but they must have astronomical costs.

      Buying in bulk isn't that big of a deal anymore. When a company goes ITQ (invitation to quote) the vendors know they aren't going to win unless they at least halve their markup.

    2. Re:Google - Free Servers by puto · · Score: 4, Insightful

      I was unclear, when I meant coming straight out, I meant right out of the factory. No distributors costs, but dell or compaqs actual costs. Which they would never publish, only allude to 6% margin.

      I certainly didnt mean pc shop.

      But if ia pc shop has an account with Tech data and other biggies then it is not unusal for 20-20 point markup on a pc. A pc that can be built with 2 gig processor, 256 meg, 19 inch monitor, getforce, nic, sound, yadda, for about 700 bucks. Will easily sell for 1200 bucks and people will think they are getting a deal, well lets subtract 100 bucks for xp home. And lets also remember that with a corporate account there are places cheaper than Pricewatch. so we say profit is 400 dollars. That is a little more than 6 percent on the homefront.

      Now I am not saying all PC shops do this, but most still have a healthy margin on the hardware. Because Johnny Six Pack still thinks you buy cheap you get cheap.

      The actual manufactures of the the seperate parts run on fairly slim margins, but the retailers control the prices. That is why we see such a disparity of prices on the web.

      I was a buyer for a fairly large shop up until recently, and we sold good boxes, good prices, and made at least 200 a box on a bad day. The only time we lost out was when we went up agains some of HP's all in one deals from Walmart or circut city. And we could still match them with better equipment and make 50 bucks on the hardware, but we didnt, of course we gave three year warranties, and people usually shelled out the extra 200 bucks, cause they had someone to throw the thing at if it didnt work.

      I also was a buyer in South America and bought things right off the boat. And you would not beleive some things I was able to get at very low prices.

      The hardware market is all price controlled. The margins are higher than they make out. But the larger the company the more staff, etc you gotta support, more perks, got to make shareholders happy. So you gotta to fudge margins, it is what we Americans or good at.

      So to end this rant. If I know I can call Tech data, get quality brand parts, sell a pc at a good price, comparable with dell. and I am going low here, make 150 bucks on top of my built in build cost. And knowing I have nowhere near the buld discounting on hardware parts as they do. Dell is making mucho bucks.

      Puto

      --
      The Revolution Will Not Be Televised
    3. Re:Google - Free Servers by puto · · Score: 3, Interesting

      For arguments sake" I am not the worlds best computer guy". I do not claim to be, but I have been in the networking/hardware end for a long time, and can consistently make good money at it while using quality equipment.

      Let me breakdown a few of the responses concerns:

      Pricewatch: The best thing since sliced bread for the tech world. Price watch might be fine for the home user, a buddy, but you actually have no idea what you are getting, and why is it so cheap. RMA stuff, returns, "Fell off the Truck". So while all this transfers into savings for you and your customer, you have this problem. TechData or any of the biggies will cross ship, or ship ASAP an RMA, and you put the old one in the box. No questions asked 99.9 % of Pricewatch suppliers will not do this. Plus most of the stuff is OEM, 1 year, 90 day, 30 day warranty. I do not know about you guys but with hardware reliability being what it is these days compared to what it was years ago. I would rather pay the extra 12 bucks for the retail item and get the 3 year warranty. That way when something burns out in 91 days, I do not have an angry customer bitching at me. In the 'real'world you know part of your profit will be eaten up by service over the next two three years. So you need quality from a reputable company. Not a 20 dollar motherboard with everything built in and 1 pci slot, something burns out. You gotta replace it outta pocket because the company that has sold it to you has disappeared three days later.

      I do trust NewEgg. But I can wangle better prices with some of the larger places. My new box is entirely new egg. But there is nothing generic in it either. The only el cheapo thing I buy are nics and those are lend out spares for my customers until I grab them something decent. I picked up 100 nics at 2 bucks a piece. 10/100 realtek. Sell em for six bucks, everyone is happy, and they work well.

      TechData - I only mentioned Tech Data, because it is one of the largest and well knownones out there. I also use other companies. Sometimes Tech Data has really good deals on somethings and others no. Also Tech Data has different prices for different customers, all about how much you buy from them. Different prices for different people. And you can always get your rep and get them to cut you a break.

      Yeah, maybe my margin was way up there, and too high. But if you are making 6%, .
      1. Do not have accounts with the right companies.
      2. Shouldn't be on the hardware end ( I make my money on the service end, hardware is a pain in the ass, and I do not trust anyone under 28 to build a box for my company. I trust someone who has had his hands in an XT. Computers have gotten way to easy to build in the past few, so hardware skills have dropped dramatically. I have noticed in the shops I have run that the techs 25 and under tend to RMA more burned out stuff.... Maybe cause they weren't working on them in the day when a pc cost 4 grand and take the same amount of care.
      3. Do not know how to market your product to justify the price.

      I honestly make all my money networking this days. I only build my personal pcs. I assess the site and order Dells, and I again I call someone at Dell. I always see on Slashdot "Yeah well on Pricewatch,Dell,HP, site here is the price" Price for who? You can call and cut deals, and if you have been in this business for any amount of time you have a nice little Rolodex with all sorts of contacts. I can usually get 12 percent knocked off Dells web price by calling. Do a little research, pick up the phone, get these dusty people skills out. My customers will buy for me on bids even if I am a few dollars higher. Why? Personality, reliability, and quality.

      And the reported earning for Compaq, or whatever computer company. You thing this are actually the truth? Especially what we are seeing in business today? Enron, AOL, Anderseen? Come on! HP/Compaq employees went public with how management doctored the sheets so the merger would go through. And Compaq has been losing its ass for a long time. You actually believe all of what you read? Then give me about five minutes to throw a web page together. And for the paltry sum of 1000 dollars I will sell you a product that will make you ejaculate %5000 more, get you hot chicks, triple your earnings, and let you reliably predict the time of Cher's next facelift.

      And as for people saying then why can't I build (insert company name here) server for 50%, or the company %50 less. Cause the market is price controlled, get that through your heads. Easy analogy. The GeForce Ultra Mega 10000 comes out. It costs $500. The GeForce Ultra Mega 90000 from last month drops to $99.99.

      You think dell can carry all that baggage with 6 percent margins. They can with 6 percent reported margins.

      I understand business and markets very well. Because I do beleive in facts and figures reported by companies. They report what they want us to hear.

      Jeez it is rant Sunday for me.

      Puto

      --
      The Revolution Will Not Be Televised
  8. Clarifying by davisshaver · · Score: 4, Funny

    So a balde server is sort of like a pie but in reverse. Instead of making it smaller you make it bigger by adding some more stuff, but you still share the same pan.

    --
    "What we have here is a failure to communicate"
    The Warden, Cool Hand Luke
  9. Setiathome Yess!!! by spineboy · · Score: 5, Funny

    Is it bad to when you see stuff like this to think how you can use it to further boost your Setiathome scores

    --
    ..........FULL STOP.
  10. whoever wrote this artlcle is on crack. by jba · · Score: 4, Informative

    Blade servers are not supposed to be stacked vertically, and you can fit *way* more than 42 blade servers in a single rack. The author is thinking of 1U boxes, which have only been around for say... 10 years!

    look at : http://www.compaq.com/products/servers/platforms/i ndex-bl.html

    280+ servers in a rack.

    1. Re:whoever wrote this artlcle is on crack. by Istealmymusic · · Score: 3, Funny

      280 servers in a rack?! is that why they call it open whordware?

      --
      "The lesson to be learned is not to take the comments on slashdot too literally." --Vinnie Falco, BearShare
    2. Re:whoever wrote this artlcle is on crack. by Anonymous Coward · · Score: 4, Informative

      Yes, you can fit more than 42 blade servers in a single rack. Good thing the article SAID that you can fit 100 or more in a rack. 42 servers was referring to traditional single unit high servers, the market blades is in many cases replacing.

      Read the article before commenting.

  11. Old Article by hopbine · · Score: 5, Informative

    The article is quite old now - March 19 - and HP appears to favour the blade servers from the former compaq. That being said the advantage that blade servers give is that they save a great deal of space, and make cabling much easier. In essence you can stuff a lot of proccessors in a rack, also put in a small disk farm, network switch using copper or fiber, and away you go.

    --
    Semper ubi sub ubi
  12. Blade... ick by LinuxHam · · Score: 5, Interesting

    I'm currently involved in a server consolidation project where the customer has dictated that they want to see some blade. Our primary platforms are some kickin' Intel servers (8-way 1.6GHz, 8GB RAM, max 16-way 64GB) running VMWare ESX, but the customer is insisting on seeing some blade. I am personally unimpressed by them. You need to make sure that your apps can and are built to either cluster or failover cleanly when you get blade involved. Or just not run any mission critical stuff on it.

    I prefer the VMWare ESX on our nearly-non-stop Intel hardware, the x440.

    --
    Intelligent Life on Earth
  13. Easy - by not using blade servers.... by mzito · · Score: 5, Insightful

    We won't see open blade servers for quite a while, if ever. Normal servers are only "open" because they use a common set of interconnects (standard power, ps/2 keyboard, 100BaseT), etc. On a blade server, you have to unify all of those interconnects in a hot-swappable fashion. The result? A customized connector and backplane architecture.

    In addition, there's no incentive for companies to open a standard for blade servers - they'll make more money by selling the chassis and blades, as well as the management software that is generally required for these types of servers.

    As far as Google goes, they rolled out their infrastructure for such a low cost because they did the following things:

    1) didn't use blade servers(more on that in a sec)
    2) bought in large quantities
    3) bought generic/semi-generic servers (by which I mean "not IBM")

    Not using blade servers was a sharp idea because the real advantages of blade servers come in certain particular situations. These include where power/heat/space is really expensive or where you need a lot of hosts without a lot of performance (like QA, staging and development environments). Remember, that while they use less space, power, etc., they also use laptop/low-power cpus and hard drives, so the performance can be lower, especially for i/o intensive operations. If you're not hugely space-constrained, using 1U servers will save you money in the long run.

    Thanks,
    Matt

    --
    me@mzi.to
  14. PICMG 2.16 Is where Linux can really shine by Anonymous Coward · · Score: 5, Informative

    Where Linux will really shine is the new PICMG-2.16 standard. It's an enhancement/alternative to CompactPCI where a chassis uses Ethernet signalling on the backplane instead of CompactPCI signals. That means a single chassis can have an intel, Sun, and/or motorola blade in the same chassis and they communicate via TCP/IP instead of hardware-specific signalling. It also means that a Linux-based blade can work in *any* manufacturers chassis. This removes a big barrier of entry for the Linux in the telecom market.

    Other cool things about PICMG 2-16 Blades:

    • Blades (like ethernet hosts) are more easily hot-swappable
    • Depending on the chassis switch, bus speeds could approach 24GB/s in the near future
    • Device drivers need only speak TCP/IP (one driver works on multiple blade operating systems)
    For more info see: The Next Big Thing (pdf) and there might be something here since these guys designed part of the spec.
  15. proprietary doesn't necessarily mean bad... by deviator · · Score: 3, Insightful
    why is there almost ALWAYS a knee-jerk reaction to the word "proprietary" by the slashdot editors?

    Just because the blades are "proprietary" doesn't mean they're bad. They're denser, thus easier to physically manage and run with lower power requirements than other types of servers. Just because they weren't created by a committee of "free-thinking" open source advocates doesn't mean they're useless to companies who need more processing power at lower cost.

    Seriously, the commercial market offers added value in their products that still lacks in many open source projects.

  16. How Google did it by faster · · Score: 5, Informative
    First, they planned to use a distributed architecture from the beginning. Then they used cheapo machines until the reliability started costing more than it saved, and then they started buying Rackable Systems boxes. 1U, half-depth, 82 to a cabinet with a hub (or was it a switch?) at the top on each side.

    From there, they figured out a functional failover system and set up four geographically distributed data centers.

    Oh, and they coded up a search engine thing at the same time.

  17. True Open Blade Servers by LuxuryYacht · · Score: 3, Informative

    True Open Standard Blade Servers are just around the corner. Up until now the current offerings by RLX, HP and IBM have been proprietary blade server designs. The next generation blade servers will be based on an open hardware standards where different vendors blades can be swapped with each other the same way that Compact-PCI is a standard blade design where all cpu boards are interchangeable with each other.

    Low power CPU's are needed for the current crop of blade server designs since they forgot to deal with any heat management. The current blade designs rely entirely on airflow across the cpu package for cooling in a 2U or 3U high blade with 0.7" between each blade. Oops!!... how many blades can you stuff into a rack with each processor pulling 30 - 60 watts each and keep the temp down to 1K cpus per 42U rack) while still using Xeon and other x86 processors that produce over 60W of heat each.

    --
    Quidquid latine dictum sit altum viditur
  18. transmeta and its applications by goombah99 · · Score: 5, Interesting
    Los Alamos has a large transmeta processor cluster on blades. It is so low power that The entire 200 blade system does not need any special cooling. It sits in an open room with offices and occupies just one ordinary rack. There are 24 blades per 3U of space sharing redundant powersupplies and built in network switches.

    The really interesting thing is that as it is used it appears to be faster than the same clock speed pentium. What? you say. How can this be, since transmeta has a rep for being slow.

    Well it truns out that for scientific applications, ones where you tend to sit in tight loops a lot the thing is faster. It's meta chips compile the intel instruructions into its internal processor code. Once the overhead of compiling is over its faster internally than a pentium 3

    The reason it got a bad rep for being slow is that for GUI type applications where the code is running all over the place and never doing the same thing for very long, it loses out.

    given the incredible stability (120 days no reboot), the increacing speed of the transmeta chips (1.2 Ghz), and the extreme low power, high density and no need for special cooling these things may revolutionize scientific and industrial computuing. But they may not dent the desktop market for raw power in GUI applications.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:transmeta and its applications by buffy · · Score: 4, Informative
      For more information about the Green Destiny:

      cnn article

      infoworld article

      Here's a link directly to a page w/in LANL and just for the heck of it a little something from google.

      Standard Disclaimer + I work for RLX.

  19. Re:Completely Worthless Post.... by frovingslosh · · Score: 3, Insightful
    I'll agree, but I'll give a reason to back it up:

    How did Google roll out 10,000 servers at such a low cost?" Am I supposed to know what timothy is talking about here? I sure don't. Google hasn't informed me of any "low cost" and the article and timothy's write-up don't say anything (else) about it. Perhaps if he's going to make a big deal of something he should explain what is revolutionary or amazing here, or at least do more than imply a special amazing but unmentioned price.

    Not only that, but the last line of the ZDNEt write-up says The new 800MHz chip, which uses ServerWorks' LE3 chipset, will list for $289 each in 1,000 unit quantities. OK, low power is nice, dual processors are OK, but hardly anything special, particularly when they only run at 800 mhz. After all, the reason for a dual processor is to gain more processing power and speed, but a dual processor 800 meg chip will not perform as well as a simple single processor 1600 mhz chip and is more complex to program for. A single processor 1600mhz AMD chip is less expensive and will outperform this chip. I see no reason to get excited if the cpu chip price is $289!

    --
    I'm an American. I love this country and the freedoms that we used to have.
  20. Re:Completely Worthless Reply to the Post.... by Moekandu · · Score: 3, Informative

    First of all, the power consumption of an AMD XP running 1600Mhz (or even a 1600+) uses significantly more power than two of these 800Mhz CPU's. Talking about one CPU is one thing, but 40? Or 200? Now you're talking about enough heat generated to cause spontaneous combustion. Low power is a good thing.

    Also, it is not just the Mhz that determines the usefulness of a given configuration. Case in point, for many large multi-user database applications the number of concurrent processes (so many per CPU based on the app itself) that the system can do is much more important than the clock speed of the CPU's. Hence the need for dual, quad and oct servers and clustering with shared storage.

    Moekandu

    "It is a sad time when a family can be torn apart by something as simple as a pack of wild dogs."

    --
    Mediocrity knows nothing higher than itself; but talent instantly recognizes genius. -- Sir Arthur Conan Doyle
  21. like PCI, USB, etc. by g4dget · · Score: 4, Interesting

    The notion of "open" makes sense for hardware, although it is slightly different than from software. "Open" hardware that is documented, hardware that conforms to standards, hardware that has well-defined interfaces for software, hardware that is at least licensed under reasonable and non-discriminatory terms. RS232C, parallel ports, PC104, PCI, ISA, USB, IDE, etc., all can be considered reasonably open. Stuff that comes only from a single company, requires proprietary drivers, etc., is not open.

    An "open" standard for blade servers would be nice. And, in fact, there are such standards: passive PCI backplanes, networking backplanes, and EuroBoards. Look around the web--there are plenty of systems to build open blade servers on--servers that are open in terms of both hardware and software.

  22. Re:Google cluster. Anyone? by hazyshadeofwinter · · Score: 4, Funny

    Here's your pictures. I can't believe you missed this, /. covered it way back in April.

    --
    Click here if you just like to click on shit.
  23. Not by using blade servers by kinkie · · Score: 3, Informative

    How did Google roll out 10,000 servers at such a low cost?

    Certainly not by using blade servers. Contrary to popular belief, blade servers cost more tran their non-blade equivalents. Just like notebooks vs. laptops. Their selling points are (in some vendors' opinions) integrated management and supposed flexibility.

    --
    /kinkie
  24. How Google did it. by Marasmus · · Score: 3, Informative

    1. Start with a 24" rack, 72" tall. Rip the doors off the front and back.
    2. Get sheet-metal 24" trays to fit into the rack. Mount them every 2U, on both the front and back of the rack. Leave a few U open in the middle of the rack for your switch and KVM.
    3. Contract a company to build you custom power supplies that are 1U tall, use 90w of power, and only have 1 ATX connector and 1 molex hookup for a hard drive.
    4. Put two Tyan dual-PIII mini-ATX motherboards w/ onboard LAN and video side-by-side on each tray. Slap two 1ghz PIII's in there with good passive heatsinks. Add a small amount of RAM (128-256mb) and strap a 10-20gb hard drive to the free space on the tray using a velcro strap.
    5. Cluster 'em up! Heat is a HUGE problem, even with using the relatively-cold PIII's instead of P4's or Athlon MP's.

    After seeing the Ashburn facility in person a year or so ago, I figured out that it would have cost about $700 per node to build the cluster. Considering it was an approximately 960-node setup, it was most likely around $700,000 for the 1920-processor cluster. That's REALLY freakin' cheap!

    --
    .... um, i lost you after "0110100001101001".