Slashdot Mirror


Intel Confirms Decline of Server Giants

An anonymous reader writes "A Wired article discusses the relative decline of Dell, HP, and IBM in the server market over the past few years. Whereas those three companies once provided 75% of Intel's server chip revenue, those revenues are now split between the big three and five other companies as well. Google is fifth on the list. 'It's the big web players that are moving away from the HPs and the Dells, and most of these same companies offer large "cloud" services that let other businesses run their operations without purchasing servers in the first place. To be sure, as the market shifts, HP, Dell, and IBM are working to reinvent themselves. Dell, for instance, launched a new business unit dedicated to building custom gear for the big web players — Dell Data Center Services — and all these outfits are now offering their own cloud services. But the tide is against them.'"

41 of 152 comments (clear)

  1. If Google sold servers... by denis-The-menace · · Score: 5, Interesting

    If Google sold servers, HP and Dell would die overnight.

    Just the "12volt-only" power supplies with built-in batteries with "12volt-only" motherboards makes them more reliable than anything out there.

    HP and Dell either can't or won't license this from Google.

    --
    Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    1. Re:If Google sold servers... by denis-The-menace · · Score: 3, Informative

      In google servers, the power supply only make +12volts.

      There are no -12V, +5V or -5V rails.
      There are, instead, DC-to-DC converters on the motherboard.

      --
      Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    2. Re:If Google sold servers... by postbigbang · · Score: 3, Insightful

      Other motherboards make use of similar dc-dc converters and have for a long time. It's nice to have a 12vdc bus; makes it more dense. But it's neither innovative or unique. Instead, it's all about density and design for a specific purpose. These aren't retail-able machines. And there are now luscious racks you can obtain with lots of dense Intel, AMD, and even ARM-powered systems. If you have the application, someone has a design.

      It might be a good design for you, and not for others.

      --
      ---- Teach Peace. It's Cheaper Than War.
    3. Re:If Google sold servers... by fm6 · · Score: 4, Interesting

      Sorry, you're wrong. Wish you were right.

      I've always been appalled by the way PCs rely on big, hot, wasteful noisy internal power supplies. When IBM entered the workstation market, 30 years ago (Oh, Lord, that makes me feel old) I worked for a company that made a pre-PC x86 system that relied entirely on external, passively cooled power supplies. To me, this was clearly the way of the future, but once IBM entered the market, everything had to be IBM compatible, even the way the power system worked. Because if you couldn't use IBM-compatible power supplies, your system cost too much to build. (I once had to throw out a perfectly good Zenith PC with a blown PS; although it was mostly IBM-compatible, its power supply was proprietary, and cost too much to replace.)

      So, Google can't go into the hardware business, because their machines would cost too much and would rely too much on proprietary infrastructure. Easier to justify using your own technology regardless of cost when you're gigantic and profitable.

      HP and Dell's nightmare isn't Google. It's cloud computing in general. The cloud providers (which includes Google, if you ignore the fact that they only provide high-level cloud services, unlike Amazon) mostly build their own hardware. Those that don't buy cheap no-name hardware.

    4. Re:If Google sold servers... by afidel · · Score: 3, Interesting

      Not in the least bit, Google designs their servers to optimize power usage and absolute lowest cost per compute cycle. Those are not the same goals for every server buyer. For instance single threaded performance is a large factor for me because we run a lot of interactive workloads that are single threaded or weakly threaded but Google doesn't really care about single threaded performance because they're optimizing at the datacenter level. I also care a lot more about the reliability of any given unit because my jobs are mostly traditional single-server jobs with only my most critical workloads being clustered so the loss of any given node has a significant impact on my overall reliability whereas Google can lose dozens of servers a day per datacenter and it would have no impact on their overall operations. Another example is storage, Google uses COTS SATA drives with horrible MTBF stats and they do so without RAID protection, the only application where that might remotely have a chance of working for me is Exchange 2010 because I have four copies of each database online and the client is seamlessly pointed to a working copy.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    5. Re:If Google sold servers... by labradore · · Score: 3, Interesting

      What's the point?
      1. you use less parts and cheaper parts in the power supply.
      2. you have fewer and shorter cables
      3. you use 5V, 3.3V, regulators that are the right size for the job. this saves space and saves material
      4. you get to choose where to put these regulators so that heat management can be more optimal
      5. it's easier to integrate the 12v battery with the space saved

    6. Re:If Google sold servers... by evilviper · · Score: 2

      If Google sold servers, HP and Dell would die overnight.

      No. You're wrong on so many levels, it's hard to believable.

      Google's solution is cheap, UNRELIABLE servers. I liked the idea of a built-in battery for about 5 seconds, until I realized that the PSU isn't going to have any way to do a weekly self-test of the battery, or allow hot-swapping it... the features that separate decent UPSes from low-end consumer crap. I liked the idea of motherboards stripped of unnecessary components, until I saw it only had a single Ethernet port (can't even do bonded/trunked NICs). I liked the all-14V power supply, until I noticed there's only a single PSU, no hot-swap.

      If any of the above sounds like a good idea to you, you're not a Dell/HP/IBM customer. Even though my company does extensive clustering and has plenty of redundancy, we're not Google-scale, where it would be perfectly okay if a bunch of servers just crap out one night... If you've got your own compute-farms, fair enough, but my experience says there are fleetingly few companies who can make economic use of cheap junk servers, and many who want to try it are instead making a decision of false-economy that will come back to bite them.

      Just the "12volt-only" power supplies with built-in batteries with "12volt-only" motherboards makes them more reliable than anything out there.

      Have you ever touched a rack of servers before? Two big UPSes at the bottom of the rack, connected to two PDUs, connected, alternately, to each of the two hot-swap power supplies in each server. It's a pretty standard configuration, which is EXTREMELY reliable (unless the UPSes are complete crap, and they both run their self-tests at the same time--I'm looking at you APC!).

      This configuration is infinitely more reliable than Google servers. Google's form of redundancy is switching to an entirely different DATACENTER at a moment's notice... The batteries are only there to smooth out minor power fluxuations, and soften the fall, so ALL the servers in a datacenter don't drop at the exact same moment in time.

      HP and Dell either can't or won't license this from Google.

      Probably BOTH. Like I said, the reliability just isn't there. If you don't care, you're probably a SuperMicro customer, rather than a Dell/HP/IBM customer.

      But if your workload does fit with the Google server model, you can actually go one step-up, and get Facebook servers solutions, thanks to the Open Compute project they put together.

          http://opencompute.org/

      The big difference being that, instead of an internal battery, Facebook has a rack of batteries for every two racks of servers, which connect to the DC-input of the PSUs. This is clearly more reliable than the Google model, because the centralized batteries allow you to routinely test, before they're needed, and swap dead batteries without taking any servers down. And since the smarts are in the (inexpensive) PSUs, you don't need special 12v-only motherboard designs at all.

      You can see it all in-action in a number of Youtube videos, such as this one:

      http://www.youtube.com/watch?v=JZUX3n2yAzY

         

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    7. Re:If Google sold servers... by evilviper · · Score: 2

      I've always been appalled by the way PCs rely on big, hot, wasteful noisy internal power supplies.

      I don't follow your complaint. I'm sure you don't have a MORE EFFICIENT, SMALLER and QUIETER, PASSIVE, EXTERNAL power supply. Obviously, you threw in at least one trait that isn't possible in combination with the rest. In particular, it's incredible just how much air and heat a tiny little 12v fan can move, even the almost completely silent ones (see: SWiF2-1200 or 800).

      And while I've long lamented the inefficiency of PC PSUs, that stopped being the case over a decade ago. A nice 80+ PSU isn't a lot more expensive than the cheapest crap PSUs out there, these days, and Seasonic's are extremely quiet, and extremely reliable. Servers are even getting 90+ and 95+% efficience PSUs these days, which is about the best you could possibly hope for.

      I'm quite happy to have internal PSUs... The cables dangling everywhere are enough of a mess, an power bricks ala laptops would be a nightmare. Hell, on a low-enough power system, you can even remote the fans all-together. I've got one system like that, drawing about 5W, which I use as a firewall/NAT/router. But with nice quiet fans available, I no longer believe it's worth the effort to drastically compromise performance (CPU speed), to shave that last 7db off the noise floor.

      And standarized PSUs have been a real boon for lab electronics and other projects. It's amazing how many amps you can draw at 12 and 5v from a little $10 commoditized box. It certainly works well for RVs.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    8. Re:If Google sold servers... by fm6 · · Score: 2

      Internal power supplies that don't make a lot of noise are becoming increasingly common now. But for most of the PC's 30-year history, PC PSUs have been noisy power hogs. It was only when people started worrying about energy waste that anything was done about it.

      I'm probably guilty of overstating the potential of passively-cooled PSUs. I just noticed that they seemed to work well on some pre-PC systems I worked with (you dislike cables, but I dislike noise, and everybody dislikes wasting energy) They only disappeared because an extreme level of IBM PC compatibility become essential to anybody hoping to manufacture systems at a reasonable cost. But I don't have the hardware engineering skills to defend their wide applicability, and indeed I notice that Google's special low-energy PSUs are internal and fan-cooled.

      But Google PSUs are also very different from PSUs in standard rack-mount systems, with unusual form factors and lack of support for lower voltages. This suggests that they are one of many custom components that would make Google's servers uncompetitive in the open marketplace. And that's really the only point I was trying to make.

    9. Re:If Google sold servers... by drsmithy · · Score: 3, Insightful

      Your statement about BGP makes no sense to me. How does BGP interfere with cloud-type connections and not others?

      He is rehashing - in a rather rather pained and circuitous fashion - the "if you lose your internet connectivity you can't do any work" argument.

      This point is not entirely without merit, but generally fails to recognise that a) most companies these days can't do a lot of work without an internet connection anyway and b) internet connectivity is usually a lot easier and cheaper to make highly available and redundant that server infrastructure.

  2. Your first server, in 2012 by Compaqt · · Score: 3, Informative

    Back in the day (say, 2008 as in the article), if you wanted to buy a server, you'd buy one from the big three.

    These days, especially with FB and Google leading the way on commodity hardware, it's a different story.

    So what should you get for your first server. I.e., you're a small company. You've got a couple of laptops. You're outgrowing mutual Samba.

    You maybe want a fileserver. Maybe it'll have a few NICs and a virtual machine on it (Xen?) will do double duty as a external webserver.

    So, Core i3, i5, Xeon? Number of processor cores? Forget fast drives, and just buy a lot of memory? Rack? Or tower?

    Lockable front (so people can't just come by and reset it)? Hotplug harddrives? (You don't go this if you go the Google build-your-own route.) Redundant hard drives and ECC memory? Or a couple different commodity-style servers + sharding/rsync?

    Is a big 3 server worth it? Or search for your own server case + server power supply, etc.?

    --
    I'm not a lawyer, but I play one on the Internet. Blog
    1. Re:Your first server, in 2012 by Anonymous Coward · · Score: 3, Informative

      Search for your own. Priced one from hp/dell and it would have cost $6,000 plus. Built it with the same specs for $3000. That right there is why their server sales are dwindling.

    2. Re:Your first server, in 2012 by ard · · Score: 3, Insightful

      With the same specs? With hot-plug drives, true hardware raid, iLO/iDRAC lights-out management, secondary bios if flashing fails?

      Get a refurbished HP gen 5 or 6 server instead of building your own. Perfomance will be sufficient, don't worry. It's well below $3000, and you get enterprise quality hardware.

    3. Re:Your first server, in 2012 by MightyMartian · · Score: 4, Insightful

      As much as anything, I think virtualization is murdering the market. I bought a $3000 server that hosts six VM guests; two Windows installs (one a DC, one an Exchange server) and four Linux. A couple of years ago, I would have needed at least three servers to do it (one for each Windows install) and one Linux. Admittedly they wouldn't have to have the balls that the new server has, but still, I think we'd be talking about $4000 to $6000 in hardware. Even worse, these are all just basically images sitting on hard drives, so they can essentially be perpetual. Two or three years, when the current server dies or I decide I need more juice, just move the VM images over and away I go, and with hardware prices the way they are, I doubt the next generation server will cost any more than the one I have now, and maybe even less.

      Factor in the cloud, VPS hosting and so on, the demand for servers will inevitably drop.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    4. Re:Your first server, in 2012 by h4rr4r · · Score: 2

      Buy from the Big Three but get it refurb.
      You can get them with the original 3 year 4 hour warranty still in place. Extend it if you need that, or better yet buy another one and there is your spare parts.

    5. Re:Your first server, in 2012 by whoever57 · · Score: 2

      With the same specs? With hot-plug drives, true hardware raid, iLO/iDRAC lights-out management, secondary bios if flashing fails?

      Use software RAID and buy from SuperMicro. Yes, $3k will get you a reliable server (perhaps with dual power supplies also).

      --
      The real "Libtards" are the Libertarians!
    6. Re:Your first server, in 2012 by heypete · · Score: 2

      I'm only really familiar with SuperMicro products, but they offer a pretty standard warranty for their servers. Since they use pretty standard components, rather than vendor-specific stuff or firmware-locked drives (see my other post), spare parts are pretty easy to come by. They had all the standard features like IPMI ("Lights Out"), redundant power supplies, etc.

      RMAing broken hard disks to Sun was an exercise in frustration and delays. It literally took weeks to get a hard disk replaced under warranty.

      Dell premium support (whatever they call it) for their Optiplex systems was great, but we didn't use Dell servers because they were too expensive. Only downside: their desktops used some Dell-specific variant on the ATX power supply plugs: if we had issues on an out-of-warranty system we'd have to buy a new power supply at an inflated price. It made testing potentially-broken systems considerably difficult.

    7. Re:Your first server, in 2012 by hawguy · · Score: 2

      Search for your own. Priced one from hp/dell and it would have cost $6,000 plus. Built it with the same specs for $3000. That right there is why their server sales are dwindling.

      The difference is not always so dramatic.

      My local whitebox builder can put together hardware equivalent to a Dell R720: dual E-2620 CPU's, 32GB RAM, dual 1TB disks with onboard RAID (i.e. fake RAID) for $2800 with one year carry-in warranty. Dell charges $3566 for the the equivalent server but includes a 3 year next business day on-site warranty.

      So the dell costs $766 more, or think of it as $20/month for on-site service.

      If you're a large shop (or a very small shop) and don't mind taking care of motherboard swaps, etc yourself, then paying extra for Dell's support probably isn't worth if, but if you're a small shop with a dozen servers, you may not want to dedicate one of your (few) sysadmin's to a day of unracking the server and driving it across town for support, or procuring a replacement motherboard (if it's still available in 2 years) and swapping it out himself.

      And when I buy the Dell, I'm less worried about build problems, like leaving a tangle of power cords dangling in front of the cooling fan (which I've seen happen on whitebox builds).

    8. Re:Your first server, in 2012 by funwithBSD · · Score: 2

      Well, sure, you can do all that with Newegg available parts.

      Would I?

      Depends. If I can scale horizontally, sure. Downsize the spec and built 4 or 5 in case one fails and I wait days for a replacement part.

        If I have a vertical architecture, then I want a box I can get someone onsite in 4hrs or less.

      And that ain't Newegg, that is an Dell or HP sized company.

      --
      Never answer an anonymous letter. - Yogi Berra
    9. Re:Your first server, in 2012 by drsmithy · · Score: 3, Insightful

      Is a big 3 server worth it?

      Almost certainly. The problem is most techies - especially young ones - only look at a handful of specifications (CPU, RAM, # disks) and the sticker price, because they think their time is free.

    10. Re:Your first server, in 2012 by h4rr4r · · Score: 4, Interesting

      Linux software raid is great.
      Proprietary software raid is garbage.

      I base this on what I have seen. Linux software raid beats cheapy hardware controllers both in reliability and speed.

    11. Re:Your first server, in 2012 by Type44Q · · Score: 2

      Back in the day (say, 2008 as in the article), if you wanted to buy a server, you'd buy one from the big three.

      If you wanted a piece of shit (and let's be fair; there are plenty of times that a piece of shit is exactly what a situation requires), then yes; a server from the big three was the way to go. If, however, you wanted something "better" than that (the quotes are due to the admittedly subjective use of the word), you ordered a Supermicro or Intel serverboard, server case, high quality power supplies, etc, etc... and you never looked back (not if you belonged anywhere near a server, anyway!).

      The servers from the Big Three were truly low-quality dogshit compared to what just about any reasonably competent and knowledgeable systems engineer could slap together in a couple hours using quality off-the-shelf parts costing a fraction as much.

      I heard all the arguments against this back then (usually from extremely incompetent PHB's); those arguments failed to hold much water then and they hold even less now, looking back on it.

    12. Re:Your first server, in 2012 by Todd+Knarr · · Score: 2

      Or we think that our time costs, but it costs less than business downtime does. If you depend on the vendor and their support contract, you're impacted for however long it takes them to come out. They won't typically let you keep spares, so when a part breaks that box is impaired or off-line for whatever your contract response time it and there's nothing you can do about it. But if it's a white-box server that can be worked on in-house, you can typically keep spares on the shelf. It may cost more in admin/tech time than the support contract would, but you get the choice of paying the time and getting the box back on-line in an hour instead of anywhere from 4 hours to next-day. And you get the option of saying "Not worth messing around with. Grab a new box, spin it up and we'll figure out what's broken with this one after we're back on-line.". We techies don't think our time is free, we just don't make the common management mistake of thinking that down-time waiting for a vendor response is free. And usually our time costs a lot less than the down-time would.

    13. Re:Your first server, in 2012 by SuperQ · · Score: 2

      I run a co-op VM cluster on Ganeti. We bought 3 supermicro 1U single-socket machines (12-core AMD, 64G of ram) for about $7,000. We have about 60% of our capacity rented out. The nice part is we allocate based on 1G of ram slices so you get a pretty powerful minimum server.

    14. Re:Your first server, in 2012 by whoever57 · · Score: 2

      I have seen really terrible performance on real hardware RAID cards using enterprise-class hard drives. And, yes, I am 100% certain that it was not a fakeRAID controller card.

      Hardware RIAD in not a magic bullet for performance and they come with a nuymber of disadvantages (your RAID controller dies: good luck getting the data off the disks).

      --
      The real "Libtards" are the Libertarians!
    15. Re:Your first server, in 2012 by afidel · · Score: 2

      your RAID controller dies: good luck getting the data off the disks
      This is such BS! The RAID controllers from the big three have placed redundant copies of the metadata on the drives for at least a decade. All you need to recover the array in the event of a card failure is to place them into another server with the same generation controller or replace the failed controller. Heck when HP designed their own hardware you could even move an array out of a Proliant and place it in an MSA array and the array would read the metadata and recognize the RAID configuration.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    16. Re:Your first server, in 2012 by MasterOfGoingFaster · · Score: 2

      RAID cards are great when they work. And when they fail.... well...

      I'd much rather depend on ZFS.

      --
      Place nail here >+
    17. Re:Your first server, in 2012 by MasterOfGoingFaster · · Score: 2

      If I have a vertical architecture, then I want a box I can get someone onsite in 4hrs or less.

      And that ain't Newegg, that is an Dell or HP sized company.

      Management turned down my plan to have a second server. It was to be the identical model, but without all the disks and redundancy. They figured HP's 4-hour response time would be better than a hot spare server.

      Then the crash came.

      A nice fellow showed up within 4 hours, with the "most likely" part. It wasn't.
      The next day, more parts. Nope.
      The next day, two nice fellows showed up and replaced every part but the case. That solved it.

      The cost of downtime was so far beyond the cost of the spare server that it wasn't even funny. Hey, this stuff happens, and the HP guys were great. It just took a lot of time to resolve the problem and a spare would have let us do it while the rest of the factory kept working.

      --
      Place nail here >+
    18. Re:Your first server, in 2012 by danpbrowning · · Score: 2

      But mdadm *does* beat at least some of the enterprise $700-$1500 ones as well. My LSI MegaRAID SAS 9261-8i cost me about $900 (the battery alone was around $300) and it's slower than snot.

      I was raking in 800 MB/s seq with mdadm on an empty 8-disk RAID-50 using a bunch of $30 "cheapy" SATA HBA, but when I switched the exact same drives to hardware raid, the most I could get was 250 MB/s (seq) on an empty array and 160 MB/s at 85% full. Not to mention the random read I/O of 1 MB/s (yes, one MB per second -- not a typo). This is after spending a few weeks optimizing things: stripe-aligned partitions, block-aligned stripe sizes, and both controller and disk cache enabled. The latter of which I'd prefer to have turned off (even with a battery).

      I certainly wont make that mistake again. Of course, it's partly my fault for buying something without waiting for reviews (several other newegg buyers found it to be ludicrously slow as well), but I thought that after all these years it was a sure bet that *anyone* could turn out a decent hardware raid card if you give them over a grand. Apparently not. And I should have really researched the raid-5 write hole more before blowing $1200 on a supposed fix for the problem when a much better solution is to just use RAID-6 and the write intent bitmap (or ZFS).

      Of course, I'm not trying to say *all* hardware raid cards are bad. I'm sure that most of them are just fine. But I just don't see any benefit to them any more. Linux has mdadm, *BSD/Solaris have ZFS. The only reason for hardware raid is if your operating system's software raid implementation is completely braindamaged. In other words, it's for Windows.

      --
      Daniel
    19. Re:Your first server, in 2012 by guruevi · · Score: 2

      I trust my single-purpose RAID controller card a lot more than my general purpose operating system to get the write right

      You know why Sun invented ZFS right? Or many of the IBM big clusters (Blue Gene) have no hardware controllers beyond simple SAS/FC HBA's for their data stores? I wouldn't trust any particular part in a computer to get it right, all it takes is 1 flipped bit. And HW RAID is particularly bad in keeping data portable.

      A UPS is not infallible since your server's operating system is subject to other failures such as someone yanking the power cord(s), hitting the reset button on the server, or an operating system crash. A hardware RAID card is not subject to any of these failures, if the power is yanked before it writes data, it will remain in the cache to be retried when the disks are available.

      Again, problems which have been solved by most if not all current file systems (except NTFS). The problem with those hardware RAID cards of yours is also that they need batteries to keep such data in cache. If the controller dies or the batteries die or the memory dies or the connection between the disks severs during a reboot (at least 4 points of failure) the array is still corrupted. And I have seen very few internal cards that have failover memory and controllers which ZFS makes it possible to have the solid state cache in a mirrored configuration.

      Filesystem journalling is independent of RAID level, most people using a journalling filesystem on top of RAID to protect against filesystem corruption from a server crash, which has nothing to do with RAID level. Typically only the filesystem metadata is journalled, so data corruption is still possible even with journalling. (data journalling is possible, but is rare since it means writing a second copy of data.

      Again, problems which have been solved by most if not all current file systems (except NTFS). All journalling file systems I can think of the top of my head do have atomic writes (Ext4, Btrfs, ZFS). You also seem to have no idea how journaling works, data corruption should not happen in a journaled file system because the journal is updated only after the data has been successfully written. A synced write does not return until the journal is updated.

      Well actually I guess the RAID controller write cache is somewhat like a data journal

      No IT IS NOT! It's merely a crutch to speed up writes to slow disks. Just as SSD's in ZFS configurations are there to enable high speed writes and to combine many write IOPS into a single write. Journaling GUARANTEES that regardless of what happens next the data has been committed to disk. Write cache BBU does not guarantee that, it merely guarantees this given a certain set of circumstances which occur 99% of the time the data may be committed to disk.

      Another advantage of Hardware RAID is that it's typically much faster than software RAID especially with RAID-5 and 6.

      Recent benchmarking (the last 5 years especially) has shown this claim to be patently false, another reason ZFS and BtrFS were created in the first place. Besides RAID6 calculations, you can also do inline compression and deduplication much faster than the 300MHz SOC you find on most cards. I have an external RAID controller with 1.2GHz Intel SOC and 2GB BBU RAM the IOPS (4k) to that thing is somewhere under 3000 at a cool 300MBps read/write to 12 15k RPM disks, cost me $24,000 ($2000/slot). Directly attached SAS with SSD cache does well over 10,000 IOPS, 300MBps to an array with the same amount of 7200RPM disks and has 90GB of read/write cache (amount of RAM) and nearly 1TB of read cache which can read out at a blistering 50,000 IOPS, this setup costs me $12,000 with 12 SAS disks and 4 SAS SSD's but has 8 times as much storage.

      Your write only has to hit the cache on the RAID controller to be "complete", while a less-than-full-stripe wr

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
  3. No surprise. by heypete · · Score: 5, Interesting

    Why bother with branded parts made by an ODM when you can buy directly from the ODM?

    My old workplace had (has, probably) a fairly beefy Sun server with a whole bunch of disks. They used it as a RAID-based storage server for a bunch of lab data. As they do on occasion, a hard disk would crap out. The server wouldn't take ordinary disks, though: it would only accept Western Digital disks with some Sun ID code baked into the firmware -- rather than simply being able to buy a few WD RAID-friendly disks ahead of time, we had to jump through Sun's hoops to get disks replaced under warranty. This usually was a multi-week process, during the array with the failed disk was running with a hot spare -- hardly ideal. That was the last time we bought Sun systems.

    At some other point, we were planning on setting up a few more storage servers for backup data. Dell's price for a storage system, including firmware-locked drives, was about triple the cost of doing it ourselves with SuperMicro servers, MD-based software RAID, and RAID-friendly disks. We ended up buying two of the SuperMicro-based systems and putting them in different buildings for semi-offsite backup (the concern was if the server room caught fire, not if a meteor affected the whole city). The only extra step during the setup was putting the disks in their caddies: the Dell systems came with the disks pre-installed. That took about 5 minutes per server. Whoop-dee-doo.

    The Dell servers restricted our (with firmware-locked disks) options and cost substantially more than doing it in-house. We'd be stupid to go with their products, as we'd be locked to that vendor for the life of the servers.

    Sure, we had Dell Optiplex systems as the desktop workstations for researchers as they were inexpensive, reliable in the lab, and essentially identical (useful for restoring system images from one computer to another), but their server stuff is stupidly overpriced.

    The SuperMicro servers were much more "open" in that they used pretty bog-standard parts and didn't have stupid anti-features like firmware locking.

    1. Re:No surprise. by heypete · · Score: 3, Informative

      First, a RAID array does not "[run] with a hotspare." When a failure occurs, the hotspare becomes a fully integrated member of the array, at which point you would be running without a hotspare, which on a redundant array isn't that much of a problem considering the Dell replacement would be there within 4 hours of reporting/determining a hardware failure.

      It took Sun 3+ weeks to send us a replacement hard disk under warranty and required multiple phone calls. This happened on multiple occasions and was one of the main reasons we decided to stop buying Sun servers.

      Yes, the spare became an integrated member of the array. That's true. My point was that the hot spare was now a member of the array and we had no remaining spare disks in the array. Since the server hardware only allowed drives with the Sun firmware, we couldn't keep a supply of spare disks around to swap into the arrays as needed.

      Second, Dell servers do not have "firmware-locked disks." I've never heard of such a thing. It's a pretty absurd concept that you could only have OEM hard disks in your box, and an unrealistic expectation that clients would comply.

      They did: "In the case of Dell's PERC RAID controllers, we began informing customers when a non-Dell drive was detected with the introduction of PERC5 RAID controllers in early 2006. With the introduction of the PERC H700/H800 controllers, we began enabling only the use of Dell qualified drives."

      Same thing with Sun, at least at that point in time.

      Finally, hardware RAID is leaps and bounds above software RAID. There's a reason it's cheaper to go with software...

      Software RAID was perfectly adequate for our needs: as backup servers they didn't need to have the utmost performance. As a bonus, we weren't reliant on a specific make and model of hardware RAID card: we could connect the array to any system running MD. Even under heavy load the demand on the CPU was negligible.

      The Sun server was the main Samba share for the lab: lab instruments would write data to it and researchers would access that data on their desktops. It also used software RAID with multiple arrays set up. CPU usage was similarly low, even at high loads, and it worked quite satisfactorily for the lab.

      You might have saved money up front, but over the life of the server, you could potentially lose much more when you consider catastrophic hardware failure which would be fully covered under the warranty of the Dell box.

      SuperMicro offered a comparable warranty, so that wasn't really an issue.

    2. Re:No surprise. by petermgreen · · Score: 2

      Dell tried locking their raid controllers to their own drives but backed down under customer pressure.

      http://www.standalone-sysadmin.com/blog/2010/04/dell-reverses-position-on-3rd-party-drives/

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
  4. FIFTH? by Anonymous Coward · · Score: 3, Interesting

    Let me get this right. Google, who builds all of their servers in-house, exclusively for their own use (not for resale), is the fifth largest buyer of Intel server chips in the world?

    That sure paints a picture about the sheer size of Google's data center operations.

  5. Eh... I don't see this as a huge deal, really.... by King_TJ · · Score: 2

    While yes, right now, the tide may be against the server manufacturers -- the cloud still requires them in large quantities to host those services. If it negatively impacts sales, it's only to the extent that efficiency is improved. (EG. Joe Businessman who once bought a server for his office of 10 employees skips it, in favor of cloud computing solutions. But it turns out his needs are small enough so they can share the load with 1-2 other small businesses like his, all on a single server in the cloud.)

    In my opinion, Dell has the right idea -- changing the focus on who their customer is for their server products. Beyond that, what's really news here?

    Going out on a bit more of a limb though? I'm really of the opinion that cloud services are over-hyped as the "in" thing for every business. Once companies migrate heavily to cloud hosted solutions and use them for a while, a fair number will conclude it's not really beneficial. Then you'll see a return to the business model of running in-house servers again. (Granted, those servers might be smaller, with lower power consumption than in the past. Little "microservers" handle many of the basic file and print sharing work companies used to relegate to full size rack mounted systems in the past.)

    But my own experience with cloud migrations tells me that it's not so great, 9 times out of 10. For example, my boss has been using the Neat document management software for a while now to scan in all of his personal receipts and documents at home. Neat now offers "NeatCloud" so you can upload your whole database and then access your docs via an iPhone or iPad client, or even scan something new in by simply taking a picture of it. Sounds great, but in reality, he had nothing but problems with it. The initial upload tied up his PC for the better part of his weekend, only to report that some documents couldn't be converted or uploaded properly. He had close to 100 random pages of existing documents thrown in a new folder the software generated, to hold the problem ones. The only "fix" for this was to click to open a trouble ticket for EACH individual document that failed, so someone at Neat could examine it manually and correct whatever issue prevented their system from properly OCRing and uploading it. Clearly, that wasn't much of a solution! He tried, repeatedly, to get someone to remote control into his PC to do some sort of batch repair for him -- but after a couple promises to call back "the next day" to look at it, nobody ever did. Now, all Neat can tell him is they have another update patch coming out for the software in the next week, and to disable cloud uploads until that time.

    Or take the recent migration a small office did from GoDaddy pop3/smtp email with Outlook to Google hosted mail. I usually help these guys with their computer issues but they thought they could tackle this migration on their own. Turns out, they wound up with a big mess of missing sub-folders of mail in Outlook on the owner's machine. After a lot of poking around, I discovered part of the problem was due to characters in the folder names that Google Apps didn't consider valid. When it hit one of those during the mail migration, it just skipped the whole mail folder upload with an error. (Did Google's migration wizard utility even warn about this in advance or offer to help rename the problem folders before continuing? Heck no!)

    For that matter, take what you'd think is pretty basic functionality with cloud based data backup? I've run into multiple situation now where people used services like MozyPro for their backups, only to discover a full restore (when a drive crashed) was incredibly slow and kept aborting in the middle of the process, making the data restore essentially impossible. Mozy's solution? They're willing to burn a copy of the data onto optical disc and physically mail it back to you. So much for the whole cloud thing, huh?

  6. What about Netcraft? by ickleberry · · Score: 2

    Do they confirm it? Nothing's actually dieing until Netcraft says so.

    1. Re:What about Netcraft? by ickleberry · · Score: 2

      Some lad was trollin once and said "BSD is dieing, netcraft confirms it" citing the latest publication by netcraft then it kind of took on a life of its own and now nothing's dieing until Netcraft confirms it

  7. demand finally saturated by Thud457 · · Score: 2

    see, I told you that electronic data processing was a fad

    -- Spencer Tracy, "The Desk Set", 1957

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  8. Re:Eh... I don't see this as a huge deal, really.. by Todd+Knarr · · Score: 2

    It may also depend on what kind of servers companies like Google want. Dell, HP and the like produce expensive servers with high-cost maintenance contracts, which look great to conventional business-executive types. Google, OTOH, probably is taking the techie approach of generic white-box servers with no support. They're installing their own OS image on it, and it's not going to be Windows or a commercial Unix, and with all Google's custom software they probably find vendor support all but useless. Ditto hardware support, the idea is to not worry too much about failures and just replace the box, and with generic hardware replacing failed parts is probably cheaper than the support contract would've been.

    You've nailed the rest, though. When you depend on "The Cloud", you're depending on someone else to prioritize solving your problem. The problem is that the most effective solution for them is far from optimal for you, and you don't have enough leverage with them to change their priorities. At least when stuff is in-house the people responsible for it answer to you and you can, if needed, go down and rearrange their to-do list in person.

  9. Low- vs. High-level cloud services by DragonWriter · · Score: 3, Informative

    The cloud providers (which includes Google, if you ignore the fact that they only provide high-level cloud services, unlike Amazon) mostly build their own hardware.

    Google provides low-level cloud services (IaaS in the form of Google Compute Engine, PaaS in the form of Google App Engine, RDBMS-in-the-cloud in the form of Google Cloud SQL, bucket-style storage in Google Cloud Storage) as well as higher-level services (all of Google's various apps build on their cloud infrastructure.)

    So the Google-Amazon distinction drawn in the parenthetical is inaccurate.

  10. This has nothing to do with google by netwarerip · · Score: 2

    And everything to do with VMWare. No one is buying servers because they have no need to. When I can replace 400 physical boxes with a couple dozen ESX hosts why wouldn't I?

    I guess another way you can look at it is Intel has innovated themselves out of a market. Multi-core procs have enabled the virtualization boom, but they didn't charge enough for them. At least the auto industry was smart about it - new cars last twice as long as cars from 15-20 years ago, and prices have gone up accordingly.