Slashdot Mirror


Intel Confirms Decline of Server Giants

An anonymous reader writes "A Wired article discusses the relative decline of Dell, HP, and IBM in the server market over the past few years. Whereas those three companies once provided 75% of Intel's server chip revenue, those revenues are now split between the big three and five other companies as well. Google is fifth on the list. 'It's the big web players that are moving away from the HPs and the Dells, and most of these same companies offer large "cloud" services that let other businesses run their operations without purchasing servers in the first place. To be sure, as the market shifts, HP, Dell, and IBM are working to reinvent themselves. Dell, for instance, launched a new business unit dedicated to building custom gear for the big web players — Dell Data Center Services — and all these outfits are now offering their own cloud services. But the tide is against them.'"

152 comments

  1. If Google sold servers... by denis-The-menace · · Score: 5, Interesting

    If Google sold servers, HP and Dell would die overnight.

    Just the "12volt-only" power supplies with built-in batteries with "12volt-only" motherboards makes them more reliable than anything out there.

    HP and Dell either can't or won't license this from Google.

    --
    Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    1. Re:If Google sold servers... by postbigbang · · Score: 1, Flamebait

      Oh? Inside your desktop or 1U/etc server is a 12V power supply, and 5vdc, too. License? This isn't about licensing, it's about density and uniformity.

      You can put a 12v battery into your machine, too. It's allowed.

      --
      ---- Teach Peace. It's Cheaper Than War.
    2. Re:If Google sold servers... by Jake73 · · Score: 1

      License what? The ability to run from 12v power?

      I'm pretty sure my old Atari 400 and Atari 800XL both ran from DC power supplied from a brick. What's new about that? Nearly every laptop runs from DC power and has a built-in battery.

    3. Re:If Google sold servers... by denis-The-menace · · Score: 3, Informative

      In google servers, the power supply only make +12volts.

      There are no -12V, +5V or -5V rails.
      There are, instead, DC-to-DC converters on the motherboard.

      --
      Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    4. Re:If Google sold servers... by denis-The-menace · · Score: 0, Redundant

      In google servers, the power supply only make +12volts.

      There are no -12V, +5V or -5V rails.
      There are, instead, DC-to-DC converters on the motherboard.

      (too, bad I can't edit posts like on Reddit)

      --
      Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    5. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      But thats different it wasn't a server.

      Just like Apple owns grid icons ... just on a phone. Not desktop.

    6. Re:If Google sold servers... by postbigbang · · Score: 3, Insightful

      Other motherboards make use of similar dc-dc converters and have for a long time. It's nice to have a 12vdc bus; makes it more dense. But it's neither innovative or unique. Instead, it's all about density and design for a specific purpose. These aren't retail-able machines. And there are now luscious racks you can obtain with lots of dense Intel, AMD, and even ARM-powered systems. If you have the application, someone has a design.

      It might be a good design for you, and not for others.

      --
      ---- Teach Peace. It's Cheaper Than War.
    7. Re:If Google sold servers... by fm6 · · Score: 4, Interesting

      Sorry, you're wrong. Wish you were right.

      I've always been appalled by the way PCs rely on big, hot, wasteful noisy internal power supplies. When IBM entered the workstation market, 30 years ago (Oh, Lord, that makes me feel old) I worked for a company that made a pre-PC x86 system that relied entirely on external, passively cooled power supplies. To me, this was clearly the way of the future, but once IBM entered the market, everything had to be IBM compatible, even the way the power system worked. Because if you couldn't use IBM-compatible power supplies, your system cost too much to build. (I once had to throw out a perfectly good Zenith PC with a blown PS; although it was mostly IBM-compatible, its power supply was proprietary, and cost too much to replace.)

      So, Google can't go into the hardware business, because their machines would cost too much and would rely too much on proprietary infrastructure. Easier to justify using your own technology regardless of cost when you're gigantic and profitable.

      HP and Dell's nightmare isn't Google. It's cloud computing in general. The cloud providers (which includes Google, if you ignore the fact that they only provide high-level cloud services, unlike Amazon) mostly build their own hardware. Those that don't buy cheap no-name hardware.

    8. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      the location, inside the box, of the 12V-to-5V DC-DC converter hardly seems interesting...

    9. Re:If Google sold servers... by afidel · · Score: 3, Interesting

      Not in the least bit, Google designs their servers to optimize power usage and absolute lowest cost per compute cycle. Those are not the same goals for every server buyer. For instance single threaded performance is a large factor for me because we run a lot of interactive workloads that are single threaded or weakly threaded but Google doesn't really care about single threaded performance because they're optimizing at the datacenter level. I also care a lot more about the reliability of any given unit because my jobs are mostly traditional single-server jobs with only my most critical workloads being clustered so the loss of any given node has a significant impact on my overall reliability whereas Google can lose dozens of servers a day per datacenter and it would have no impact on their overall operations. Another example is storage, Google uses COTS SATA drives with horrible MTBF stats and they do so without RAID protection, the only application where that might remotely have a chance of working for me is Exchange 2010 because I have four copies of each database online and the client is seamlessly pointed to a working copy.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    10. Re:If Google sold servers... by gagol · · Score: 1

      Google's server architecture is custom made for their datacenters and built around their application. What they could offer is a turn-key datacenter thet requires a similar workload to theirs... and it is not their business to do so.

      --
      Tomorrow is another day...
    11. Re:If Google sold servers... by labradore · · Score: 3, Interesting

      What's the point?
      1. you use less parts and cheaper parts in the power supply.
      2. you have fewer and shorter cables
      3. you use 5V, 3.3V, regulators that are the right size for the job. this saves space and saves material
      4. you get to choose where to put these regulators so that heat management can be more optimal
      5. it's easier to integrate the 12v battery with the space saved

    12. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      On the flip side, regulatory compliance is a major issue. For safety and (RF) emissions compliance reasons in particular, Google servers (and Amazon's, FB's, etc...) can't be sold as-is in most of the major markets.

      It wouldn't be a huge leap for Google (or Amazon) to get that compliance though and I would certainly be placing my orders if they did!

    13. Re:If Google sold servers... by evilviper · · Score: 2

      If Google sold servers, HP and Dell would die overnight.

      No. You're wrong on so many levels, it's hard to believable.

      Google's solution is cheap, UNRELIABLE servers. I liked the idea of a built-in battery for about 5 seconds, until I realized that the PSU isn't going to have any way to do a weekly self-test of the battery, or allow hot-swapping it... the features that separate decent UPSes from low-end consumer crap. I liked the idea of motherboards stripped of unnecessary components, until I saw it only had a single Ethernet port (can't even do bonded/trunked NICs). I liked the all-14V power supply, until I noticed there's only a single PSU, no hot-swap.

      If any of the above sounds like a good idea to you, you're not a Dell/HP/IBM customer. Even though my company does extensive clustering and has plenty of redundancy, we're not Google-scale, where it would be perfectly okay if a bunch of servers just crap out one night... If you've got your own compute-farms, fair enough, but my experience says there are fleetingly few companies who can make economic use of cheap junk servers, and many who want to try it are instead making a decision of false-economy that will come back to bite them.

      Just the "12volt-only" power supplies with built-in batteries with "12volt-only" motherboards makes them more reliable than anything out there.

      Have you ever touched a rack of servers before? Two big UPSes at the bottom of the rack, connected to two PDUs, connected, alternately, to each of the two hot-swap power supplies in each server. It's a pretty standard configuration, which is EXTREMELY reliable (unless the UPSes are complete crap, and they both run their self-tests at the same time--I'm looking at you APC!).

      This configuration is infinitely more reliable than Google servers. Google's form of redundancy is switching to an entirely different DATACENTER at a moment's notice... The batteries are only there to smooth out minor power fluxuations, and soften the fall, so ALL the servers in a datacenter don't drop at the exact same moment in time.

      HP and Dell either can't or won't license this from Google.

      Probably BOTH. Like I said, the reliability just isn't there. If you don't care, you're probably a SuperMicro customer, rather than a Dell/HP/IBM customer.

      But if your workload does fit with the Google server model, you can actually go one step-up, and get Facebook servers solutions, thanks to the Open Compute project they put together.

          http://opencompute.org/

      The big difference being that, instead of an internal battery, Facebook has a rack of batteries for every two racks of servers, which connect to the DC-input of the PSUs. This is clearly more reliable than the Google model, because the centralized batteries allow you to routinely test, before they're needed, and swap dead batteries without taking any servers down. And since the smarts are in the (inexpensive) PSUs, you don't need special 12v-only motherboard designs at all.

      You can see it all in-action in a number of Youtube videos, such as this one:

      http://www.youtube.com/watch?v=JZUX3n2yAzY

         

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    14. Re:If Google sold servers... by evilviper · · Score: 2

      I've always been appalled by the way PCs rely on big, hot, wasteful noisy internal power supplies.

      I don't follow your complaint. I'm sure you don't have a MORE EFFICIENT, SMALLER and QUIETER, PASSIVE, EXTERNAL power supply. Obviously, you threw in at least one trait that isn't possible in combination with the rest. In particular, it's incredible just how much air and heat a tiny little 12v fan can move, even the almost completely silent ones (see: SWiF2-1200 or 800).

      And while I've long lamented the inefficiency of PC PSUs, that stopped being the case over a decade ago. A nice 80+ PSU isn't a lot more expensive than the cheapest crap PSUs out there, these days, and Seasonic's are extremely quiet, and extremely reliable. Servers are even getting 90+ and 95+% efficience PSUs these days, which is about the best you could possibly hope for.

      I'm quite happy to have internal PSUs... The cables dangling everywhere are enough of a mess, an power bricks ala laptops would be a nightmare. Hell, on a low-enough power system, you can even remote the fans all-together. I've got one system like that, drawing about 5W, which I use as a firewall/NAT/router. But with nice quiet fans available, I no longer believe it's worth the effort to drastically compromise performance (CPU speed), to shave that last 7db off the noise floor.

      And standarized PSUs have been a real boon for lab electronics and other projects. It's amazing how many amps you can draw at 12 and 5v from a little $10 commoditized box. It certainly works well for RVs.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    15. Re:If Google sold servers... by fm6 · · Score: 2

      Internal power supplies that don't make a lot of noise are becoming increasingly common now. But for most of the PC's 30-year history, PC PSUs have been noisy power hogs. It was only when people started worrying about energy waste that anything was done about it.

      I'm probably guilty of overstating the potential of passively-cooled PSUs. I just noticed that they seemed to work well on some pre-PC systems I worked with (you dislike cables, but I dislike noise, and everybody dislikes wasting energy) They only disappeared because an extreme level of IBM PC compatibility become essential to anybody hoping to manufacture systems at a reasonable cost. But I don't have the hardware engineering skills to defend their wide applicability, and indeed I notice that Google's special low-energy PSUs are internal and fan-cooled.

      But Google PSUs are also very different from PSUs in standard rack-mount systems, with unusual form factors and lack of support for lower voltages. This suggests that they are one of many custom components that would make Google's servers uncompetitive in the open marketplace. And that's really the only point I was trying to make.

    16. Re:If Google sold servers... by hairyfeet · · Score: 1

      That's great...for a server or specialized workstation. For your bog standard PC tower you are talking 3 to 5 slots which can be pretty much anything and could need anything from practically no power to assloads of power. You can have onboard or discrete sound, hell you can put in 3 graphics card with each being fed a ton of power, there is simply too many different things to have it all fed by a passively cooled power brick.

      Personally I LIKE the current design, because that means I can quite easily design the system with the correct PSU for that system. My GF, who only has an Athlon X3 with an HD5450 and a single hard drive and DVD burner? A 450w with 85% efficiency is just perfect for that system whereas mine with 3 HDDs, the possibility to go crossfire, power hungry GPU and 6 core CPU and dual burners? A 750w is a better fit and gives me more headroom to add more later.

      And best of all it doesn't cost an insane amount of money and is even possible because it isn't a bunch of proprietary crap like we had back in those days. I don't know how many machines I had to shitcan when all they need was some minor upgrade because either the proprietary PSU in a more powerful form cost more than the system or it didn't exist at all.

      So maybe if you could make it bog standard so anybody could replace that brick with any other brick? It would probably be fine but sadly as we've seen time and time again what we end up with is more lock in and proprietary crap. hell I'd argue that is why so many damned laptops end up straight in the dump, everything about laptops are so proprietary if its anything other than just needing RAM or a HDD then its just not worth fixing.

      --
      ACs don't waste your time replying, your posts are never seen by me.
    17. Re:If Google sold servers... by inKubus · · Score: 1

      Cloud computing is a fad. The reason why is BGP. BGP means that there's nothing but statistical luck that your connection to your data will go through. The biggest companies in the world (and the largest purchasers of IT equipment) will not ever use it. It will always be relegated to the consumer and the small business, who don't have much to lose if they can't access the data.

      At some point, some genius will invent a new internet protocol that will enable the data to be stored local to the owner but can also be securely and easily shared with everyone. And it won't depend on border routing arrangements but instead will be a true autonomous mesh. At that point, the 2010-2012 "cloud" (e.g. outsourced managed software/storage/hardware? as a service) will become the 2016 "cloud" of distributed services and storage. It's just right now there's a flood of computer illiterate who "grew up" on Facebook and the web and don't know any other way. The idea of having to deal with files and names and stuff is just too hard. And god forbid having to teach your devices to talk to each other rather than one parent in the sky. Pft. Get off my lawn.

      --
      Cool! Amazing Toys.
    18. Re:If Google sold servers... by fm6 · · Score: 1

      Your statement about BGP makes no sense to me. How does BGP interfere with cloud-type connections and not others?

      You seem to be claiming that that cloud computing is simply impossible. And yet Google, Facebook, Amazon, Salesforce, and Microsoft all operate huge data centers that run only cloud technology. Not only are big companies using it, but they're selling their excess cloud capacity. That's how the two biggest cloud services got started: Amazon and Salesforce developed cloud technology because they needed it to serve millions of customers at a time, and realized they'd created a service they could sell.

      One is reminded of that story about the guy who proved that bumblebees can't fly.

    19. Re:If Google sold servers... by Anonymous Coward · · Score: 1

      Wait for Apple to use 12v in the next iPhone and even cars will have to find a new voltage of choice.

    20. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      in 1976 I was part of a team making a 50 volt 500 Amp PSU with 97% efficiency, so today 95+ is easy technically, there just has to be the will to make it, and stop supplying so many rails out to the motherboard.

    21. Re:If Google sold servers... by drsmithy · · Score: 3, Insightful

      Your statement about BGP makes no sense to me. How does BGP interfere with cloud-type connections and not others?

      He is rehashing - in a rather rather pained and circuitous fashion - the "if you lose your internet connectivity you can't do any work" argument.

      This point is not entirely without merit, but generally fails to recognise that a) most companies these days can't do a lot of work without an internet connection anyway and b) internet connectivity is usually a lot easier and cheaper to make highly available and redundant that server infrastructure.

    22. Re:If Google sold servers... by Ed+Avis · · Score: 1

      12 volt power bricks are produced in China in enormous numbers. Provided you use a power-efficient CPU like ARM or Intel's forthcoming Haswell chips, there is no cost issue with powering your server from an external PSU or perhaps two of them. Sure, if you want to build a 2006-era PC with a gas-guzzling CPU and massive heatsink, spinning disks and internal fans, it would be expensive to get an external power supply capable of supplying enough current. But today's components such as SSDs are a lot more frugal, provided you're not a 'gamer' who requires the fastest-clocked CPU and GPU possible, and we can expect this trend to continue for a few years at least.

      --
      -- Ed Avis ed@membled.com
    23. Re:If Google sold servers... by laptop006 · · Score: 1

      "bonded/trunked NICs"

      Why does that matter? The only justification for bonding with 10g these days is "redundancy" and I've seen many more outages (at a variety of sites) from people failing at bonding than I have from switch failure.

      If a machine is that critical the service it runs shouldn't live on a single machine.

      Even at my last job where we had a design based on multiple SPOFs we lost machines to PSU or drive/RAID failure several times, but never network, except for the one site that did "redundant" NICs.

      --
      /* FUCK - The F-word is here so that you can grep for it */
    24. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      This is correct. My current Atari 800 still does.

    25. Re:If Google sold servers... by evilviper · · Score: 1

      Even at my last job where we had a design based on multiple SPOFs we lost machines to PSU or drive/RAID failure several times, but never network, except for the one site that did "redundant" NICs.

      I've never seen anyone "failing at bonding", and any such misconfiguration would be picked-up by the monitoring system before a given server went live, so your trained-monkeys appear to be highly defective, and you clearly need to get them traded-in for better ones.

      At my last job, where we were a nicely clustered environment, I've seen a signficant number of switches either failing suddenly, or at least rebooting for no apparent reason (dual power sullpies, btw). In addition to that, I've seen a small number of network cables suddenly go out, and just as many cases of 1 of the 2 ethernet ports on the mobo just dying.

      You can yell "cluster" all you want, but it won't magically make any of this a non-issue. Redundancy gets you a small grace period to deal with a problem, not an open-ended opportunity to let everything fall apart. Hey, the most recent switch failure was one of the two switches serving up data between the Oracle RAC containing all our live customer data. Having a second, working network path saved us from being forced to operate with all our eggs in a single basket, on your nice cheap servers with questionable UPSes and the like, until someone could fly out to the datacenter with a new switch.

      Like I said, if you've got Google's level of clustering, where you can fail-over to a redundant DATACENTER, or if you're just doing simple batch compute jobs, then cheap servers are for you. If you're any smaller, and uptime really matters, then several machines disappearing over a busy weekend is going to cause you some problems. Even nicely distributed file systems typically only handle 2 nodes going down without data loss, and changing it to get more redundancy will quickly eat into the money you thought you saved by going cheap.

      With an attitude like yours, it's pretty clear you've never run anything that really was mission critical. Me and my millions of customers expecting 99.999% uptime, would like to kindly ask you to stay far, far away from our servers and networking.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    26. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      You're correct, Google does this. But everyone else does this too, and has been doing it for a long time.
      One other correction: The PSU also has to create some standby voltage for when in S5. Not all 12V rails can be standby (too large). So these uber-reliable PSUs have at least 2 voltage rails.

    27. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      Nice to know, but my PSU uses DC-to-DC conversion the non-12v rails. I guess the benefit of the converters on the motherboard is you can in-line the battery between the PSU and motherboard.

    28. Re:If Google sold servers... by fm6 · · Score: 1

      He's not talking about flaky ISPs or NAPs. He's talking about a routing protocol that he says prevents clouds from working. At all. Further explanation required.

    29. Re:If Google sold servers... by Anonymous Coward · · Score: 0

      Horrible mtbf? Their stats fairly conclusively determine there is no real mtbf difference between desktop Sata and enterprise sas. The crucial difference is heat

    30. Re:If Google sold servers... by afidel · · Score: 1

      Uh, Google showed an AFR of over 10% for the SATA disks in their study with a high duty cycle, that's compared to 1.5-2% for enterprise drives that typically run flat out for their entire life. Also the Google study made no conclusions wrt sas vs sata, however the numbers MS released showed "enterprise" SATA with a 5% AFR and MDL SAS with a 2.75% AFR. SATA drives also have a much worse BER than enterprise drives.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
  2. Your first server, in 2012 by Compaqt · · Score: 3, Informative

    Back in the day (say, 2008 as in the article), if you wanted to buy a server, you'd buy one from the big three.

    These days, especially with FB and Google leading the way on commodity hardware, it's a different story.

    So what should you get for your first server. I.e., you're a small company. You've got a couple of laptops. You're outgrowing mutual Samba.

    You maybe want a fileserver. Maybe it'll have a few NICs and a virtual machine on it (Xen?) will do double duty as a external webserver.

    So, Core i3, i5, Xeon? Number of processor cores? Forget fast drives, and just buy a lot of memory? Rack? Or tower?

    Lockable front (so people can't just come by and reset it)? Hotplug harddrives? (You don't go this if you go the Google build-your-own route.) Redundant hard drives and ECC memory? Or a couple different commodity-style servers + sharding/rsync?

    Is a big 3 server worth it? Or search for your own server case + server power supply, etc.?

    --
    I'm not a lawyer, but I play one on the Internet. Blog
    1. Re:Your first server, in 2012 by Anonymous Coward · · Score: 3, Informative

      Search for your own. Priced one from hp/dell and it would have cost $6,000 plus. Built it with the same specs for $3000. That right there is why their server sales are dwindling.

    2. Re:Your first server, in 2012 by toejam13 · · Score: 1

      The problem is that you have to support all of that equipment you just threw together all piecemeal-like. Do you have spare parts available? If no, how much does it cost to have them shipped overnight? Are they still available via retail channels or do you have to dredge through eBay? How much does it cost to purchase and store spare inventory? Do you have the equipment to test for failed components without the possibility of frying other equipment?

      Those "Big Three" server companies charge more because of service and support so you don't have to worry as much about those things. RMA and forget. And yeah, I'm saying that with a straight face.

      There are times where a company is small enough to where your tech has enough idle time to deal with a white box server. Other times, your techs are better utilized doing other work.

    3. Re:Your first server, in 2012 by gravyface · · Score: 1

      ...looks alot like the one from 2008. Big three = hardware warranty and support: drive dies, Dell guy's there in less than 4 hours. That covers the entire lifecycle of the server (3-5 years) while it's in production and playing a mission critical role. Virtualization/consolidation/cloud are whittling away at the server market, but it's never going to go away. Right now I'm dealing with an EC2 instance that won't start and I can't detach the volume to try to snapshot it or mount it to another new instance... yeah, yeah, "b-b-but you don't have an Elastic Load Balanced, Cloud Reach-around setup?". Well, this isn't a mission critical server and nightly backups are good enough, but it's still annoying to me and the end-users. And at ~$100 a month (reserved medium Windows EBS instance), I could've leased a new low-end PowerEdge over 3 years...

      --
      body massage!
    4. Re:Your first server, in 2012 by denis-The-menace · · Score: 1

      Maybe something like a QNAP?

      --
      Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    5. Re:Your first server, in 2012 by ard · · Score: 3, Insightful

      With the same specs? With hot-plug drives, true hardware raid, iLO/iDRAC lights-out management, secondary bios if flashing fails?

      Get a refurbished HP gen 5 or 6 server instead of building your own. Perfomance will be sufficient, don't worry. It's well below $3000, and you get enterprise quality hardware.

    6. Re:Your first server, in 2012 by MightyMartian · · Score: 4, Insightful

      As much as anything, I think virtualization is murdering the market. I bought a $3000 server that hosts six VM guests; two Windows installs (one a DC, one an Exchange server) and four Linux. A couple of years ago, I would have needed at least three servers to do it (one for each Windows install) and one Linux. Admittedly they wouldn't have to have the balls that the new server has, but still, I think we'd be talking about $4000 to $6000 in hardware. Even worse, these are all just basically images sitting on hard drives, so they can essentially be perpetual. Two or three years, when the current server dies or I decide I need more juice, just move the VM images over and away I go, and with hardware prices the way they are, I doubt the next generation server will cost any more than the one I have now, and maybe even less.

      Factor in the cloud, VPS hosting and so on, the demand for servers will inevitably drop.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    7. Re:Your first server, in 2012 by h4rr4r · · Score: 2

      Buy from the Big Three but get it refurb.
      You can get them with the original 3 year 4 hour warranty still in place. Extend it if you need that, or better yet buy another one and there is your spare parts.

    8. Re:Your first server, in 2012 by Anonymous Coward · · Score: 1

      Back in the day (say, 2008 as in the article), if you wanted to buy a server, you'd buy one from the big three.

      These days, especially with FB and Google leading the way on commodity hardware, it's a different story.

      So what should you get for your first server. I.e., you're a small company. You've got a couple of laptops. You're outgrowing mutual Samba.

      You maybe want a fileserver. Maybe it'll have a few NICs and a virtual machine on it (Xen?) will do double duty as a external webserver.

      So, Core i3, i5, Xeon? Number of processor cores? Forget fast drives, and just buy a lot of memory? Rack? Or tower?

      Lockable front (so people can't just come by and reset it)? Hotplug harddrives? (You don't go this if you go the Google build-your-own route.) Redundant hard drives and ECC memory? Or a couple different commodity-style servers + sharding/rsync?

      Is a big 3 server worth it? Or search for your own server case + server power supply, etc.?

      If you're asking these kinds of questions to try and piecemeal your company's file server together from spare parts, clearly you've never had to deal with an outage with a 4-hour SLA window...

      One does not pay the premium for hardware from the Big Three because it's a bargain. One pays for the support engine behind it (and even if it sucks or fails, "Big Three" translates to "CYA" when the SHTF...)

    9. Re:Your first server, in 2012 by WhiteDragon · · Score: 1

      The problem is that you have to support all of that equipment you just threw together all piecemeal-like. Do you have spare parts available? If no, how much does it cost to have them shipped overnight? Are they still available via retail channels or do you have to dredge through eBay? How much does it cost to purchase and store spare inventory? Do you have the equipment to test for failed components without the possibility of frying other equipment?

      Those "Big Three" server companies charge more because of service and support so you don't have to worry as much about those things. RMA and forget. And yeah, I'm saying that with a straight face.

      There are times where a company is small enough to where your tech has enough idle time to deal with a white box server. Other times, your techs are better utilized doing other work.

      The Big 3 have the same problems. I've seen lots of IBM servers have failed RAID controller batteries, which IBM won't replace under warranty because they're "consumable", and won't replace for a fee because they aren't available anymore. On the other hand, installing a third-party part voids the warranty anyway.

      --
      Did you mount a military-grade, variable-focus MASER on an unlicensed artificial intelligence?
    10. Re:Your first server, in 2012 by whoever57 · · Score: 2

      With the same specs? With hot-plug drives, true hardware raid, iLO/iDRAC lights-out management, secondary bios if flashing fails?

      Use software RAID and buy from SuperMicro. Yes, $3k will get you a reliable server (perhaps with dual power supplies also).

      --
      The real "Libtards" are the Libertarians!
    11. Re:Your first server, in 2012 by heypete · · Score: 2

      I'm only really familiar with SuperMicro products, but they offer a pretty standard warranty for their servers. Since they use pretty standard components, rather than vendor-specific stuff or firmware-locked drives (see my other post), spare parts are pretty easy to come by. They had all the standard features like IPMI ("Lights Out"), redundant power supplies, etc.

      RMAing broken hard disks to Sun was an exercise in frustration and delays. It literally took weeks to get a hard disk replaced under warranty.

      Dell premium support (whatever they call it) for their Optiplex systems was great, but we didn't use Dell servers because they were too expensive. Only downside: their desktops used some Dell-specific variant on the ATX power supply plugs: if we had issues on an out-of-warranty system we'd have to buy a new power supply at an inflated price. It made testing potentially-broken systems considerably difficult.

    12. Re:Your first server, in 2012 by hawguy · · Score: 2

      Search for your own. Priced one from hp/dell and it would have cost $6,000 plus. Built it with the same specs for $3000. That right there is why their server sales are dwindling.

      The difference is not always so dramatic.

      My local whitebox builder can put together hardware equivalent to a Dell R720: dual E-2620 CPU's, 32GB RAM, dual 1TB disks with onboard RAID (i.e. fake RAID) for $2800 with one year carry-in warranty. Dell charges $3566 for the the equivalent server but includes a 3 year next business day on-site warranty.

      So the dell costs $766 more, or think of it as $20/month for on-site service.

      If you're a large shop (or a very small shop) and don't mind taking care of motherboard swaps, etc yourself, then paying extra for Dell's support probably isn't worth if, but if you're a small shop with a dozen servers, you may not want to dedicate one of your (few) sysadmin's to a day of unracking the server and driving it across town for support, or procuring a replacement motherboard (if it's still available in 2 years) and swapping it out himself.

      And when I buy the Dell, I'm less worried about build problems, like leaving a tangle of power cords dangling in front of the cooling fan (which I've seen happen on whitebox builds).

    13. Re:Your first server, in 2012 by funwithBSD · · Score: 2

      Well, sure, you can do all that with Newegg available parts.

      Would I?

      Depends. If I can scale horizontally, sure. Downsize the spec and built 4 or 5 in case one fails and I wait days for a replacement part.

        If I have a vertical architecture, then I want a box I can get someone onsite in 4hrs or less.

      And that ain't Newegg, that is an Dell or HP sized company.

      --
      Never answer an anonymous letter. - Yogi Berra
    14. Re:Your first server, in 2012 by MightyMartian · · Score: 1

      I'm having a hard time putting "software RAID" and "reliable" in the same sentence.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    15. Re:Your first server, in 2012 by drsmithy · · Score: 3, Insightful

      Is a big 3 server worth it?

      Almost certainly. The problem is most techies - especially young ones - only look at a handful of specifications (CPU, RAM, # disks) and the sticker price, because they think their time is free.

    16. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      This 'shipped overnight', '2-hour response', ... is unprofessional.

      Our servers deliver a service. A 2 hour service outage is way too much. Each server has a hot standby. To keep it affordable we keep the servers relatively cheap by scalable software design.

      If things break I buy an upgrade in speed. I make sure that I don't rely on old hardware.

    17. Re:Your first server, in 2012 by drsmithy · · Score: 1

      I've seen lots of IBM servers have failed RAID controller batteries, which IBM won't replace under warranty because they're "consumable", and won't replace for a fee because they aren't available anymore.

      You'd have to be talking about a machine at least 5 years old.

    18. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      I know. It is crazy! No hardware RAID is running any sort of software on it, right?? That would be batshit crazy!! It is all baked into the fabric of spacetime.

      Software RAID can't have battery backup. No sirreee! Those UPS things are not for commodity hardware anyway, only for big iron.

      And journaling file system?? That only exists on the hardware from the big 3! Software RAID 1 implodes into a tiny blackhole everytime you run your rsync. Everyone knows that!

    19. Re:Your first server, in 2012 by h4rr4r · · Score: 4, Interesting

      Linux software raid is great.
      Proprietary software raid is garbage.

      I base this on what I have seen. Linux software raid beats cheapy hardware controllers both in reliability and speed.

    20. Re:Your first server, in 2012 by hjf · · Score: 1

      I don't know what you got. I got an IBM x3200 M3, quad-core Xeon, IMM (integrated management module), SAS controller, hot-plug bays, 2 gigabit NICs and 2GB RAM for $1000.

      If I had gone the route of IBM hard drives and RAM it would have doubled the price, but I just got Kingston ECC memory ($60 for 8GB) and some SATA HDDs (I don't need SAS).

      The killer feature for me? the IMM is connected to the serial port. So I can SSH into the IMM and get a Linux console (and also, get to the BIOS -UEFI actually- over Ethernet).

    21. Re:Your first server, in 2012 by h4rr4r · · Score: 1

      How many layers deep does that go?
      Sure you can flop over to a hot spare, but getting parts in 4 hours or NBD is still valuable compared to ordering them and waiting 3 days. Lots can happen in those 3 days.

    22. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      if you can't design (afford?) a hardware raid card... chances are your UPS is gerbil powered.

    23. Re:Your first server, in 2012 by MightyMartian · · Score: 1

      To some extent virtualization has done away with even this. Frankly, I doubt I will ever run a server that isn't a guest, unless I'm looking at something like a dedicated backup server (which I have right now) or some very high capacity database server (for my business's needs, I can't see that happening any time in the near future). So for most of my needs, I'd be buying something good RAID, fast drives, lots of RAM and CPU that I can install VMWare or Debian with KVM or Xen support on (running KVM right now). The guests won't know the difference between Dell, HP or something I put together on my own, In the medium term, I'm looking at two NASs, one primary, one failover, and the virtualization server can do it that way.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    24. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      for your porn collection sure... enterprise apps... not so much

    25. Re:Your first server, in 2012 by snowraver1 · · Score: 1

      Software RAID has it's advantages. If you have your controller card blow up, you don't need to procure an identical card. It does have other drawbacks though.

      --
      Copyright 2010. All rights reserved. This comment may not be copied in any way including, but not limited to caching.
    26. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      RMAing broken hard disks to Sun was an exercise in frustration and delays. It literally took weeks to get a hard disk replaced under warranty.

      You think that was bad? Try RMAing a broken tape drive to Sun.

    27. Re:Your first server, in 2012 by hawguy · · Score: 1

      I know. It is crazy! No hardware RAID is running any sort of software on it, right?? That would be batshit crazy!! It is all baked into the fabric of spacetime.

      I trust my single-purpose RAID controller card a lot more than my general purpose operating system to get the write right.

      Software RAID can't have battery backup. No sirreee! Those UPS things are not for commodity hardware anyway, only for big iron.

      A UPS is not infallible since your server's operating system is subject to other failures such as someone yanking the power cord(s), hitting the reset button on the server, or an operating system crash. A hardware RAID card is not subject to any of these failures, if the power is yanked before it writes data, it will remain in the cache to be retried when the disks are available.

      And journaling file system?? That only exists on the hardware from the big 3! Software RAID 1 implodes into a tiny blackhole everytime you run your rsync. Everyone knows that!

      Filesystem journalling is independent of RAID level, most people using a journalling filesystem on top of RAID to protect against filesystem corruption from a server crash, which has nothing to do with RAID level. Typically only the filesystem metadata is journalled, so data corruption is still possible even with journalling. (data journalling is possible, but is rare since it means writing a second copy of data. Well actually I guess the RAID controller write cache is somewhat like a data journal)

      Another advantage of Hardware RAID is that it's typically much faster than software RAID especially with RAID-5 and 6. Your write only has to hit the cache on the RAID controller to be "complete", while a less-than-full-stripe write with RAID-5 means reading the stripe, calculating parity then rewriting the entire stripe, so each write is really 3 I/O's and the I/O's all have to complete before you can declare the write complete. (I'm assuming NVRAM or battery backed cache RAM, if you use a RAID controller without it then you get what you deserve)

      Software RAID has its place, but a hardware RAID controller (a real one, not fake-RAID) adds so little to a typical enterprise server's price that it's generally worth using.

    28. Re:Your first server, in 2012 by blind+biker · · Score: 1

      What VM do you use? I am quite ignorant when it comes to virtualization, I left IT (I am now back into academia) before virtualization became big.

      --
      "The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
    29. Re:Your first server, in 2012 by Anonymous Coward · · Score: 1

      You have to know what you are doing for *any* RAID solution to improve reliability. But, on a low budget Linux server, software RAID is as good as any other choice, assuming you are still spending the same on disks, chassis, and power supply (the most common failure points). Many people have tried to use too cheap of a RAID card and discovered how unreliable those are compared to a basic multi-port controller or mainboard-integrated ports. Those cheap 'hardware RAID' cards are really software RAID too, but with a terrible software stack instead of the standard stuff in a proper server OS.

      Linux software RAID is also easier to monitor and manage with zero downtime while doing things like activating a spare drive, swapping out a failed one, or reshaping an array. With low end hardware RAID, you have to use even more arcane CLI tools specific to the RAID card, rather than standard tools like 'mdadm', or sometimes go back to the pre-boot environment and wait for these long operations to complete before you can boot your server again. The BSD or Solaris variants with ZFS have similar characteristics to Linux software RAID, as far as easy online management of disks and recovery.

      However, a pretty decent RAID controller is only around $500-800 depending on cache size and number of SATA or SAS ports. So if you are already springing for a SuperMicro chassis with lots of hot-swap drive bays and a SAS/SATA backplane, you might consider a RAID card instead of a "just a bunch of disks" controller card. It will perform better than software RAID for many I/O heavy server loads, particularly with a proper battery-backed write-back cache. Make sure it is one with a driver module in your intended OS kernel. Steer well clear of anything that requires a third-party driver to be installed!

    30. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      You can get a Dell Poweredge for 500-1000 dollars that is pretty nice for a small business with an enterprise support contract. Perfect for a lot of vertical market accounting apps.

      Used to sell these when I worked for an accounting software company (for glass shops). It doubled as a file server, database server, print server, vpn host etc.

    31. Re:Your first server, in 2012 by Type44Q · · Score: 2

      Back in the day (say, 2008 as in the article), if you wanted to buy a server, you'd buy one from the big three.

      If you wanted a piece of shit (and let's be fair; there are plenty of times that a piece of shit is exactly what a situation requires), then yes; a server from the big three was the way to go. If, however, you wanted something "better" than that (the quotes are due to the admittedly subjective use of the word), you ordered a Supermicro or Intel serverboard, server case, high quality power supplies, etc, etc... and you never looked back (not if you belonged anywhere near a server, anyway!).

      The servers from the Big Three were truly low-quality dogshit compared to what just about any reasonably competent and knowledgeable systems engineer could slap together in a couple hours using quality off-the-shelf parts costing a fraction as much.

      I heard all the arguments against this back then (usually from extremely incompetent PHB's); those arguments failed to hold much water then and they hold even less now, looking back on it.

    32. Re:Your first server, in 2012 by Todd+Knarr · · Score: 2

      Or we think that our time costs, but it costs less than business downtime does. If you depend on the vendor and their support contract, you're impacted for however long it takes them to come out. They won't typically let you keep spares, so when a part breaks that box is impaired or off-line for whatever your contract response time it and there's nothing you can do about it. But if it's a white-box server that can be worked on in-house, you can typically keep spares on the shelf. It may cost more in admin/tech time than the support contract would, but you get the choice of paying the time and getting the box back on-line in an hour instead of anywhere from 4 hours to next-day. And you get the option of saying "Not worth messing around with. Grab a new box, spin it up and we'll figure out what's broken with this one after we're back on-line.". We techies don't think our time is free, we just don't make the common management mistake of thinking that down-time waiting for a vendor response is free. And usually our time costs a lot less than the down-time would.

    33. Re:Your first server, in 2012 by DragonWriter · · Score: 1

      One does not pay the premium for hardware from the Big Three because it's a bargain.

      Of course you do, if its a rational decision. You buy it because the expected combined cost of the hardware + support + cost of expected downtime and other losses despite the support is lower than with the available alternatives. Its bargain hunting, just with a wider scope of costs included in the analysis than just the sticker price of the hardware.

    34. Re:Your first server, in 2012 by SuperQ · · Score: 2

      I run a co-op VM cluster on Ganeti. We bought 3 supermicro 1U single-socket machines (12-core AMD, 64G of ram) for about $7,000. We have about 60% of our capacity rented out. The nice part is we allocate based on 1G of ram slices so you get a pretty powerful minimum server.

    35. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      It does beat 'cheap' hardware controllers, but not the enterprise $700-$1500 ones.

    36. Re:Your first server, in 2012 by drsmithy · · Score: 1

      Or we think that our time costs, but it costs less than business downtime does. If you depend on the vendor and their support contract, you're impacted for however long it takes them to come out. They won't typically let you keep spares, so when a part breaks that box is impaired or off-line for whatever your contract response time it and there's nothing you can do about it. But if it's a white-box server that can be worked on in-house, you can typically keep spares on the shelf. It may cost more in admin/tech time than the support contract would, but you get the choice of paying the time and getting the box back on-line in an hour instead of anywhere from 4 hours to next-day.

      If your system is that important, then approaching the problem by keeping spare parts on-site is Doing It Wrong. You need proper redundancy.

      On top of that, what vendors won't let you buy spare parts ?

      And you get the option of saying "Not worth messing around with. Grab a new box, spin it up and we'll figure out what's broken with this one after we're back on-line.".

      So exactly the same as name-brand hardware then.

      We techies don't think our time is free, we just don't make the common management mistake of thinking that down-time waiting for a vendor response is free.

      This is what's called a non-sequitur.

    37. Re:Your first server, in 2012 by whoever57 · · Score: 2

      I have seen really terrible performance on real hardware RAID cards using enterprise-class hard drives. And, yes, I am 100% certain that it was not a fakeRAID controller card.

      Hardware RIAD in not a magic bullet for performance and they come with a nuymber of disadvantages (your RAID controller dies: good luck getting the data off the disks).

      --
      The real "Libtards" are the Libertarians!
    38. Re:Your first server, in 2012 by afidel · · Score: 2

      your RAID controller dies: good luck getting the data off the disks
      This is such BS! The RAID controllers from the big three have placed redundant copies of the metadata on the drives for at least a decade. All you need to recover the array in the event of a card failure is to place them into another server with the same generation controller or replace the failed controller. Heck when HP designed their own hardware you could even move an array out of a Proliant and place it in an MSA array and the array would read the metadata and recognize the RAID configuration.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    39. Re:Your first server, in 2012 by hawguy · · Score: 1

      I have seen really terrible performance on real hardware RAID cards using enterprise-class hard drives. And, yes, I am 100% certain that it was not a fakeRAID controller card.

      Hardware RIAD in not a magic bullet for performance and they come with a nuymber of disadvantages (your RAID controller dies: good luck getting the data off the disks).

      What kind of workload were you running? As I said, hardware raid is typically faster than software raid, especially for writing to RAID-5/6 volumes. If your workload is mostly read-only, then you may not see much (if any) improvement with hardware RAID.

      I use RAID to protect me from server downtime more than to protect my data - even if I have redundant servers, if one server in an HA pair is down, then I have no redundancy left so I use RAID (sometimes with dual controllers), dual power supplies, etc to help ensure that the server stays up. If the server is down anyway, I'm just going to restore data from backup rather than try to recover the data after I replace the card.

    40. Re:Your first server, in 2012 by afidel · · Score: 1

      You don't need an identical card, just one of the same generation, at least for servers from the big 3.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    41. Re:Your first server, in 2012 by MasterOfGoingFaster · · Score: 2

      RAID cards are great when they work. And when they fail.... well...

      I'd much rather depend on ZFS.

      --
      Place nail here >+
    42. Re:Your first server, in 2012 by cdrudge · · Score: 1

      The Big 3 have the same problems. I've seen lots of IBM servers have failed RAID controller batteries, which IBM won't replace under warranty because they're "consumable", and won't replace for a fee because they aren't available anymore. On the other hand, installing a third-party part voids the warranty anyway.

      Under 15 USC 2302(c), they can not require original equipment be used. If the 3rd party component (in this example a battery) can be shown caused damage, then they may have grounds to deny a warranty claim. But if you install a battery and a drive or stick of memory goes south, then they don't have much ground to stand on in denying the claim.

    43. Re:Your first server, in 2012 by MasterOfGoingFaster · · Score: 2

      If I have a vertical architecture, then I want a box I can get someone onsite in 4hrs or less.

      And that ain't Newegg, that is an Dell or HP sized company.

      Management turned down my plan to have a second server. It was to be the identical model, but without all the disks and redundancy. They figured HP's 4-hour response time would be better than a hot spare server.

      Then the crash came.

      A nice fellow showed up within 4 hours, with the "most likely" part. It wasn't.
      The next day, more parts. Nope.
      The next day, two nice fellows showed up and replaced every part but the case. That solved it.

      The cost of downtime was so far beyond the cost of the spare server that it wasn't even funny. Hey, this stuff happens, and the HP guys were great. It just took a lot of time to resolve the problem and a spare would have let us do it while the rest of the factory kept working.

      --
      Place nail here >+
    44. Re:Your first server, in 2012 by rtb61 · · Score: 1

      Makes you think what the cloud is doing to the OS server market. It seems only the M$ managed parts of the cloud make M$ any real money and the rest of the cloud is running OSs that keep revenue within those parts of the cloud controlled by those operators. Taking the point of view that the cloud is a whole and not really separated as it is made to appear because you can tie your services to more that just one operator, especially considering the risks of the cloud.

      --
      Chaos - everything, everywhere, everywhen
    45. Re:Your first server, in 2012 by afidel · · Score: 1

      That particular problem was solved a few years ago when they introduced flash backed write cache. Basically it's a supercap or bank of regular caps that will power the controller long enough to push ram contents into a flash module. I won't buy anything else and in fact HP stopped offering battery backed units with the gen8 servers.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    46. Re:Your first server, in 2012 by whoever57 · · Score: 1

      All you need to recover the array in the event of a card failure is to place them into another server with the same generation controller or replace the failed controller.

      Exactly. You have to go out and buy a new controller. In some cases, you have to match the firmware version. In reality, when you buy a controller card, you should probably buy a second card as a spare in case the primary card dies.

      There is no such complication using software RAID under Linux. I don't have to ask if the vendor has made provision to make the RAID set portable.

      There are a few cases where hardware RAID may give an advantage, but it is (IMHO), poor use of the money. The same money applied to other parts of your server can give more value.

      --
      The real "Libtards" are the Libertarians!
    47. Re:Your first server, in 2012 by swalve · · Score: 1

      RAID cards are great when they work. And when they fail.... well...

      I'd much rather depend on ZFS.

      When they fail, you replace them.

    48. Re:Your first server, in 2012 by afidel · · Score: 1

      Dude, you can still buy any Dell, HP, or IBM raid controller ever produced because they sell each model by the millions. The last time I had to match firmware versions was like 8 years ago with an IBM controller, it's never been an issue with HP (there may be potential issues between uncertified controller and disk firmware combinations but they're a hell of a lot less likely than similar problems with "let's buy a bunch of generic HDD's and pray they all play nicely with whatever controller I bought"). If you consider data reliability an optional feature (or like the disk performance of drives with their write cache disabled) then you don't belong anywhere near anything called a server.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    49. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      You would be surprised. It is used in fortune 500 companies.

    50. Re:Your first server, in 2012 by mjwx · · Score: 1

      So what should you get for your first server. I.e., you're a small company. You've got a couple of laptops. You're outgrowing mutual Samba.

      You maybe want a fileserver. Maybe it'll have a few NICs and a virtual machine on it (Xen?) will do double duty as a external webserver.

      Erm, if you're a small sub 10 man outfit (say engineering for example) and need storage in this day and age you just buy a $3-400 QNAP NAS and 4 $100 2 TB disks. You've got to be pretty out of it to deploy a file server over a NAS box.

      This can be expanded by a cheap server and run SBS or Linus. business this small have been using non brand name Intel Xeon white boxen for over a decade, this is nothing new. Because a QNAP supports iSCSI and LDAP you dont need excessive storage in a server to have Windows/AD file services.

      BTW, no attachment to QNAP, feel free to swap with Thecus, Synology or brand of your choice. All but the cheapest NAS's support iSCSI and AD.

      You start to buy Dell, HP and IBM servers when you get bigger, say above 50 employees. When you've got over 1000 users, only the likes of HP and IBM can get you the volume of servers you need and HW support. But seeing as we're all virtualising, we're buying 20 servers where we used to buy 100.

      --
      Calling someone a "hater" only means you can not rationally rebut their argument.
    51. Re:Your first server, in 2012 by whoever57 · · Score: 0

      You seem to have missed my point that I have had a bad experience with performance when using a hardware RAID controller. I got a lot of support from the vendor, who agreed that I was using appropriate enterprise-class drives. Eventually the conclusion from the vendor was that RAID cards were built to optimise certain types of usage at the cost of poor performance for other types of usage. Apparently what I was doing (or rather, what the company I was working for was doing) just didn't fit into the envelope of performance for that card.

      In my experience, hardware RAID has other disadvantages: flexibility -- can you re-shape or extend your array with a hardware card? I am also at the mercy of the hardware vendor when it comes to the tools used to manage the RAID system.

      Perhaps some kinds of usage make the ability to withstand power cuts more important than others (database servers, for example).

      If money is no object and you don't care about flexibility, go for a hardware RAID card, but if money is a concern, I would spend money on redundant power supplies and UPS for the system first.

      You give examples of time when a hardware RAID card would save data loss when software RAID would not, but what if the RAID card's cache is full when the power goes off? You are still going to lose data. Perhaps your examples are corner cases? Arguably, the RAID card is more complexity and more to go wrong on the system. What if the RAID card dies when writing data?

      Yes, there are advantages to hardware RAID, but pretending that there are no downsides is not realistic.

      --
      The real "Libtards" are the Libertarians!
    52. Re:Your first server, in 2012 by danpbrowning · · Score: 2

      But mdadm *does* beat at least some of the enterprise $700-$1500 ones as well. My LSI MegaRAID SAS 9261-8i cost me about $900 (the battery alone was around $300) and it's slower than snot.

      I was raking in 800 MB/s seq with mdadm on an empty 8-disk RAID-50 using a bunch of $30 "cheapy" SATA HBA, but when I switched the exact same drives to hardware raid, the most I could get was 250 MB/s (seq) on an empty array and 160 MB/s at 85% full. Not to mention the random read I/O of 1 MB/s (yes, one MB per second -- not a typo). This is after spending a few weeks optimizing things: stripe-aligned partitions, block-aligned stripe sizes, and both controller and disk cache enabled. The latter of which I'd prefer to have turned off (even with a battery).

      I certainly wont make that mistake again. Of course, it's partly my fault for buying something without waiting for reviews (several other newegg buyers found it to be ludicrously slow as well), but I thought that after all these years it was a sure bet that *anyone* could turn out a decent hardware raid card if you give them over a grand. Apparently not. And I should have really researched the raid-5 write hole more before blowing $1200 on a supposed fix for the problem when a much better solution is to just use RAID-6 and the write intent bitmap (or ZFS).

      Of course, I'm not trying to say *all* hardware raid cards are bad. I'm sure that most of them are just fine. But I just don't see any benefit to them any more. Linux has mdadm, *BSD/Solaris have ZFS. The only reason for hardware raid is if your operating system's software raid implementation is completely braindamaged. In other words, it's for Windows.

      --
      Daniel
    53. Re:Your first server, in 2012 by aaarrrgggh · · Score: 1

      Hell, for most small companies, two single drive NAS units that have automated failover and synchronization are all you need. Throw in external monitoring and plug-and-play backup redundancy for off-site and you are golden.

      The MyBookLive units work pretty good in this respect, but I haven't bothered to do automated failover. We just use them for off-site backups with an rsync script that runs on the server.

      Add in a nicer router like a Cisco ASDM 500, and you are fine until you need an accounting server... All for less than $1k.

    54. Re:Your first server, in 2012 by aaarrrgggh · · Score: 1

      It is great until you have a drive failure, then the system turns to mush trying to rebuild, unless you are still using 250GB drives...

    55. Re:Your first server, in 2012 by hawguy · · Score: 1

      You seem to have missed my point that I have had a bad experience with performance when using a hardware RAID controller. I got a lot of support from the vendor, who agreed that I was using appropriate enterprise-class drives. Eventually the conclusion from the vendor was that RAID cards were built to optimise certain types of usage at the cost of poor performance for other types of usage.

      Well, that's the difference between rolling your own RAID array and buying from the big three -- you won't be talking to the RAID vendor, you'll be talking to the company that built your system, and when they isolate the performance problem, they'll get custom firmware from the RAID card maker and/or the drive manufacturer.

      Apparently what I was doing (or rather, what the company I was working for was doing) just didn't fit into the envelope of performance for that card.

      What is this special use case?

      In my experience, hardware RAID has other disadvantages: flexibility -- can you re-shape or extend your array with a hardware card?

      If that's important to you, then choose a RAID card that supports online RAID expansion (Promise supports it, I'm sure others do). I don't really trust online RAID expansion (whether software RAID or hardware RAID), but if you want to do it, you can find a card that will handle it.

      I am also at the mercy of the hardware vendor when it comes to the tools used to manage the RAID system.

      True, but I haven't found that to be limiting.

      You give examples of time when a hardware RAID card would save data loss when software RAID would not, but what if the RAID card's cache is full when the power goes off? You are still going to lose data.

      You seem to not understand how write-caches work, they don't become "too full". The only time a write is acknowledges is when it's safely stored in cache (or disk). If there's no room left in the cache, your write will wait until other data is written from the cache and space is available for your new data. There is never be a case when the cache is over full and data can be lost, even in the event of a power failure. If you're regularly filling the write cache on your controller, you probably need a higher performance disk subsystem for your workload.

      It is true, however that with a battery backed cache, you can lose data after a sustained power failure (most BBU's are good for at least 72 hours, so if you don't get power to the server and shut it down cleanly within 72 hours, you'll lose data.

      Perhaps your examples are corner cases? Arguably, the RAID card is more complexity and more to go wrong on the system. What if the RAID card dies when writing data?

      Yes, there are advantages to hardware RAID, but pretending that there are no downsides is not realistic.

      You think the RAID drivers in your operating system don't add complexity? The RAID controller has the advantage of its own SAS controller so the firmware only needs to work well with that one controller, also, when you buy a system from one of the big 3 vendors, the hard drive firmware is also qualified with the RAID card.

      When the RAID controller fails, it's the same thing that happens when your SAS or SATA controller fails - your application can't write data and could lose data. I've got dozens of servers with dozens of RAID controllers, and haven't had a RAID controller failure yet. They are not the quirky beasts they used to be, they just work (though I do keep up with firmware updates).

      I never said hardware RAID is perfect for every use case, but I haven't run across any cases where it's detrimental. The extra cost is minimal on any enterprise server. If pinching pennies is important, then software RAID may be your best choice.

    56. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      That only applies to consumer products. Business transactions are often governed by explicitly signed contracts anyway, although you have to be a huge enterprise to be able to really negotiate conditions with IBM.

    57. Re:Your first server, in 2012 by guruevi · · Score: 2

      I trust my single-purpose RAID controller card a lot more than my general purpose operating system to get the write right

      You know why Sun invented ZFS right? Or many of the IBM big clusters (Blue Gene) have no hardware controllers beyond simple SAS/FC HBA's for their data stores? I wouldn't trust any particular part in a computer to get it right, all it takes is 1 flipped bit. And HW RAID is particularly bad in keeping data portable.

      A UPS is not infallible since your server's operating system is subject to other failures such as someone yanking the power cord(s), hitting the reset button on the server, or an operating system crash. A hardware RAID card is not subject to any of these failures, if the power is yanked before it writes data, it will remain in the cache to be retried when the disks are available.

      Again, problems which have been solved by most if not all current file systems (except NTFS). The problem with those hardware RAID cards of yours is also that they need batteries to keep such data in cache. If the controller dies or the batteries die or the memory dies or the connection between the disks severs during a reboot (at least 4 points of failure) the array is still corrupted. And I have seen very few internal cards that have failover memory and controllers which ZFS makes it possible to have the solid state cache in a mirrored configuration.

      Filesystem journalling is independent of RAID level, most people using a journalling filesystem on top of RAID to protect against filesystem corruption from a server crash, which has nothing to do with RAID level. Typically only the filesystem metadata is journalled, so data corruption is still possible even with journalling. (data journalling is possible, but is rare since it means writing a second copy of data.

      Again, problems which have been solved by most if not all current file systems (except NTFS). All journalling file systems I can think of the top of my head do have atomic writes (Ext4, Btrfs, ZFS). You also seem to have no idea how journaling works, data corruption should not happen in a journaled file system because the journal is updated only after the data has been successfully written. A synced write does not return until the journal is updated.

      Well actually I guess the RAID controller write cache is somewhat like a data journal

      No IT IS NOT! It's merely a crutch to speed up writes to slow disks. Just as SSD's in ZFS configurations are there to enable high speed writes and to combine many write IOPS into a single write. Journaling GUARANTEES that regardless of what happens next the data has been committed to disk. Write cache BBU does not guarantee that, it merely guarantees this given a certain set of circumstances which occur 99% of the time the data may be committed to disk.

      Another advantage of Hardware RAID is that it's typically much faster than software RAID especially with RAID-5 and 6.

      Recent benchmarking (the last 5 years especially) has shown this claim to be patently false, another reason ZFS and BtrFS were created in the first place. Besides RAID6 calculations, you can also do inline compression and deduplication much faster than the 300MHz SOC you find on most cards. I have an external RAID controller with 1.2GHz Intel SOC and 2GB BBU RAM the IOPS (4k) to that thing is somewhere under 3000 at a cool 300MBps read/write to 12 15k RPM disks, cost me $24,000 ($2000/slot). Directly attached SAS with SSD cache does well over 10,000 IOPS, 300MBps to an array with the same amount of 7200RPM disks and has 90GB of read/write cache (amount of RAM) and nearly 1TB of read cache which can read out at a blistering 50,000 IOPS, this setup costs me $12,000 with 12 SAS disks and 4 SAS SSD's but has 8 times as much storage.

      Your write only has to hit the cache on the RAID controller to be "complete", while a less-than-full-stripe wr

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    58. Re:Your first server, in 2012 by inKubus · · Score: 1

      Well, assuming you're just doing file stuff, one of the commonly available NAS solutions with a box full of disks and multiple file protocols would work great. If you're tiny, your external webserver will be at dreamhost or something (I might have said GoDaddy here in 2008), because you're not going to have a real network connection. More likely your network will be on par with your server equipment and it'll be a cable modem or DSL. Personally, and this has been my business niche a LONG time, so I hate to say this, but if you're under 25 employees, you can get by with just a great internet connection and Google or Windows Live or one of the other cloud apps services. If, and this is a big if, you don't need the data to do your work. For instance, if you're a plumbing company, and you can just do the work and then account for it later with paper slips or something, cloud apps are probably reliable enough.

      The thing is, Dell and HP were never in this niche in a big way anyway. I mean, Windows SBS (Small Business Server) never sold many units, and it was designed to be a single server OS in a small office. I think what's really going on is that we've been in a recession, and so big companies have been buying fewer servers. Secondly, computers have gotten too powerful for the standard business workloads and if you combine this with the tendency over the past few years to do horizontal scaling in the CPU (i.e. more cores, not faster clock speeds), you have a lot of unused capacity if you stick with the old "one server per service" mantras. So, people have been virtualizing, building the "private clouds" where you have fewer more powerful hardware units and you split them up in software.

      What's crazy is that this has been IBM's like bread and butter since the late 80's when AS 400 and then later zOS came out. For them it's always been about one big hardware unit and cutting it up. Hell, you can go back to the 60's timesharing computers and see "cloud" computing.

      So, there you have it. Dell, HPaq have probably been selling fewer servers, and IBM is probably selling fewer due to the recession. On the consumer side, there's obviously Apple to blame for a lot of the desktop erosion, but again, we've been in a recession, everyone who wants a computer probably has one, and there hasn't been a compelling reason or need for new faster hardware.

      --
      Cool! Amazing Toys.
    59. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      If the page spec for Dell was $6,000 you should have paid no more than $4,000 for it, probably less.

    60. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      This is my experience as well. Software RAID is very very fast, almost no hardware RAID can beat it. Also it's more flexible and reliable in certain situations (with small installation where you can't afford a lot of hardware redundancy), because you can move the drives/arrays from one controller or server to another without worrying about array formats. It's also easier to administer than most hardware RAID controllers, which give you scary BIOS configuration menu's that all work differently and lousy tools to administer and monitor the arrays. It boots and initializes a lot faster than hardware RAID too. About the only place I'd still use "hardware" RAID is with VMWare, by necessity.

    61. Re:Your first server, in 2012 by h4rr4r · · Score: 1

      You can say the same thing about most hardware controllers. Rebuild times these days are just too damn long. This is what will kill spinning discs in the enterprise.

    62. Re:Your first server, in 2012 by MightyMartian · · Score: 1

      Currently I'm using Linux KVM with the libvirt libraries. There are limitations, such as there is no simple way to move images between servers, but all in all it works well.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    63. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      Cheap hardware raid? Mdraid beats the skittles out of high end IBM raid cards, fully optioned.

    64. Re:Your first server, in 2012 by Anonymous Coward · · Score: 0

      As someone who has btdt its worth buying kit twice to not have to deal with time and life sucking IBM firmware and support.

    65. Re:Your first server, in 2012 by blind+biker · · Score: 1

      With Xen?

      --
      "The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
    66. Re:Your first server, in 2012 by SuperQ · · Score: 1

      kvm and drbd on 12.04. It's been running fairly well except for a qemu bug that causes the network (bridged) to stall. I'm going to be testing a patch that will probably hit release soon that fixes the bug.

  3. No surprise. by heypete · · Score: 5, Interesting

    Why bother with branded parts made by an ODM when you can buy directly from the ODM?

    My old workplace had (has, probably) a fairly beefy Sun server with a whole bunch of disks. They used it as a RAID-based storage server for a bunch of lab data. As they do on occasion, a hard disk would crap out. The server wouldn't take ordinary disks, though: it would only accept Western Digital disks with some Sun ID code baked into the firmware -- rather than simply being able to buy a few WD RAID-friendly disks ahead of time, we had to jump through Sun's hoops to get disks replaced under warranty. This usually was a multi-week process, during the array with the failed disk was running with a hot spare -- hardly ideal. That was the last time we bought Sun systems.

    At some other point, we were planning on setting up a few more storage servers for backup data. Dell's price for a storage system, including firmware-locked drives, was about triple the cost of doing it ourselves with SuperMicro servers, MD-based software RAID, and RAID-friendly disks. We ended up buying two of the SuperMicro-based systems and putting them in different buildings for semi-offsite backup (the concern was if the server room caught fire, not if a meteor affected the whole city). The only extra step during the setup was putting the disks in their caddies: the Dell systems came with the disks pre-installed. That took about 5 minutes per server. Whoop-dee-doo.

    The Dell servers restricted our (with firmware-locked disks) options and cost substantially more than doing it in-house. We'd be stupid to go with their products, as we'd be locked to that vendor for the life of the servers.

    Sure, we had Dell Optiplex systems as the desktop workstations for researchers as they were inexpensive, reliable in the lab, and essentially identical (useful for restoring system images from one computer to another), but their server stuff is stupidly overpriced.

    The SuperMicro servers were much more "open" in that they used pretty bog-standard parts and didn't have stupid anti-features like firmware locking.

    1. Re:No surprise. by Anonymous Coward · · Score: 0

      First, a RAID array does not "[run] with a hotspare." When a failure occurs, the hotspare becomes a fully integrated member of the array, at which point you would be running without a hotspare, which on a redundant array isn't that much of a problem considering the Dell replacement would be there within 4 hours of reporting/determining a hardware failure.

      Second, Dell servers do not have "firmware-locked disks." I've never heard of such a thing. It's a pretty absurd concept that you could only have OEM hard disks in your box, and an unrealistic expectation that clients would comply.

      Finally, hardware RAID is leaps and bounds above software RAID. There's a reason it's cheaper to go with software...

      You might have saved money up front, but over the life of the server, you could potentially lose much more when you consider catastrophic hardware failure which would be fully covered under the warranty of the Dell box.

    2. Re:No surprise. by Anonymous Coward · · Score: 1

      Dell had restricted drives to their brand but a firmware update removed the restriction. Here is a link to a discussion about it:

      http://en.community.dell.com/support-forums/servers/f/906/t/19324790.aspx

    3. Re:No surprise. by heypete · · Score: 3, Informative

      First, a RAID array does not "[run] with a hotspare." When a failure occurs, the hotspare becomes a fully integrated member of the array, at which point you would be running without a hotspare, which on a redundant array isn't that much of a problem considering the Dell replacement would be there within 4 hours of reporting/determining a hardware failure.

      It took Sun 3+ weeks to send us a replacement hard disk under warranty and required multiple phone calls. This happened on multiple occasions and was one of the main reasons we decided to stop buying Sun servers.

      Yes, the spare became an integrated member of the array. That's true. My point was that the hot spare was now a member of the array and we had no remaining spare disks in the array. Since the server hardware only allowed drives with the Sun firmware, we couldn't keep a supply of spare disks around to swap into the arrays as needed.

      Second, Dell servers do not have "firmware-locked disks." I've never heard of such a thing. It's a pretty absurd concept that you could only have OEM hard disks in your box, and an unrealistic expectation that clients would comply.

      They did: "In the case of Dell's PERC RAID controllers, we began informing customers when a non-Dell drive was detected with the introduction of PERC5 RAID controllers in early 2006. With the introduction of the PERC H700/H800 controllers, we began enabling only the use of Dell qualified drives."

      Same thing with Sun, at least at that point in time.

      Finally, hardware RAID is leaps and bounds above software RAID. There's a reason it's cheaper to go with software...

      Software RAID was perfectly adequate for our needs: as backup servers they didn't need to have the utmost performance. As a bonus, we weren't reliant on a specific make and model of hardware RAID card: we could connect the array to any system running MD. Even under heavy load the demand on the CPU was negligible.

      The Sun server was the main Samba share for the lab: lab instruments would write data to it and researchers would access that data on their desktops. It also used software RAID with multiple arrays set up. CPU usage was similarly low, even at high loads, and it worked quite satisfactorily for the lab.

      You might have saved money up front, but over the life of the server, you could potentially lose much more when you consider catastrophic hardware failure which would be fully covered under the warranty of the Dell box.

      SuperMicro offered a comparable warranty, so that wasn't really an issue.

    4. Re:No surprise. by h4rr4r · · Score: 1

      All the big storage vendors restrict you to their drives. Try chucking random drives in a EMC storage box and tell me how it works out.

    5. Re:No surprise. by petermgreen · · Score: 2

      Dell tried locking their raid controllers to their own drives but backed down under customer pressure.

      http://www.standalone-sysadmin.com/blog/2010/04/dell-reverses-position-on-3rd-party-drives/

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    6. Re:No surprise. by zlives · · Score: 1

      There are also some chassis warranty issues (eualogic) while not using dell bought drives... this i have run into which imho is completely asinine but thats the rule.

  4. Dell doesn't honor quotes by Spazmania · · Score: 1

    At the beginning of August I got a quote from dell for 2 R710 servers and 4 R610 servers. Three weeks later I placed the order. The response? Sorry, we're not selling those any more. You have to buy the R720's instead and they're more expensive.

    So, sorry Dell. I won't be considering you for the upgrades to the other 200 servers I manage after all. Pity because HP just pissed me off with the DL380p gen8 which can hold 16 drives but has no raid card which can use more than 8.

    --
    Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    1. Re:Dell doesn't honor quotes by houstonbofh · · Score: 1

      Intel makes a nice server platform that many people OEM. I have bought a few from System76, even when I didn't need Linux. Good support and better price.

    2. Re:Dell doesn't honor quotes by Anonymous Coward · · Score: 0

      I order A LOT of HP servers( they are my favorite ODM )

      First the DL380p gen 8 can have 25 Hard drives....
      Second under additional Storage adapters if you are customizing you can pick the p822 controller.... which can handle over 200 HDD's

    3. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      The p822 can handle 200 hard drives as long as 192 of them are in external chassis. It can handle exactly 8 drives inside the dl380p. It is not compatible with HP's internal SAS expander card the way the previous generation of smart array controllers were.

      Also, the 25 drive version is not a dl380p gen8, it's a dl380e gen8. The E or Economy series is a distinctly lower end box with a maximum processor speed of 2.4ghz.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    4. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      But if you've implemented a DL380p (not e) with the expansion drive chassis to bring it to 16 drives and gotten all 16 to work on a single controller then by all means tell me what configuration you used. If you've found the hidden magic, I'll be only too happy to eat my words.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    5. Re:Dell doesn't honor quotes by gagol · · Score: 1

      Have you tried their laptop? I badly need one, they look and prices great. Need feedback here!

      Sorry for offtopic'ing!

      --
      Tomorrow is another day...
    6. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      Nope. It handles 25 drives in the dl380e, the underpowered economy version of the dl380. In the dl380p it handles 8 drives only. If connected to a drive expander to multiplex the 8 sas channels, it refuses to boot and prints a message saying to disconnect the expander.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    7. Re:Dell doesn't honor quotes by Jeng · · Score: 1

      The mistake that Dell made was giving you a quote without letting you know that it was not going to be available in three weeks.

      They probably just didn't think you were going to take three weeks to finally place the damn order.

      Once they no longer have the items just what in the fuck did you expect them to do?

      --
      Don't know something? Look it up. Still don't know? Then ask.
    8. Re:Dell doesn't honor quotes by ixidor · · Score: 1

      uh, that is when you get the hp sas expander card http://h18004.www1.hp.com/products/servers/proliantstorage/arraycontrollers/sas-expander/index.html it is the very definition of what you are trying to do ..

    9. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      Does not work. The current smart array controller (the old ones aren't compatible with the chassis) reports: "This smart array is not compatible with the expander. Please remove it and reboot." Bootup then stops.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    10. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      That is, the P420 series definitely doesn't work with the card you referenced.

      I tried a P410. It worked with the card. But not with the drive bay: it reported all 16 drives as being bay 1 drive 0 and it wouldn't light any of the lights.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    11. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      Do you buy for a large corporation? Do you generally place the order the same day you got the quote? The standard business practice is that quotes are good for 30 days. There's a reason for this: bureaucracy. Love it or hate it it's a business reality.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    12. Re:Dell doesn't honor quotes by Jeng · · Score: 1

      It is a business reality, although I don't buy for a large corporation, I take orders and give quotes as part of my job.

      Quotes may say 30 days, but shit happens and sometimes those items are just plain no longer available. They may have had a stock of the servers you wanted, but they sold out before you placed your order.

      --
      Don't know something? Look it up. Still don't know? Then ask.
    13. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      This isn't Joe's two person computer shop we're talking about. They have years of warranty service obligations remaining on the machines they did sell. They have access to a continuing source for every part that goes in to those computers and will for some time.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    14. Re:Dell doesn't honor quotes by Jeng · · Score: 1

      They have access to a continuing source for every part that goes in to those computers and will for some time.

      They may have spare parts till the end of time, but that doesn't mean they will build a computer out of the spare parts that are in the spare parts warehouses scattered around the world.

      --
      Don't know something? Look it up. Still don't know? Then ask.
    15. Re:Dell doesn't honor quotes by Spazmania · · Score: 1

      Dell made an offer to sell a piece of equipment. The offer was accepted. They refused to honor the offer. The refusal was not based on any circumstances beyond their control. That's plain slimy.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    16. Re:Dell doesn't honor quotes by houstonbofh · · Score: 1

      I have a 2.5 year old Lemur Ultra Thin. Rock solid. It was in a backpack bungied to my motorcycle when it was launched 20 feet and landed between two cars. Still works perfectly. Me, not so much, but getting better.

  5. FIFTH? by Anonymous Coward · · Score: 3, Interesting

    Let me get this right. Google, who builds all of their servers in-house, exclusively for their own use (not for resale), is the fifth largest buyer of Intel server chips in the world?

    That sure paints a picture about the sheer size of Google's data center operations.

    1. Re:FIFTH? by Penguinisto · · Score: 1

      It also paints a picture of just how much pr0n, lolcats, and pointless facebook updates actually exist on Earth.

      Pretty depressing, isn't it?

      --
      Quo usque tandem abutere, Nimbus, patientia nostra?
  6. Eh... I don't see this as a huge deal, really.... by King_TJ · · Score: 2

    While yes, right now, the tide may be against the server manufacturers -- the cloud still requires them in large quantities to host those services. If it negatively impacts sales, it's only to the extent that efficiency is improved. (EG. Joe Businessman who once bought a server for his office of 10 employees skips it, in favor of cloud computing solutions. But it turns out his needs are small enough so they can share the load with 1-2 other small businesses like his, all on a single server in the cloud.)

    In my opinion, Dell has the right idea -- changing the focus on who their customer is for their server products. Beyond that, what's really news here?

    Going out on a bit more of a limb though? I'm really of the opinion that cloud services are over-hyped as the "in" thing for every business. Once companies migrate heavily to cloud hosted solutions and use them for a while, a fair number will conclude it's not really beneficial. Then you'll see a return to the business model of running in-house servers again. (Granted, those servers might be smaller, with lower power consumption than in the past. Little "microservers" handle many of the basic file and print sharing work companies used to relegate to full size rack mounted systems in the past.)

    But my own experience with cloud migrations tells me that it's not so great, 9 times out of 10. For example, my boss has been using the Neat document management software for a while now to scan in all of his personal receipts and documents at home. Neat now offers "NeatCloud" so you can upload your whole database and then access your docs via an iPhone or iPad client, or even scan something new in by simply taking a picture of it. Sounds great, but in reality, he had nothing but problems with it. The initial upload tied up his PC for the better part of his weekend, only to report that some documents couldn't be converted or uploaded properly. He had close to 100 random pages of existing documents thrown in a new folder the software generated, to hold the problem ones. The only "fix" for this was to click to open a trouble ticket for EACH individual document that failed, so someone at Neat could examine it manually and correct whatever issue prevented their system from properly OCRing and uploading it. Clearly, that wasn't much of a solution! He tried, repeatedly, to get someone to remote control into his PC to do some sort of batch repair for him -- but after a couple promises to call back "the next day" to look at it, nobody ever did. Now, all Neat can tell him is they have another update patch coming out for the software in the next week, and to disable cloud uploads until that time.

    Or take the recent migration a small office did from GoDaddy pop3/smtp email with Outlook to Google hosted mail. I usually help these guys with their computer issues but they thought they could tackle this migration on their own. Turns out, they wound up with a big mess of missing sub-folders of mail in Outlook on the owner's machine. After a lot of poking around, I discovered part of the problem was due to characters in the folder names that Google Apps didn't consider valid. When it hit one of those during the mail migration, it just skipped the whole mail folder upload with an error. (Did Google's migration wizard utility even warn about this in advance or offer to help rename the problem folders before continuing? Heck no!)

    For that matter, take what you'd think is pretty basic functionality with cloud based data backup? I've run into multiple situation now where people used services like MozyPro for their backups, only to discover a full restore (when a drive crashed) was incredibly slow and kept aborting in the middle of the process, making the data restore essentially impossible. Mozy's solution? They're willing to burn a copy of the data onto optical disc and physically mail it back to you. So much for the whole cloud thing, huh?

  7. iPads! Clouds! LinkedIn! by devphaeton · · Score: 1

    Further proof that tablets and the Cloud(tm) are the paradigm shift into the new memesphere. Nobody needs big, bulky Iron from folks like IBM, HP, EMC, etc.

    We'll do it all now on clustered iPads! With Retina Displays! Surfing the web is dead, now we're Hangliding in The Cloud(tm)!!!!

    --


    do() || do_not(); // try();
    1. Re:iPads! Clouds! LinkedIn! by denis-The-menace · · Score: 1

      "The Cloud" is only good as secondary backup if you don't care that it becomes public.

      Encrypt it all you want. Access to your data is the hardest hurdle and by using the could you give it away.

      --
      Obama's legacy: (N)othing (S)ecure (A)nywhere and (T)error (S)imulation (A)dministration
    2. Re:iPads! Clouds! LinkedIn! by devphaeton · · Score: 1

      "The Cloud" is only good as secondary backup if you don't care that it becomes public.

      Encrypt it all you want. Access to your data is the hardest hurdle and by using the could you give it away.

      But.. but.. but... smartphones and virtualization and...and...and...free community wireless internet over dark fiber!!!

      (Yes, I'm just being silly. Having a slow day at work and the free coffee sucks)

      --


      do() || do_not(); // try();
    3. Re:iPads! Clouds! LinkedIn! by DrVomact · · Score: 1

      "The Cloud" is only good as secondary backup if you don't care that it becomes public.

      Encrypt it all you want. Access to your data is the hardest hurdle and by using the could you give it away.

      I'm thinking that people who want to "be in the cloud" don't think about stuff like encrypting. "What, me--worry? I'm using the cloud!" En/Decrypting is work, and the whole idea of the cloud is to avoid work. If any crypto is being done, it's probably a service operated by your friendly (non-local) cloud provider, which means it provides no real security at all.

      This willingness of businesses to surrender their family jewels—their data—to complete strangers has puzzled me since this type of service came into vogue. But then, I'm also mystified by people's willingness to put their true names and their personal lives on the web and make them accessible to everyone. There is an acute shortage of paranoia among the sheep these days.

      --
      Great men are almost always bad men--Lord Acton's Corollary
    4. Re:iPads! Clouds! LinkedIn! by icebraining · · Score: 1

      The benefit of the "cloud" is reduced costs, and certainly doesn't mean it's insecure.

      Tarsnap (a backup service), for example, is very much a cloud service (runs on EC2 and stores the user data on S3), yet it encrypts each archive you upload with a random AES256 key that is then itself encrypted with an RSA key that never leaves your machine, and the whole thing has multiple levels of signatures (to prevent tampering).

      It's also designed and run by the FreeBSD Security Officer, which isn't a position given exactly to anyone.

      While cloud services, like everything else, follow Sturgeon's law, you shouldn't label everything as insecure or badly designed.

  8. What about Netcraft? by ickleberry · · Score: 2

    Do they confirm it? Nothing's actually dieing until Netcraft says so.

    1. Re:What about Netcraft? by Anonymous Coward · · Score: 0

      I've been lurking on Slashdot for over a decade and have seen this joke/statement repeatedly, but I've never understood it. Can someone explain it?

    2. Re:What about Netcraft? by ickleberry · · Score: 2

      Some lad was trollin once and said "BSD is dieing, netcraft confirms it" citing the latest publication by netcraft then it kind of took on a life of its own and now nothing's dieing until Netcraft confirms it

    3. Re:What about Netcraft? by Anonymous Coward · · Score: 0

      Ah, so it's a "you had to be there" kind of thing.

    4. Re:What about Netcraft? by kiwirob · · Score: 1

      I was running something like FreeBSD 4.3 with KDE as my primary desktop (refused to go from Win98 to XP so went BSD instead) at the time of the "BSD is dieing, netcraft confirms it" meme. Believe you me I was there and I took it very personally at the time, how could someone say my beloved desktop of choice was dieing! ....hang on a minute that was their plan all along... bloody trolls. Was probably those pesky linux troll users slagging off the original BSD unix systems in the early 2000's. I get the same thing today from Fandriod trolls slagging off my current BSD distribution known as OSx & iOS.

  9. demand finally saturated by Thud457 · · Score: 2

    see, I told you that electronic data processing was a fad

    -- Spencer Tracy, "The Desk Set", 1957

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  10. Re:Eh... I don't see this as a huge deal, really.. by DragonWriter · · Score: 1

    While yes, right now, the tide may be against the server manufacturers -- the cloud still requires them in large quantities to host those services.

    Google's position on the list of Intel server-chip buyers makes it clear that the problem isn't for people server manufacturers (which Google, very much, is), its for server vendors. Sure, the cloud requires servers. But if the people selling cloud services are also building their own servers, that doesn't create a market for server vendors.

  11. Re:Eh... I don't see this as a huge deal, really.. by Todd+Knarr · · Score: 2

    It may also depend on what kind of servers companies like Google want. Dell, HP and the like produce expensive servers with high-cost maintenance contracts, which look great to conventional business-executive types. Google, OTOH, probably is taking the techie approach of generic white-box servers with no support. They're installing their own OS image on it, and it's not going to be Windows or a commercial Unix, and with all Google's custom software they probably find vendor support all but useless. Ditto hardware support, the idea is to not worry too much about failures and just replace the box, and with generic hardware replacing failed parts is probably cheaper than the support contract would've been.

    You've nailed the rest, though. When you depend on "The Cloud", you're depending on someone else to prioritize solving your problem. The problem is that the most effective solution for them is far from optimal for you, and you don't have enough leverage with them to change their priorities. At least when stuff is in-house the people responsible for it answer to you and you can, if needed, go down and rearrange their to-do list in person.

  12. Home built + VMs by heezer7 · · Score: 0

    We have 2 in house built servers hosting 10 VMs. Waaay less hardware than if it was not virtualized and miles cheaper than the Dell servers we priced out.

  13. Re:Eh... I don't see this as a huge deal, really.. by Anonymous Coward · · Score: 0

    Or small business could, you know, buy now-cheap servers and skip the whole monthly bill that comes with The Cloud (tm). Hosted email? Sure, but that's not "cloud"--it's been common for years. Backup? Properly done, OK, but the thought of paying per use on a business server is just creepy. Well, that, and you'll eventually get the Verizon Effect. Hosted servers will be cheap until people depend on them and then--price hikes and service reductions. It's the American Way (tm).

  14. Really Cheaper? by Anonymous Coward · · Score: 0

    Is it really cheaper to build it yourself once you reach a certain size? We just added a few petabytes for storage and went with IBM. It was costing only a little more than ordering parts and doing it ourselves but it wouldn't have been as neat and efficient. That thing is tightly integrated, from the power supplies to the software.

    To have something comparable, we would have had to hire a mechanical engineer and an electrical engineer on top of taking time from the people in house to work on the software side.

    Of course, that all made me want to add another SAN at home. My own build came out cheaper than buying something pre-built but that's because off-the-shelf parts and software are sufficient for my own needs.

    With Google and Amazon, they hired people to design this stuff but I don't see every bank, retail chain, or big companies creating their own solution.

  15. Low- vs. High-level cloud services by DragonWriter · · Score: 3, Informative

    The cloud providers (which includes Google, if you ignore the fact that they only provide high-level cloud services, unlike Amazon) mostly build their own hardware.

    Google provides low-level cloud services (IaaS in the form of Google Compute Engine, PaaS in the form of Google App Engine, RDBMS-in-the-cloud in the form of Google Cloud SQL, bucket-style storage in Google Cloud Storage) as well as higher-level services (all of Google's various apps build on their cloud infrastructure.)

    So the Google-Amazon distinction drawn in the parenthetical is inaccurate.

    1. Re:Low- vs. High-level cloud services by fm6 · · Score: 1

      I stand corrected.

  16. Dell has one advantage by kurt555gs · · Score: 0

    Michael Dell can suck harder and deeper on Balmer's cock. It's worked in the past.

    --
    * Carthago Delenda Est *
  17. Diversify by Anonymous Coward · · Score: 0

    Not a big impact to HP, IBM, Dell. They have since taken on IT Service Management, Service Desks, BPOS, among other sevriceng lines. More money in servicing then in hardware sales. Labor is cheap, profit margin large. Their shareholdetrs are happy.

  18. Beowulf by Anonymous Coward · · Score: 0

    I'd say this dude, http://en.wikipedia.org/wiki/Thomas_Sterling_(computing), killed them.

  19. This has nothing to do with google by netwarerip · · Score: 2

    And everything to do with VMWare. No one is buying servers because they have no need to. When I can replace 400 physical boxes with a couple dozen ESX hosts why wouldn't I?

    I guess another way you can look at it is Intel has innovated themselves out of a market. Multi-core procs have enabled the virtualization boom, but they didn't charge enough for them. At least the auto industry was smart about it - new cars last twice as long as cars from 15-20 years ago, and prices have gone up accordingly.

  20. So ... by Rambo+Tribble · · Score: 1

    ... where is all this going to sit when you build your new computer on your printer?

  21. Google Server Production by Baardvark · · Score: 1

    If Google's 5th on the list, I ran some dead reckoning crunches and figure they must be producing somewhere North of 300k servers annual run rate.

  22. Data security still matters by gessel · · Score: 1

    My data centers are all so small they'd be lost in the caverns of the likes of Google or FB, but in applications where ownership of the data is important; and this should apply to sovereign governments, most companies, and even most small businesses; availing oneself of an external data hosting or processing service is giving away the farm.

    There are a variety of security concerns unique to the "cloud" environment that should worry anyone who has some liability or risk associated with unintended exposure of their data: from other users of the same physical hardware, from the typically faceless third party employees operating it, and from joining a collective target. A counter argument is that cloud vendors tend to be expert at security and are likely to have more resources to stay current and be vigilant than any single client of theirs, just as a law of scale. But, as DropBox's password fiasco proves, this assumption is not always true - or, perhaps more accurately, a statistical reduction in the likelihood of execution risk is not an elimination of that risk and the consequences of false assumptions can be severe when the failure is of a central repository.

    One is safe in using a "cloud" service (such a fluffy marketing term for "third party hosted IT") for data that is intrinsically public, such as this forum or a Facebook post. For a company's HR database, not so much. For a government to have a "cloud computing strategy to lower costs" is very sad. The OP references a statistic that is driven in large part by Google and Facebook, services of such massive scale that vertical integration into the hardware makes sense. It is not intrinsically a refutation of owned and operated hardware. That these vertical integrations have grown to such scale as to rank as major hardware vendors in their own right is impressive, but not in and of itself a "tide" against enterprise hardware. That the vendors of enterprise hardware would seek to own a piece of the emerging market for low cost, low atomic reliability (mitigated by macro reliability) compute systems isn't an abdication of more proven product lines, rather a reasonable foray into new product lines.

    The OP finds the data supportive of a popular meme: that cloud computing will replace enterprise computing. This may be true if Zuckerberg's "no privacy" jihad is extended to "no secrets" as well, but as long as companies and governments have secrets and people value privacy, there will be a market for owned and operated hardware since he that owns the hardware owns the data (and when you host your data with a third party, you implicitly trust every employee there). While it is in theory possible to secure remotely hosted data through encryption (and perhaps even to allow remote processing of fully encrypted data), the overhead of securing one's secrets against the third party's prying eyes (and those of their other customers) significantly undermines any touted (but generally unproven) cost savings of "cloud computing."