Slashdot Mirror


When Does Powering Down Servers Make Sense?

snydeq writes "Powering down servers to conserve energy is a controversial practice that, if undertaken wisely, could greatly benefit IT in its quest to rein in energy costs in the datacenter. Though power cycling's long-term effects on server hardware may be mythical, its effects on IT and business operations are certainly real and often detrimental. Yet, development, staging, batch processing, failover — several server environments seem like prime candidates for routine power cycling to reduce datacenter energy consumption. Under what conditions and in what environments does powering down servers seem to make the most economic and operational sense, and what tips do folks have to offer to those considering making use of the practice?"

44 of 301 comments (clear)

  1. Only when it makes sense by Yvan256 · · Score: 5, Funny

    Like when someone posts your domain name on slashdot!

    You can't take down a server that's already off-line.

    1. Re:Only when it makes sense by TubeSteak · · Score: 5, Funny

      You can't take down a server that's already off-line.

      Nuke the entire site from orbit.
      It's the only way to be sure.

      --
      [Fuck Beta]
      o0t!
  2. The moment when.... by TheNecromancer · · Score: 4, Funny

    you see the Windows logo appear? (sorry, couldn't resist)

    --
    Attention all planets of the Solar Federation! We have assumed control! - Neil Peart
    1. Re:The moment when.... by Yvan256 · · Score: 5, Funny

      Give it 30 seconds and it'll do it on its own (sorry couldn't resist either)

  3. Simple by eln · · Score: 5, Funny

    The best time to shut down the servers is right before you quit your job. Password-protecting the BIOS first adds value too.

    1. Re:Simple by Anonymous Coward · · Score: 5, Funny

      Password-protecting the BIOS first adds value too.

      A real pro puts epoxy on the BIOS battery & any motherboard jumpers.

      If I can't have this server, neither can you

    2. Re:Simple by mysidia · · Score: 5, Funny

      A real blackhat flashes a custom BIOS with the password set, so pulling the battery just resets the BIOS back to his default password.

  4. WOL by Anonymous Coward · · Score: 5, Insightful

    Put redundant/failover servers into a sleep state and enable WOL.

    1. Re:WOL by cerberusss · · Score: 5, Funny

      Mod parent redundant.

      --
      8 of 13 people found this answer helpful. Did you?
  5. Business needs and Risk by Kamokazi · · Score: 4, Insightful

    It's pretty much up to your business....what must run 24/7, what systems are likely to get accessed in off hours, and how likely is that, and how critical are they? With redundant systems, can there be any downtime while they are powered up, or should it be immediate failover? If you use virtualization the redundancy should be easier to manage in many cases...you may be able to immediately offload to running systems and power up backup systems and then bring the VMs up there.

    It's hard to get very specific without knowing your business and what you are running and what the needs are.

    --
    As our way of thanking you for your positive contributions to Slashdot, you are eligible to disable Slashdot 2.0.
    1. Re:Business needs and Risk by vwjeff · · Score: 5, Interesting

      Example Setup The organization I work for has a well known usage patterns that we use to make decisions like this. 95% or more of our traffic occurs during business hours which we define as 7:00 AM - 7:00 PM. During business hours we have dedicated servers for various functions. We have a cluster of servers running virtual server instances that duplicate the dedicated servers. During off hours the dedicated servers are powered down and the virtual server instances take over. It works for us and we have seen a significant decrease in power usage with no impact on our users.

  6. I go by a few simple rules... by Anonymous Coward · · Score: 5, Funny

    I'm glad this was posted to "Ask Slashdot" where your audience is highly seasoned professionals that can give you wise, insightful answers...
    In the data center that I manage, I use a few simple rules to determine when I power them down.
    1) If the server is on fire
    2) If there are no users using the server
    or
    3) If the power company is saying that I haven't paid my bill and they are sending "Hank" over to cut me off
    4) Civil unrest, tornado, earthquake, zombies, etc.

    1. Re:I go by a few simple rules... by Anonymous Coward · · Score: 5, Funny

      I'm glad this was posted to "Ask Slashdot" where your audience is highly seasoned professionals that can give you wise, insightful answers...
      In the data center that I manage, I use a few simple rules to determine when I power them down.
      1) If the server is on fire
      2) If there are no users using the server
      or
      3) If the power company is saying that I haven't paid my bill and they are sending "Hank" over to cut me off
      4) Civil unrest, tornado, earthquake, zombies, etc.

      Zombies aren't a good reason for shutting down the servers, that's why our IT guy keeps a shotgun leaned up against the server....at least he says it's for zombies.

  7. Virtualize! Virtualize! Virtualize! by Anonymous Coward · · Score: 5, Interesting

    If you virtualized your servers, you could create a managed power-down/power-up scenario. In the morning, your servers would turn on, your virtualized instances would move around (so they have more power for the day's activities), and then at night they'd retreat to a smaller group of servers. The unused servers could shut down for the night. You could even rotate which servers stay on overnight keeping the virtual servers running to spread the wear around if there is some.

    1. Re:Virtualize! Virtualize! Virtualize! by Amarok.Org · · Score: 5, Informative

      There are a number of tools and products out there to assist this.

      Consider a large (65k+ employees) company that has a several hundred server implementation that they use to process payroll every two weeks. They use a management tool to power them up on Friday, process payroll over the weekend, and shut them down on Monday. The power and cooling cost impact of these several hundred servers *not* running most of the month (6 or so days a month instead of 31) is huge.

      Another (and also in use by the same company) strategy is to virtualize the OS instances, spin those up and down as necessary, and then use something like VMWare's VMotion to maximize usage of the physical boxes - and again use another tool to power down unneeded compute capacity.

      Welcome to the virtual world...

      Lots of prerequisites, but when it works, it's pretty freakin' sweet...

      --
      -- "Other than that, how was the play Mrs. Lincoln?"
    2. Re:Virtualize! Virtualize! Virtualize! by agallagh42 · · Score: 4, Informative

      ...and again use another tool to power down unneeded compute capacity.

      And that other tool is ... VMware! DPM (distributed power management) is built right in, and does exactly what you describe.

      http://www.vmware.com/products/vi/vc/drs.html (scroll to the bottom)

      Welcome to the virtual world...

      Yup, the game is officially changed.

      --
      Carpe Cerevisi - Seize the Beer
    3. Re:Virtualize! Virtualize! Virtualize! by Amarok.Org · · Score: 4, Informative

      Actually, the other tool in this case is Cisco's VFrame Data Center. The problem with DPM (and other VMware tools) is that they won't let you move a physical box between ESX clusters. If you have multiple ESX clusters, the physical machine stays with it - powered up or not. With VFrame, the system can be powered down, removed from the cluster, and added to another if/when necessary... including any necessary network configuration (VLAN memberships, etc) and SAN configuration (zoning changes, LUN masking).

      Not that I'm complaining about VMWare's solution to this problem - they're actually quite complimentary.

      --
      -- "Other than that, how was the play Mrs. Lincoln?"
    4. Re:Virtualize! Virtualize! Virtualize! by nabsltd · · Score: 5, Interesting

      First, let's assume "several hundred" equals 200, and we have exactly 65000 employees. Let's also assume that these extra servers are on for exactly 48 hours. Let's also assume perfect load balancing and distribution of the process over the servers.

      That means that each server processes payroll for 325 employees in 48 hours, or about 7 employees per hour. So, each of these servers is basically the equivalent of a Commodore 64 in computing power. I suggest that the best way to save money at this task is to replace the 200 servers with a single Pentium 4 quad core running at 3GHz.

      The other explanation—that the software is so unbelievably bad that it really does take 8½ minutes for it to run a single employee—is possible, but would going out and buying "QuickBooks" really cost more than the 200 servers to run this awful beast of a payroll program?

    5. Re:Virtualize! Virtualize! Virtualize! by Silentknyght · · Score: 4, Interesting

      If you have a consulting or legal business, where your employees bill time by the tenth of an hour, then yes, this could be a much longer process than you estimate. You have to tabulate all the hours for each employee for the month, and then allocate each hour spent on each day to each client, each client's job, each phase of said job, and each task under that job. Spread that across 1000 active clients with 1-2 jobs each, many with multiple phases, and all with multiple task codes. None of that has to do with processing a paycheck for me. The billing cycle isn't about getting a check from your employer, but getting a check from your client. The above may seem overly complex, but they ask for it and they pay the bills.

    6. Re:Virtualize! Virtualize! Virtualize! by will592 · · Score: 4, Insightful

      But what happens to all of the servers that fail to start up in time to process payroll? It's late? You pay overtime through the nose for th SysAdmins that have to come in and work 24 hour days to bring the machines online? Seriously, I'm not saying it's a bad idea but I would say that this scenario is probably more like 15 days on 15 days off. You have to build in time on the front end to make sure the machines are up and running in a stable configuration, and probably time on the back end to apply patches and perform metrics on the machines to make sure they are running properly for next month. I'm not sure that this would save anyone any money in the long run because of the load on their staff during spin-up.

    7. Re:Virtualize! Virtualize! Virtualize! by Amarok.Org · · Score: 3, Informative

      And given that there's more to processing payroll than printing out a check for each employee (calculation of taxes in every state in the US, every country in the world, etc), updating various accounting systems, etc... there's a lot of work to be done besides "take 8 1/2 minutes for a single employee".

      --
      -- "Other than that, how was the play Mrs. Lincoln?"
    8. Re:Virtualize! Virtualize! Virtualize! by Bandman · · Score: 4, Insightful

      Wait, you know of a place where sysadmins are paid overtime? Or even by the hour?

    9. Re:Virtualize! Virtualize! Virtualize! by billcopc · · Score: 5, Funny

      First of all, I'm with you, I also don't understand what it is about these mythical accounting processes that takes so damn long to process.

      I guess it's like everything else in the software industry:

      - software built by programmers for programmers runs quickly
      - software built by programmers for non-programmers is incoherent
      - software built by non-programmers for non-programmers is slow as molasses
      - software built by non-programmers for programmers is never executed!

      --
      -Billco, Fnarg.com
  8. Like a car... by fiftysixquarters · · Score: 4, Interesting

    Seriously, this analogy makes sense. When a car is cruising on the high way it's able to maintain speed using 4/8 cylinders. Servers could be cycled in a similar fashion. Do you really need 20 web servers running at 3 am on a Sunday?

    1. Re:Like a car... by Yvan256 · · Score: 4, Insightful

      If it's a website, it's international, wether or not the actual products and services are available internationally.

    2. Re:Like a car... by compro01 · · Score: 3, Insightful

      Excepting google and such, I doubt that the vast majority of servers would have such a geographically balanced workload.

      --
      upon the advice of my lawyer, i have no sig at this time
    3. Re:Like a car... by Dr+Caleb · · Score: 4, Funny

      Hola Señor.

      Me gusta lo que dices, y estoy interesado en suscribirse a su boletín informativo.

      --
      "History doesn't repeat itself, but it does rhyme." Mark Twain
  9. Simple Answer by jcnnghm · · Score: 4, Insightful

    When you're sure you don't need it to come back up.

    --
    You don't make the poor richer by making the rich poorer. - Winston Churchill
  10. Not often by nine-times · · Score: 4, Insightful

    How many of us have servers that don't need to be live? Yeah, I guess there might be a development server, but that assumes that you're not developing. There could be a failover server that does nothing when the primary hasn't failed, but in that case you'd want to be damn sure that the failover will come online without difficulty when it needs to.

    It seems to me like it would be a pretty rare case when this is applicable. I'd sooner be interested in asking, can they build servers that can selectively power down subsystems that aren't currently in use, sufficiently enough that there's no serious harm. For example, I'd consider putting some of my fileservers' hard drives to sleep over night, but I'd still want the server to be available and the drives to spin back up if I log in from home and need access.

    Mostly, I'd say that if you have servers that you don't need to be live, you might not be using your servers efficiently. It may be worth looking into setting up some kind of VM server with various images that can be brought up on command. But hey, if you do have a server that you can turn off without causing problems, go for it.

    1. Re:Not often by CFTM · · Score: 3, Interesting

      Uh I am the administrator of a server that archives all email for our company. We no longer use this solution for our email archiving, but according to federal regulations this email needs to be accessible for at least another 26 months. The only people who use the server anymore are the various alphabet soups of regulators who came in twice a year, maybe I'm the exception but not the rule but I can't see a reason to keep the server on...

  11. Power Management by Super_Z · · Score: 3, Interesting

    Powering down your servers tends to introduce response issues. :-)
    Some servers, like the HP ProLiant line, has power management features. Try experimenting with features like these first.

  12. Re:Well... by csnydermvpsoft · · Score: 5, Insightful

    What kind of UPS does that? If the batteries are already charged, what would it be doing with the power that's not consumed by the devices - does it also act as a space-heater?

    The ratings for UPS's - and any other power supply - are peak loads, if the UPS is being used at 100% capacity.

  13. XenServer by Obsession12 · · Score: 4, Interesting

    Full disclosure, I work for Citrix. Check out XenServer, which can remotely provision server workloads to virtual and bare metal machines - based on load, you can remotely power up resources as needed. I have seen the future, and it is awesome. And green.

    --
    Atari, System V, C64, Amiga, College Unix (?, I wasn't like root or nothin'), Mac, WinNinetySighs, NT, Novell, Win2K, So
  14. Wrong way round by symes · · Score: 4, Insightful

    My guess is that managing energy consumption by powering down servers is the wrong way round - there seems to be a fair bit of interest in developing hardware that manages it's own energy consumption without loss, either in additional power to bring it back up to speed or in processing lag, etc. Of course, this doesn't address the poster's immediate concerns to which I have little to add other than it's probably good to cost in heightened risks of hardware failure and therefore the costs of unscheduled downtime.

  15. Some criteria by Colin+Smith · · Score: 3, Informative

    1: Can your service be load balanced across several identical servers?
    2: Does your services experience predictable but varying load?
    3: Can the state used by your service be rapidly replicated (10 minutes) across newly booted systems?

    Not all server systems make good candidates for shutdown. Web farms do tend to because they fit the criteria above.

     

    --
    Deleted
  16. PSU failures by blind+biker · · Score: 4, Informative

    The problem is the PSU, which fails most often during power-up. Leaving the servers always on has the advantage of avoiding that particular failure mode. Also, other components in the server are prone to failure during power-up, way more often than at steady state. So, powering up your computers is overall a risky moment.

    --
    "The agriculture ministry is not in charge of Gundam" - Japanese ministry official.
  17. colo by donnyspi · · Score: 3, Insightful

    As long as power use is built into the fixed price I pay for the cabinet I rent at the colo, I'll never turn off my servers if I don't need to. Why would I?

  18. Re:Old gear by xaxa · · Score: 4, Interesting

    Analogy (this time, light bulbs).
    - Light bulbs fail just as you turn them on. Or off.
    - They hardly ever fail whilst switched on.

    I think servers are the same. You're in trouble if a server you've had switched on for two years and forgotten about loses power and doesn't come back up. If it'd been switched off every weekend it would have failed earlier -- but probably at a more convenient time.

  19. Re:Well... by prog-guru · · Score: 5, Funny

    (My datacenter charges about a buck a VA)

    A watt?

    --

    chris@xanadu:~$ whatis /.
    /.: nothing appropriate.

  20. Re:oh nos by Enki+X · · Score: 3, Insightful

    Power outages present a very different scenario to the system from powering things down the right way...

    --
    On second thought, let's not go to the internet. 'Tis a silly place.
  21. If they can be powered off are they needed? by aarggh · · Score: 3, Insightful

    I would think that if any servers can be regularly powered off, then they probably fall into one of two categories, they aren't really needed or they are only loaded at certain times. In both cases there's a good reason for consolidation, whether it be physical or virtual. obviously virtual gives the best bang for buck. I run several ESX clusters and despite dept's not trusting virtual servers, they all come around in the end. I think virtuals really are the only way to go to really save money, space, power, and the all important UPS load. Don't forget, the myth about hard disks dying after they have been running for a long time and then allowed to cool after a power failure, well that myth isn't a myth, it happens, and it happens a lot.

    I cannot think of situation where powering off a server that is needed provides any benefit whatsoever, you might save a few dollars, but as we all know when you're IT dept struggles to get budget for anything, the risk of failure and the HUGE costs associated with that far outweigh ANY power savings you might achieve.

    I don't give a rat's arse if powering off a few minor servers saves $100 a month, when if the disk dies after it cools down, and I then have to go into repair mode to find out what peculiar apps were installed on the server, somehow scrounge another system with no budget, and then rebuild the whole damn thing, only to find out the developers have changed so many configurations it takes weeks or months before everything is really working as it should. Even more joy is that usually occurs at night if power is lost, as we have nothing better to do anyway. NO THANKS!

    For companies who have massive budgets for IT, and routinely swap out hard disks, etc, maybe that would work, most companies I know and have worked for over the years though tend to view IT as a parasitic loss centre run by people who spend there days watching the blinkety lights and having fun, "it's just a bunch of servers, how hard could it be" or "how much money could they need, I can go the PC shop and get a whole quad core rig for $600!"

    But I will say, nothing gets Capital Exp forms signed faster than a major downtime!

  22. Well the most obvious use for power down.... by 3seas · · Score: 3, Funny

    ... is with electronic voting servers, to force paper ballots and more accurate counting.

  23. Re:Well... by babyrat · · Score: 3, Funny

    I personally think a buck for a Virginia would be a great deal.

    On a side note, that seems pretty pricey for a watt - turning on my blow dryer in the morning would cost me $1500 where you live. I'd have to go to work with wet hair everyday.

    Ooooh - I could instead use solar energy to dry my hair (stand outside in the sun for a while). Green is good!

  24. Re:Old gear by LeafOnTheWind · · Score: 3, Interesting

    Light bulbs fail when they're turned on because there's a warmup spike as the electricity flows through the wire. This causes the tungsten to heat up more than it will when the circuit is complete, and break the circuit.

    If your lightbulb fails it's because the filament has worn down - it's just that you usually find out about it when you turn the light bulb on or off.

    Also, your analogy means nothing. Servers are nothing like light bulbs.