Slashdot Mirror


Generator Delays May Slow Data Center Projects

miller60 writes "The data center building boom is causing backlogs for new generator orders, with some companies reporting delivery delays of up to a year for new 2,000kw units, which are the current standard for mission-critical facilities. Generator availability is 'the No. 1 thing that will drive your construction schedules,' according to Equinix, which is building centers in three major markets. 'This will be a big issue for the next wave of data center builds,' says another industry executive. Used generators and smaller units tend to be more available than the 2 megawatt units, but companies targeting the enterprise sector may be wary of relaying on used units or smaller generators than those powering competing facilities."

18 of 257 comments (clear)

  1. 2 MEGAwatts?!?! by AKAImBatman · · Score: 4, Funny
    "Generator lead time for a nice 2 megawatt diesel engine is now up to a year for one generator," Josh Snowhorn of Terremark said in a panel at the NANOG conference earlier this year.

    HOLY MOLY, that's a lot of power! If you had 250 watt power supplies, all running at maximum, you'd be able to power 8,000 power supplies simultaneously! You could run a small town on a generator that large! Or to put it another way, you could use it to power a Diesel Locomotive capable of pulling dozens of fully loaded cars.

    Wow, just wow. That's just an incredible amount of power to be putting in a datacenter. Is it even possible for these centers to run off the grid?

    "So we can build all the raised floor we want, and then sit around and wait six months for a generator."

    The part that I don't undestand is this: Why do they need just one generator? If you're having difficulties obtaining a 2Mw unit, wouldn't it make sense to get two smaller units? You'd waste a bit of extra space, but you'd have redundancy that a single genearator couldn't offer.
    1. Re:2 MEGAwatts?!?! by CastrTroy · · Score: 3, Insightful

      Why don't they just go find an old diesel locomotive and convert that into a generator? Or get a really big diesel truck. A diesel generator isn't much more than a diesel engine. I see opportunities here for new manufacturers.

      --

      Anthropic principle: We see the universe the way it is because if it were different we would not be here to see it.
    2. Re:2 MEGAwatts?!?! by Volante3192 · · Score: 5, Informative

      Well, converting an existing engine gives you the same, if not more, concerns as getting a used generator. As TFA mentioned, there's no problem finding used 2MW generators, but it's the stigma of using used equipment period.

      Add to that the changes and parts necessary to change engines geared to creating propulsion to engines geared to creating electricity.

      I doubt any company who considers their data center a key component of thier infrastructure to risk their backup solution on an untested refurbished generator.

    3. Re:2 MEGAwatts?!?! by jeffmeden · · Score: 5, Informative

      On your comment about data center size: Consolidation is the buzzword of the decade. 'Big boy' data centers start at 2MW and get BIGGER. It's not uncommon for a main site facility to be closer to 4MW. These are usually fed from the grid at the 14kV level, often from dual substations. Yes it's a lot of CPUs and supporting equipment, but thats the way we like em!

      Your question on two generators vs. one: Redundancy does NOT come from two half sized units doing a single job, it comes from two FULL sized units each doing half the job. Having two half sized generator units means losing one will cause failure. With a 10,000HR MTBF per unit (rough number used for demonstration) you get a system MTBF of 5,000HR, NOT what I would call redundant! You would need at least 3/2 redundancy (3 generators doing the work of 2) to have a reasonably reliable replacement for a single large unit.

    4. Re:2 MEGAwatts?!?! by megaditto · · Score: 3, Funny
      That's just an incredible amount of power to be putting in a datacenter.
      Not if your customers requires sharks with freaking laser beams attached to their heads.

      Why do they need just one generator? [...] wouldn't it make sense to get two smaller units?
      I agree. And just imagine the publicity value of having two smaller 1337 kW genenartors powering up your data center in tandem.
      --
      Obama likes poor people so much, he wants to make more of them.
    5. Re:2 MEGAwatts?!?! by johneee · · Score: 4, Funny

      Same with Hovercraft. Of course, the supply of hovercraft is quite a bit more limited than locomotives, but that's beside the point.

      Plus, you'd have to deal with all the eels.

      --
      - ------- There are ten kinds of people in the world. Those who understand binary, and those who... Huh?
  2. Easy, just buy... by DigitalRaptor · · Score: 4, Funny

    Easy, just buy 400 5kw generators instead of 1 2000kw generator.

    You may have to hire more people to start them, though. And change the oil.

    --
    Lose Weight and Feel Great with Isagenix
    1. Re:Easy, just buy... by Detritus · · Score: 5, Informative

      Then you have to keep them phased together. That can be complicated and error-prone. When you're operating on diesel power and lose a generator, the load gets dumped on the remaining generators, which can cause large frequency errors and brownouts. To put a spare generator online, you have to match frequency and phase with a system that is under severe stress. It can get ugly.

      --
      Mea navis aericumbens anguillis abundat
  3. There is a stopgap measure for this by eln · · Score: 4, Funny

    If you've built out your data center but the generators have not yet arrived, a quick and inexpensive solution is to buy several thousand hamsters and hamster wheels. These will keep your data center humming along in the event of an outage. If PETA starts protesting, sysadmins with larger wheels can be substituted. Most of them will find this activity a welcome break from the inane busywork in their everday lives.

  4. I can understand completely by hurting+now · · Score: 4, Informative

    You need to remember, its not just the computers & servers. Its the lights, the heating/AC, all other power needs. We have a generator at my work and it has to power EVERYTHING. 100 desktops 34 thin clients, 19 laptops, 34 servers, the A/C for the data center, the elevator, the emergency lighting, fire detection system, phones... you get the idea. We have a 30 KVA battery backup for the data center in case the generator doesn't kick on the right way.

    1. Re:I can understand completely by scuba_steve_1 · · Score: 3, Interesting

      I studied this topic for work this year and learned that the current data center rule of thumb is that for every watt that you spend powering a server, you must spend another watt on air conditioning...and it gets worse.

      Now, with servers getting smaller (e.g., blades) and CPUs evolving to multi-core, heat and power usage density is increasing dramatically within the same floor space...and cooling it effectively ranges between difficult and nearly impossible...without ripping everything out and starting over...which few can afford to do. Effective cooling now requires knowledge of interior meteorology (to butcher a term). Data centers now end up with weather patterns...with cold zones, hot zones, wind, plague, pestilence...and it gets worse every day.

      According to a study conducted last year by AFCOM (http://www.afcom.com ), a leading association for data center professionals, data center managers reported a 10% or more increase in power requirements during the previous year, with most expecting that number to continue to rise at a similar rate for the foreseeable future. As a result, 41% of those surveyed stated that the will be forced to upgrade their power and cooling systems within the next 36 months.

      What to do? Well...first off, exploit the hardware that you have. Google VMware...and start using those spare cycles for more virtual platforms. Secondly, stop cramming everything into small spaces...learn to expand gracefully. Otherwise, that rule of thumb is going to fail...and we'll end up spending two-thirds of our power dollar on A/C...and still end up frying hardware. Lastly, how about demanding power usage metrics from vendors when specing out servers? Power supplies installed in many servers frequently run at 65% efficiency. The result is an enormous amount of excess power used that simply generates heat, which must then be removed. Unfortunately, the industry has not yet established benchmarks for performance-per-watt expended. Start demanding that info. You'll get blank stares and cryptic answers, but let them know that it matters, That electricity doesn't come out of the wall folks...it comes from burning coal, fossil fuels, hydro, and nuclear power. We either need to get over our fear of nuclear power and our distaste for dams...or start demanding better performance.

      $0.02

  5. Suggestion by truthsearch · · Score: 4, Funny

    Take out a $10,000 simolian loan and place a natural gas power plant in a corner. It costs $9,000 simolians and produces "moderate pollution", so residential and commercial zones won't develop well nearby. But your city won't grow quickly without a lot of power.

  6. not on my project by superstick58 · · Score: 3, Informative

    I didn't see any delays on a project I am working on. We have 4 Gens in the 2MW range plus 3 gas/diesel gens in the 30MW range. Of course, this isn't for a datacenter, but I wonder if the generators would be the same.

  7. Re:DC power? by Silver+Sloth · · Score: 4, Insightful

    You can keep your generator(s) running indefinitely. Certainly longer than any predictable power outage, but if you're running on batteries you're against the clock. What are you going to do when they start to run down - nip over to the 7-11 and buy all the AAs they've got?

    --
    init 11 - for when you need that edge.
  8. Skywest Airlines can tell you... by DigitalRaptor · · Score: 4, Interesting

    I was having dinner with an IT guy from Skywest Airlines the other night and he told me in the last big power outage in St. George, Utah where they're based (and I live) their battery backups ran out quickly and there was a hardware problem between their generators and their IT department.

    The end result is that all of their servers and network equipment went out for hours, and they had to cancel a whole lot of flights costing the company well over $1,000,000.

    You can buy a lot of crappy gas generators at the Lowes across the street for $1M. I think I would have sent two guys there and two guys to the gas station to keep the essentials online.

    There is a lot to be said for redundancy. Redundancy is very important. You can't talk about redundancy enough. Seriously, it's better to be twice as redundant than only half as redundant. And three times as redundant is even better than twice!

    --
    Lose Weight and Feel Great with Isagenix
  9. Hogwash by Critical+Facilities · · Score: 3, Insightful

    Our datacenter has about 24,000 sq feet of raised floor (not huge by datacenter standards) and we have 2 x 2MegaWatt Generators (as well as redundant utility feeds). To say that 2MW is too much power in this case shows your lack of understanding of what a "MAJOR data center with plenty of redundancy" means.

    Prior to working here, I was an engineer at one of the main datacenters for a big Texas based IT provider (think Ross Perot) and their datacenter had over 100,000 sq feet of raised floor. At last count, they were up to 9 750KW generators and badly in need of more.

    While we're on it, cooling towers do not provide chilled water, they provide CONDENSER WATER, and I promise you that they would not be able to satisfy your cooling needs in a MAJOR datacenter for 2 hours in the event of a chiller failure.

    I can appreciate your being surprised at the power/cooling requirements of a datacenter, but don't let your experience at 1 "datacenter" fool you into thinking you know about all datacenters, as like most things, they are not all created equal. In truth, what is one man's datacenter is another man's "server room".

  10. Clearing up a couple of misconceptions.... by Above · · Score: 5, Informative

    I see a lot of posts that 2MW is a lot of power. Perhaps.

    There are many facilities out there with 10-30 2MW generators. I personally worked on a facility that had 18. 12 were for "critical load", that is, things fed via UPS's. This included all of the servers and networking equipment, the NOC, emergency lighting, fire supression systems and soforth. The other 6 were for "emergency load", these were things that did not need UPS protection (they could go down), just not for long. Virtually all of this load was air conditioning. So when the power went out the A/C's went off and came back 30-60 second later on generator, while the servers and all stayed up the same time.

    While big, it's far from the largest facility out there.

    Now, why would you buy one generator? Well, many buildings use bus variations (the whole N+1, or N+2 thing). So you build your data center for all 18 generators (as above), but install 6 and 3, or half the capacity. You now wait for the building to fill to 25-30%, and then start adding more generators, one at a time. However, they now have to be matched to the other generators.

    Now, why are data center generators special? Well, to switch from one AC source to another the two loads must be approximately in phase (there is some tolerance, but it's small). So in order to be able to switch between generators, switch from UPS to generator, and all that other stuff you need additional circuitry to keep the generator just so. While the engine block and generator were the same as say a diesel locomotive, there were some additional sensors, lots of additional computer control, and some additional quick start features.

    Most sites want their backup generators to be "ready to load" in 15-30 seconds. Indeed, several manufacturers make 10 second ready to load units. However that requires things like engine oil and coolant heaters that basically keep the entire motor warm 24x7x365. These are not found on industrial generators or locomotives.

    So, they really are special, high tech tight tolerance units designed to work in a system. When you connect to WoW or your other large game you're probably one one of a thousand servers run by that company, who is one of but hundreds of companies in the larger colo facilities. It's not uncommon to find 50,000 servers under a single roof. So you need lots, and lots, of 2MW generators.

  11. Well, yes and no by Flying+pig · · Score: 3, Informative
    Nobody will read this...

    Your product is interesting but there is a difference. The reason the cost per KW of engines over about 500KW starts to rise is that they are designed for very long life. Unlike gas engines, where when you get outside the cylinder size range of about 50-500cc things start to go downhill, Diesels scale to enormous cylinder sizes but, because the mean piston speed needs to be constant, power goes up as the 2/3 root of cylinder volume. Mass scales more closely to volume, so mass rises faster than output. However, the benefit is that the wear life of a larger cylinder is much greater, because it can tolerate larger amounts of linear wear before blowby becomes excessive.

    The implications are that while the cost per installed KW of your multi-engine plant is about the same as that of a single 2MW unit (because of the additional switching and control gear) it will not have the same service life and its lifetime cost per KW is higher.

    Correctly and honestly, you describe your generators as backup. But larger units in the 2MW and over range can be used as primary generators. That's the difference. As somebody else has observed elsewhere, large units can be remote controlled by electricity utilities for handling load peaks. This means that their asset utilisation can be much higher than standby generators in well designed stationary applications. The lifetime cost per KWH of a backup generator can be very high because its first cost is amortised over low running hours.

    Fact is, 2MW isn't a big Diesel. It's portable power (as used in trains and boats.) That's why supply and demand is likely to vary according to major events like earthquakes and wars.

    --
    Pining for the fjords