Price of Power in a Data Center

mstansberry writes "Much like the rest of the country, IT is facing an energy crisis. The utilities are bracing companies for price spikes this winter and according to experts and IT pros, those prices aren't going to come down any time soon. This is thefirst article in a four-part series investigating the impact of energy issues on IT."

Comments

Hot Intel chips are big contributor

[Hulkster]

I think "crisis" is a bit sensational, but yea, power is a concern and it ain't getting any cheaper. This is certainly not helped by the power consuming (and heat generating) hot chips from Intel. Note that you have to pay for that "twice" since for every BTU they consume in electricity, you have to cool it in a data center. Ironically, Part 1 does not even talk about how the CPU itself is a big issue here ... maybe they'll cover it in the rest of the series. Speaking of which, wouldn't it be better for stuff like this to wait until the series is over before posting on Slashdot?

P.S. The submitter has a nice fishing web site and is holding about a 12" trout on his main page. Nice catch ... but I'd recommend he go on a fishing charter in Seward Alaska if he wants to catch some mongo fish. This trip was a major slayfest and my brother was Captain Crudd who knows how to fish with a beer in his hand.

Re:Hot Intel chips are big contributor

[Jeff DeMaagd]

The cooling expense isn't as bad as the heating. I think the theoretical efficiency of cooling is 10% of the heat to be removed, where it would take 100W to remove 1000W of heat. In practice, it is about 30%, so it's not as bad as some people think.

One thing I am skeptical of is the need to cool to like 60 degrees F that I've heard (and felt in one room). Good cooling is nice, but I know one guy that says they don't ever see problems until the temperature is above 80F, so businesses can save a lot by not being so freaking cold.

Re:Hot Intel chips are big contributor

[Rei]

I saw a speech recently from the director of NCAR, Tim Killeen. NCAR does advanced climate change modelling. According to his speech, they know pretty much every factor now that has a relevant effect on global climate; their only limitation that they are aware of is processing power and data storage. As such, their computing requirements are growing notably faster than Moore's law.

Their current power bill is 40,000$/mo. At their new facility (you can see a design of it in this document), it will be far more. Most of the building will be for computers and associated equipment; the building is being largely designed for dissipating all of the heat. I recall he said it was to consume about 3 MW, so at 0.8 cents/kWh, that would be about 175k$/mo.

As an aside, it was a really fascinating presentation. They showed *their* model of Katrina (which was presented to the White House as an "experimental product"); it was spot on. Very impressive stuff indeed. At one point I asked him about proposed methods to induce global cooling such as dumping iron into iron-deficient waters. He stated that while he hadn't modelled that, their models already take into account natural mineral influxes and their effects on bacteria populations (and thus, the effects of those bacteria on the environment), so they could model that if they needed to. He also pointed me to some newer Vostok core data :)

Re:Hot Intel chips are big contributor

[demigod]

One thing I am skeptical of is the need to cool to like 60 degrees F that I've heard (and felt in one room). Good cooling is nice, but I know one guy that says they don't ever see problems until the temperature is above 80F, so businesses can save a lot by not being so freaking cold.

I always considered that as buffer for when you loose one of the AC units. That way if it takes all day to get it fixed, your only up to 80F and still OK.

Re:Hot Intel chips are big contributor

[GMFTatsujin]

At what point do the heat effects of their computers get folded into the climate simulation parameters themselves?

Re:Hot Intel chips are big contributor

[Tiger4]

That depends on the room and the equipment. A single small box ins a large room might take all day, or all week to heat it up to 80F. On the other hand, a lot of boxes in a small room might jump to 80F within minutes of losing the cooling. There is no substitute for good engineering. Do the calcs and set it up right.

And virtualization may be the answer

[gtrubetskoy]

We have a page on our site with some calculations on how much energy is being saved because we're using Linux VServer and why dedicated servers are not environmentally-friendly (at least not with the current technology - this may change). The numbers are probably off a bit, but they give you some idea.

Also the street price for a 20A circuit in a datacenter is $200-$300, while the cost of a megabit is $100 or less. So a rack of servers that requires two power circuits and pushes 3Mbps (not an unusual scenario) costs twice as much in power than in bandwidth.

And here's another article on this issue. And another.

Energy price predictions

[grqb]

Energy prices are going to hurt everybody.

From here:
"EIA expects energy expenditures will be 18% higher this winter compared to last winter, which will be 8.3% of the annual gross domestic product, a record since 1987 when it was 8.4%."

And for those of you who want to find a way to save energy: Here's 60 Tips To Save Energy This Winter

Yeah, but at least you won't have to

[Tavor]

Run the heat in the winter with Intel chips! Just do batch-processing, or some intense rendering work.

Moore's law?

[ChrisGilliard]

"It's the other side of Moore's Law," Sneider said. "As the cost of [buying] these machines decreases, the cost of powering and cooling them increases."

I don't agree with this. How power efficient was Eniac? Also, my laptop lasts much longer the one I had a few years back. I think we're making progress on the power front, but the demand for computing power is attracting more and more dollars, the power cost is largely insignificant with regards to the return on investment.

Re: Linux and power management

[grqb]

I bought myself a watt meter to measure the power of some of my home electronics. So I tested my friend's laptop, it was a Dell, 15 inch monitor P4. Under linux the laptop was drawing 50-100watts (which is very high for a laptop), under windows it was drawing from 30-50 watts. Linux on desktops has the same power management as windows on desktops though.

Re:Unctuous

[mc6809e]

Oil still costs about $15 to pump out of the ground,

What a bunch of bullcrap. The cost of pumping oil varies from well to well. Sure, it might cost Saudi Arabian Oil Company $15 per barrel, but if they only release enough oil for half the world's demand, other producers have to fill that supply. It can cost those other suppliers much more to pull oil out of the ground. And that high price is going to lift the market price.

but instead of the $25 price before we invaded Iraq, it's pushing $70+ as a "permanent high". Maybe Congress and the White Hosue can exercise some accountability for their totally failed energy policies (including sending us to war) by stopping the price gouging the oil corporations are abusing us with.

Oh really? So they're just going to tell Saudi Arabia or Venezuala to lower their prices? How are they going to force them to do that? Oh, you mean force American Oil companies. Well here's a clue: American oil companies are bench-warmers in the global oil market. The biggest American company, ExxonMobil, ranks just 16th in the world in total reserves. They control about 2% of the worlds oil. Hell, even Petronas, a Malaysian company, is bigger than America's biggest oil company.

And looking at the table you see that the market is dominated by state-owned, national oil companies like Saudi Arabian Oil Company, and Petroleos de Venezuela. The only way you're going to lower the price they charge for oil is to invade and force them. Otherwise they'll sell their oil to the highest bidder.

I know those corporations are their best bribers^Wcontributors, and their foreign sources are our best traitors^Wallies, but Americans will vote on the entire House of Representatives and 1/3 of the Senate in elections next year. We might be willing to put up with a lot of BS on faith, but there's no denying we're not getting the spoils of all of our "superpower" status.

So your complaint is that Bush hasn't invaded enough countries yet to lower oil prices. Interesting.

The fact is state-run foreign oil companies set the price for oil. There is very little the government of the USA can do about it aside from rushing in with tanks to take their oil fields. Any kind of price control on this oil would mean it would get sold to someone else at a higher price, like the Chinese, for example.

Leading Oil and Gas Companies Around the World

Rank by 2004 Oil Equivalent Reserves Company Worldwide Liquids Reserves, Million Barrels Worldwide Natural Gas Reserves, Billion Cubic Feet Total Reserves in Oil Equivalent Barrels, Million Barrels
1 Saudi Arabian Oil Company (Saudi Arabia) 2,3 259,400 234,500 299,485
2 National Iranian Oil Company (Iran) 2,3 125,800 940,000 286,484
3 Qatar General Petroleum Corporation (Qatar) 3 15,207 910,000 170,763
4 Gazprom (Russia) 0 988,892 169,041
5 Iraq National Oil Company (Iraq) 2,3 115,000 110,000 133,803
6 Abu Dhabi National Oil Company (UAE) 3 92,200 196,100 125,721
7 Petroleos de Venezuela.S.A. (Venezuela) 3 78,998 149,891 104,620
8 Kuwait Petroleum Corporation (Kuwait) 3 99,000 55 99,009
9 Nigerian National Petroleum Corporation (Nigeria) 2,3 35,255 176,000 65,340
10 National Oil Company (Libya) 2,3 39,000 52,000 47,889
11 Sonatrach (Algeria) 2,3 11,800 160,500 39,236
12 OAO Lukoil (Russia) 23,215 39,089 29,897
13 Petronas (Malaysia) 5,290 85,200 19,854
14 PetroChina Co. Ltd. (China) 10,941 44,554 18,557
15 Petroleos Mexicanos (Mexico) 14,803 14,807 17,334
16 ExxonMobil Corporation (United States) 8,395 31,843 13,838
17 BP Corporation (United Kingdom) 5,775 46,650 13,729
18 Egyptian General Petroleum Corp. (Egypt) 2 3,700 58,500 13,700
19 OAO Yukos (Russia) 10,950 7,800 12,283
20 Petroleo Brasilerio S.A. (Brazil) 2 9,945 11,247 11,868