Slashdot Mirror


Google Demands Higher Chip Temps From Intel

JagsLive writes "When purchasing server processors directly from Intel, Google has insisted on a guarantee that the chips can operate at temperatures five degrees centigrade higher than their standard qualification, according to a former Google employee. This allowed the search giant to maintain higher temperatures within its data centers, the ex-employee says, and save millions of dollars each year in cooling costs."

40 of 287 comments (clear)

  1. Is this possible? by CRCulver · · Score: 3, Insightful

    Wouldn't Intel run into physical limitations that simply don't allow chips to run at that low a temperature? I'm surprised Google isn't considering moving some of its data centres to Arctic locations where you get cool temperatures year-round. We've seen reports of appealing places like that on Slashdot before. (Of course, that would just be a short-term fix before we move the Earth to a farther orbit around the sun to avoid suffocating in our own waste heat like the Puppeteers in Niven's Ringworld ).

    1. Re:Is this possible? by Thelasko · · Score: 5, Insightful

      Wouldn't Intel run into physical limitations

      Google is most likely getting the best chips out of Intel's standard production. It's akin to sorting out the best bananas at the grocery store. This sort of privilege happens when you buy enough products from a supplier.

      If they were demanding much more than 5 degrees then I would say they are getting custom made chips, but I don't think that's the case.

      --
      One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    2. Re:Is this possible? by onitzuka · · Score: 4, Interesting

      WI'm surprised Google isn't considering moving some of its data centres to Arctic locations where you get cool temperatures year-round.

      There is no reason to be surprised. It is cheaper to not move the data center to where it is colder and just make all upgraded hardware use the new chips. Google's budget calls for hardware upgrades already. Upgrading to CPUs with higher temp tolerances would mean they pay the same $X-thousand for the box they would anyway and simply turn the thermostat up.

      A net savings.

    3. Re:Is this possible? by Ngarrang · · Score: 4, Informative

      I'm surprised Google isn't considering moving some of its data centres to Arctic locations where you get cool temperatures year-round.

      Don't kid yourself. They probably have. But then, who did you get to work at what would probably be a very remote location?

      Additionally, such remote locations may suffer from not enough bandwidth and/or electricity.

      --
      Bearded Dragon
    4. Re:Is this possible? by Zocalo · · Score: 5, Interesting

      Two words: "Free Cooling"

      The greater the difference between your data centre's output air temperature and whatever passive external cooling system you are pumping it though, the more heat you can dump at zero cost. That's monetary cost as well as the cost to the environment through the energy "wasted" in HVAC systems and the like. Google has a PUE (Power Usage Effectiveness; the ratio of power input to power acutally used for powering production systems) approaching 1.2 vs typical values of around 2.5-3.0 - Microsoft is around 2.75 as I recall - so they are clearly doing something right.

      --
      UNIX? They're not even circumcised! Savages!
    5. Re:Is this possible? by iminplaya · · Score: 5, Funny

      I'm surprised Google isn't considering moving some of its data centres to Arctic locations where you get cool temperatures year-round.

      Oh yeah! And completely melt the ice cap.

      --
      What?
    6. Re:Is this possible? by jimicus · · Score: 4, Insightful

      Wouldn't Intel run into physical limitations that simply don't allow chips to run at that low a temperature? I'm surprised Google isn't considering moving some of its data centres to Arctic locations where you get cool temperatures year-round.

      Are you serious? Neither the Arctic nor the Antarctic is well known for reliable power or fast Internet connections.

    7. Re:Is this possible? by terraformer · · Score: 3, Insightful

      Two more words, uncontrolled humidity.... Yes, there are efficiency gains to be had everywhere, but none of them are free, only less costly as in bringing in moist outside air will require that air to be dehumidified, at a cost obviously. If you go with a heat exchanger, the amount of cooling decreases significantly and so you need more of them, and each one DOES require energy to operate (aka; move air/liquid/whatever through).

      --
      Who are you? The new #2 Who is #1? You are #617565. I am not a number, I am a free man! Muhahaha.
    8. Re:Is this possible? by Intron · · Score: 5, Funny

      It also takes longer to boil ramen.

      --
      Intron: the portion of DNA which expresses nothing useful.
    9. Re:Is this possible? by Dr.+Manhattan · · Score: 3, Interesting

      This happens with resistors, too. If you want one within 5% of the nominal ohmage, you pay more. If you want want one within 10%, you pay less, but you'll find that they're all either about 10% low or 10% high, with a 'notch' in the center of the distribution. Same production process used, but they skim off the 'good ones' and charge more for them.

      --
      PHEM - party like it's 1997-2003!
    10. Re:Is this possible? by thermian · · Score: 3, Insightful

      If you had say, a town sized data centre installation, it would probably have about the same effect as a smallish and partially active volcano, of which there are many in northern latitudes. Pretty much nothing apart from local effects, which is, in spite of the green crazies rantings, not too bad, not compared to the alternatives.

      What you wouldn't have is as much need for additional power to cool, which of course saves the pollution caused by its generation. You should bear in mind that the colder parts of the Earth are being far more seriously effected by polutants in the atmosphere then by anything which is just warmer than its surroundings.

      As for why I said green crazies. Well if they hadn't been so all fired determined to put governments off nuclear power, we'd have that instead of all these coal burning plants. Now we have massive pollution problems and a truly gigantic cost for building all those nuclear plants in a shorter time, instead of gradually over the last three or four decades.

      --
      A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
    11. Re:Is this possible? by Thelasko · · Score: 4, Interesting

      Legend has it that the Celeron processor began its life as a way for Intel to make money off of the Pentiums that didn't pass quality control. If they sell the low performing processors at a discount, why shouldn't they sell the over performing ones at a premium?

      --
      One of our competitors trademarked the term "hypothesis". From now on, we will call them "boneheaded ideas".
    12. Re:Is this possible? by TheRaven64 · · Score: 5, Informative

      It's not just the celerons, its most CPUs. A modern CPU is quite big and contains a lot of components that aren't essential to the operation of the chip. If you disable these, you have a slightly less good chip without the engineering cost of designing a entirely new die layout. AMD takes this to extremes. Their Opterons have 4 cores, three hypertransport connections and a load of cache. If there is a manufacturing flaw in the cache, they are sold as a model with less cache. If it's in the cores, then they are sold as three, two, or single core chips. If it's in the HT controllers then they only support 2- or 4-way multichip configurations. Intel's 486SX line was just a 486 (later renamed the 486DX) where the FPU didn't work.

      --
      I am TheRaven on Soylent News
    13. Re:Is this possible? by interstellar_donkey · · Score: 3, Funny

      Right. Those polar bears, if given the chance, would rip you to shreds, eat your body and then climb into the oh-so-warm data center to hunker down for hibernation.

      My brother was a sysadmin in Alaska and a polar bear did exactly that, you insensitive clod.

      --
      The Internet is generally stupid
    14. Re:Is this possible? by mzs · · Score: 4, Informative

      What was even weirder was the i487SX. This was a i486DX with an extra pin. If you had a i486SX system and wanted a FPU you bought the i487SX and plugged it in. Then during boot the i486SX was disabled and the i487SX was used for everything.

    15. Re:Is this possible? by Phroggy · · Score: 3, Interesting

      You are correct, or it may not cook correctly at all at the lower temperature even with more time. For example, if you want to boil rice in Guatemala City, you have to sautee it first.

      Damn Slashdot's broken Unicode support. There should be an accent in there.

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    16. Re:Is this possible? by jonaskoelker · · Score: 4, Funny

      Intel's 486SX line was just a 486 (later renamed the 486DX) where the FPU didn't work.

      Mod parent +5.0000000018623, Informative

  2. Underclocking if you're poor? by Junior+J.+Junior+III · · Score: 3, Interesting

    If you don't have the clout of a Google-sized organization to buy higher-rated chips from Intel, I wonder if you can basically achieve the same thing by underclocking. An underclocked chip will run cooler, but I don't know if it'll run more stably at higher temps, although I think it would.

    Does anyone have any experience with doing this?

    I think it'd be interesting to see whether the cost savings in power and cooling is offset by the cost of the performance losses.

    --
    You see? You see? Your stupid minds! Stupid! Stupid!
    1. Re:Underclocking if you're poor? by LaminatorX · · Score: 3, Informative

      In the past, I've under-clocked primarily for noise benefits. Lower clock->lower temp->slower fam RPM->lower dbSPL.

  3. Waste Heat reclamation by LaminatorX · · Score: 4, Funny

    When in college, I heated my crappy little schack by putting 150W bulbs in every light. It was like my own little Easy-Bake oven.

  4. Re:Environmental impact by LWATCDR · · Score: 4, Insightful

    Not really.
    No matter how cool the chips run they will put out heat. If you have two chips that run at X and use Y watts you will save power if you can run them a little hotter and use less power for cooling.

    --
    See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
  5. Re:Environmental impact by Rogerborg · · Score: 3, Interesting
    Ideally, yes. And ideally, I'd come home to find Alyson Hannigan oiled up and duct taped to my bed.

    Pragmatically, if they can't run cool, then it's more efficient to run them hot than to spend more energy actively cooling them.

    --
    If you were blocking sigs, you wouldn't have to read this.
  6. Re:Environmental impact by I.M.O.G. · · Score: 5, Insightful

    I'm not sure what your getting at - if by doing this they are saving millions in cooling expense, they are certainly using less energy. What is "going green" if it isn't energy conservation? The fact that the conservation comes from less work for their AC units rather than efficient little processors is immaterial.

    Don't expect any company to do things because its right - but good companies will find win-win situations where they cut costs and do things to "Go Green".

  7. Re:Environmental impact by gstoddart · · Score: 3, Insightful

    Seems that google's not really thinking green in this case (despite the pretension to do so in others), unless they plan on making use of the datacenter heat elsewhere.

    The amount of energy you need to use to cool that stuff is quite significant. And, in case you haven't realized it, generating cool air also create more warm air, it's just not in the data center. It's usually vented right outside.

    If the chips could run hotter, they'd have to use less energy to cool the data center, and generate less waste heat from that very cooling in the first place.

    I'm not convinced that what they're asking for isn't a good idea.

    Cheers

    --
    Lost at C:>. Found at C.
  8. WTF? Lawyers as engineers, not so much by Ancient_Hacker · · Score: 3, Informative

    This sounds like a scenario where lawyers are trying to act as engineers. That works about as well as you might expect.

    There are these engineering things, amusingly called "Schmoo plots", that map out a chip's operating envelope of voltage versus speed versus temperature. From those an engineer can forsee how hot you can run a chip before its rise and fall time margins start to get marginal.

    There is very little Intel can do to stretch thing by another 5 degrees. It's not something that can be imposed by fiat. Intel engineers have already juggled all the variables to come up with the best performance possible. SOMETHING is going to have to give. Either the chips will have to be selected and graded for speed, lowering the overall envelope for the chips everyone else gets, or they'll have to fudge some other parameters, hoping nobody will notice, or worse yet they'll tweak some variable right to the edge of raggedness, resulting in worse reliability down the road.

    Lawyers and accountants generally don't know you can't have everything. let's hope the engineers educate them.

  9. Re:No one mentions a more obvious approach. by SoupIsGoodFood_42 · · Score: 3, Insightful

    That means you'd need to make up for the lack of processing power with additional CPUs, which would mean more CPUs to cool.

  10. Re:Not too surprising by stilwebm · · Score: 5, Insightful

    "Guarantee us a higher temp CPU or we will switch to AMD...and tell everyone about it."

    That's not really how the negotiation goes in this type of situation where there are two major supplier choices (AMD and Intel) and Google is a relatively small customer when compared with Dell, HP, IBM, etc.

    In all likelihood, the negotiation is more of a partnership where both parties work together to create value. Google says, "We buy thousands upon thousands of your chips, but we also pay millions of dollars annually to cool them. We'd be willing to pay little premium and lock in more volume if you can help us save money by increasing the temperature inside our data centers." Google has done the math and comes prepared with knowledge of how much those specs can save them and forecast of chip need of the next 12-18 months, and the two work together to create value. For example, Google might offer to allow endorsements (as they did with Dell for their Google appliances) in exchange for favorable pricing and specifications.

    The "do this or I'll switch" tactic only works well when there are many suppliers and products are relatively undifferentiated, like SDRAM or fan motors.

  11. Re:WTF? Lawyers as engineers, not so much by mindstrm · · Score: 5, Insightful

    Odds are this is being driven by a data-center engineering team, who are looking at the cost savings of running their data center 5 degrees hotter.

    You don't get what you don't ask for.

    Intel will do exactly as much engineering as necessary to keep their target market up, and no more.

    If the market wants chips that operate 5 degrees hotter.. the engineers will do their job and see if it can be done. Intel will charge a premium for this.

    That's business.
     

  12. Are they saving MILLIONS? by hackus · · Score: 5, Interesting

    Most of the power supply systems for my servers, which are HP G3-5 systems of various U sizes, tend to waste more power as temperature goes up.

    This has nothing to do with CPU's though. It is the power supplies on the machines. As temperature goes up, efficiency goes down. At around 80 degrees I noticed a significant larger draw on the power supply with my amp meter.

    I had a gaming system with two ATI 4870's and the 800 Watt power supply would crash my machine if I did not run the air conditioner and keep the room at 70 degrees after some fairly long Supreme Commander runs.

    I noticed that the amperage would go up, and the power output would go down as temperature would go up.

    I have not conducted any experiments in a lab setting with this stuff, but from experience, jacking the temperature up usually makes power supplies work harder and makes them less efficient.

    -gc

    --
    Got Geometrodynamics? Awe, too hard to figure out? Too bad.
  13. But they pass it off to someone else by Moraelin · · Score: 5, Insightful

    Yes, but way I see this is:

    Intel isn't arbitrarily going, "man, we could make chips that run ok 5 degrees hotter, but we're gonna piss everyone off by demanding more cooling. Just because we can." Most likely Intel is already doing the best it can, and getting a bunch of chips which vary in how good they are. And they're getting the same bunch of chips regardless of whether Google demands higher temps or not.

    Google just gets a cherry-picked bunch, but the average over Intel's production is still the same. Hence everyone else is getting a worse selection. They what remains after Google took the best.

    It's a zero-sum game. The total load on the planet is the same. The same total bunch of chips exits Intel's fabs. On the total, no energy was conserved.

    So Google's "going green" is at the cost of making everyone else less "green". They can willy-wave about how energy efficient they are, by simply dumping the difference on someone else.

    That's not "going green", that's a predatory approach. Your computers could require on the average an extra 0.5W in cooling, so Google can willy-wave that theirs uses 1W less. They just dumped their costs and their "eco burden" to someone else.

    It's akin to me willy-waving that I'm so green and produce less garbage than you... by dumping some of my garbage in random other people's garbage bins across the town. Yay, I'm so green now, you all can start worshipping me. Well, no, on the total the same amount of garbage being produced, I just dumped it and the related costs on other people. That's not going green, that's being a predator.

    I can see why a business might want to cut their own costs, and not care about yours. That's, after all, the whole "invisible hand" theory. But let me repeat it: on the whole no energy was conserved. They just passed off some of their cooling costs (energy _and_ money) to someone else.

    --
    A polar bear is a cartesian bear after a coordinate transform.
    1. Re:But they pass it off to someone else by Muad'Dave · · Score: 5, Insightful

      I agree with most of what you said, but I think there is a _slight_ difference between Google having the higher-temp-rated chips and your average Joe user having them. Google's chips will be running full throttle/full temp 24/7; Joe user might run them full blast (and therefore full temp) 2% of the time. I bet the energy savings are not insignificant when usage patterns are taken into consideration.

      --
      Tiller's Rule: Never use a word in written form that you've only heard and never read. You will end up looking foolish.
    2. Re:But they pass it off to someone else by nabsltd · · Score: 3, Interesting

      Google's chips will be running full throttle/full temp 24/7

      Is there any documentation for this?

      I seriously find it hard to believe that Google has every processor they own running 24/7 at 100% utilization. Other than the computation problems like SETI and protein folding, most problems are I/O bound, and I would think that the stuff Google does would involve a lot of I/O.

  14. Re:Environmental impact by moderatorrater · · Score: 5, Funny

    And ideally, I'd come home to find Alyson Hannigan oiled up and duct taped to my bed

    You know you're pathetic when they're even unwilling in your fantasies.

  15. Re:higher chip temps??? by OneSmartFellow · · Score: 4, Insightful

    They are not asking for the chips to be made to produce more heat, they're demanding that Intel guarantee that the chips will still perform, even if operated at a higher than specified max operating environment temperature.

    You would be forgiven for thinking it makes more sense to for Google to insist that the chips produce less heat, rather than that they will still operate in extreme temperatures, since the majority of the cooling cost come from dissipating the chip heat from the enclosed space. But hey, it's Google, they do things a bit different.

  16. Re:Environmental impact by Surt · · Score: 5, Insightful

    And ideally, I'd come home to find Alyson Hannigan oiled up and duct taped to my bed

    You know you're pathetic when they're even unwilling in your fantasies.

    You're assuming everyone prefers them willing.

    --
    "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
  17. Re:But they pass it off to someone else - WRONG by MadCow42 · · Score: 4, Insightful

    >> So Google's "going green" is at the cost of making everyone else less "green". They can willy-wave about how energy efficient they are, by simply dumping the difference on someone else.

    The difference is that Google is going to actively exploit the ability of those hand-picked CPU's to run hotter. Chances are that the users who would have otherwise received those chips would not reap any energy savings from the capabilities.

    At a minimum, Google is contributing here by forcing a vendor to differentiate chips that have a capability of running hotter from ones that don't. No matter who uses that capability, it's a benefit to the planet (versus the alternatives at least).

    MadCow.

    --
    I used to have a sig, but I set it free and it never came back.
  18. But heat also affects... by invalid_account · · Score: 3, Interesting

    Hard disks. In fact, I am typically far more concerned with long-term issues with my data than with the computing itself. Not to mention, the CPU is NOT the only chip that can suffer from heat issues.

  19. Higher operating temp by bperkins · · Score: 3, Informative

    There are two issues with higher operating temp.

    One is that you get less drive current from your transistors, so you get less performance (which everyone seems to understand), but this is usually a fairly small effect for 5 degree C.

    The _big_ deal with 5 degree C would be electromigration in interconnect metal, which goes up very quickly with temperature. So the difference in failure rates might be quite large.

    If there was any deal at all, it's likely that the Intel engineers tried to remove some conservatism from their temperature estimates to see if they could squeeze out 5 degrees from the thermal budget, or perhaps information on the workload itself to get Intel to "bless" the higher data center temperature.

  20. Re:good. by OrangeTide · · Score: 3, Insightful

    What? American businesses like saving money almost as much as they like making it. It's environmentalism is not as a big motivator as profit, at least in the US. Make being efficient profitable long term, and some businesses will do it. Make it profitable short term and businesses will fall over one another to do it.

    --
    “Common sense is not so common.” — Voltaire
  21. Re:No one mentions a more obvious approach. by Henneshoe · · Score: 3, Funny

    What they should do is get the processors to run at 100 degrees C. Then they could use the heatsinks to boil water, the steam to turn a turbine and the turbine to generate electricity. It would be somewhat like the turbocharger for your car.

    Slashdot Post Checklist
    Bad Car Analogy - Check
    Spelling Errors - Check
    A solution that won't work in real world - check
    Reply to a comment on top 10% of page so people read yours - check