Slashdot Mirror


Ask Jonathan Koomey About 'Koomey's Law'

A few weeks back, we posted a story here that described Koomey's Law, which (in the spirit of Moore's Law) identifies a long-standing trend in computer technology. While Moore's prediction centers on the transistor density of microprocessors, Jonathan Koomey focuses instead on computing efficiency — in a nutshell, computing power per watt, rather than only per square nanometer. In particular, he asserts that the energy efficiency of computing doubles every 1.5 years. (He points out that calling this a "law" isn't his idea, or his doing — but it's sure a catchy turn of phrase.) Koomey has agreed to respond to your questions about his research and conclusions in the world of computing efficiency. Please observe the Slashdot interview guidelines: ask as many questions as you want, but please keep them to one per comment.

28 of 52 comments (clear)

  1. Your Take on Futurists? by eldavojohn · · Score: 4, Interesting

    What is your take on the interpretation of Futurists -- like Raymond Kurzweil -- in regards to extrapolating these 'laws' out to extreme distances?

    --
    My work here is dung.
  2. GodfatherofSoul's Law by Anonymous Coward · · Score: 1

    Find an arbitrary pattern or trend, then name it after yourself.

  3. Lets work this backwards ... by PPH · · Score: 2

    ... and see where the Babbage Engine fits on the curve.

    --
    Have gnu, will travel.
  4. Infinity w/ reversible computing? by DriedClexler · · Score: 1

    This one doesn't seem to have fundamental physical limits, so long as we eventually transition to reversible computing, in which the computer does not use up useful energy because every process it uses is fully reversible (i.e. the original state could be inferred).

    All the limits on computation (except regarding storage) that you hear about (e.g. Landauer limit) are on irreversible computing, which is how current architecture works. It is the irreversibility of an operation that causes it to increase entropy.

    --
    Information theory is life. The rest is just the KL divergence.
    1. Re:Infinity w/ reversible computing? by DriedClexler · · Score: 3, Insightful

      Sorry, the question there wasn't clear. How about "Could the whole process be bypassed by the near-infinite efficiency of reversible computers?"

      --
      Information theory is life. The rest is just the KL divergence.
    2. Re:Infinity w/ reversible computing? by vlm · · Score: 1

      Particles traveling FTL might make it necessary to redefine the laws of thermodynamics slightly.)

      Do you have anything other than a W.A.G. or am I missing something? The best argument I can come up with is maxwells demon pretty much needs to operate supersonically, using some kind of electrical design doesn't help, so operating faster than c wouldn't "help" because c is already a zillion mach number so a couple ppm more won't change the result. Everything else in the thermodynamics laws operates subsonic, way less than c...

      I do respect that an unknown cause could also have a theoretical effect on thermodynamics (smaller than we've ever been able to measure in a lab), in addition to the speedy neutrino effect.

      --
      "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
    3. Re:Infinity w/ reversible computing? by optimism · · Score: 1

      All the limits on computation (except regarding storage) that you hear about (e.g. Landauer limit) are on irreversible computing, which is how current architecture works. It is the irreversibility of an operation that causes it to increase entropy.

      No. The loss of power as heat has nothing whatsoever to do with the reversibility of computing operations.

      Power is lost (and thermal entropy increased) because of the electrical resistivity of the materials from which our CPUs are made.

      If you discover a room-temperature superconductor, please let the rest of the world know, because the researchers haven't found it yet. Bonus points if you can fabricate a modern CPU using that superconducting material.

    4. Re:Infinity w/ reversible computing? by DriedClexler · · Score: 1

      Power is lost (and thermal entropy increased) because of the electrical resistivity of the materials from which our CPUs are made.

      Right, like I said: it produces entropy because you are using a reversible process to do it -- in this case, a wire that heats up.

      Yes, it's *difficult* right now to get the computation speeds we want using only reversible processes. I didn't intend to suggest otherwise.

      --
      Information theory is life. The rest is just the KL divergence.
  5. Multicore or System on a Chip Speed bumps? by eldavojohn · · Score: 1, Interesting

    A lot of consumer grade machines have begun focusing on multicore chips with a lower frequency to provide the same or better perceived computing performance than a high frequency single core chip. What happens when a technology like this subverts our craving for higher transistor density? Can you argue that your "law" is immune to researchers focusing on some hot new technology like a thousand core processor or a beefed up system on a chip in order to improve end user experience over pure algorithm crunching speed?

    --
    My work here is dung.
    1. Re:Multicore or System on a Chip Speed bumps? by LWATCDR · · Score: 1

      I do not understand how multi-core subverts our craving for transistor density? You kind of need that to increase the core count. The comes form the lack really good tools for parallel programing.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
    2. Re:Multicore or System on a Chip Speed bumps? by onepoint · · Score: 1

      >>I do not understand how multi-core subverts our craving for transistor density

      Look I do understand what you just said but think with the herd ..

      back in the 80's ( early ), a phrase used in corporate America, it was " no on got fired for buying IBM "
      sometime is the mid-late 80's the 80386 came out, and corporate america said they had those PC's prior to them being sold to the market.
      back then it was a MHZ race

      people will no longer brag about speed, they will brag about core count, with the thinking that everyone has the same speed in the cores.

      the real race that I hope happens is when we start counting how little energy the platform uses when we get to the speed threshold.

      --
      if you see me, smile and say hello.
    3. Re:Multicore or System on a Chip Speed bumps? by LWATCDR · · Score: 1

      Well I do feel that we are at that speed threshold. Mobile will drive down power so we are are already there. I am waiting for the next big jump. There is now reason why a Tegra II could not power the average desktop pc.

      --
      See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
    4. Re:Multicore or System on a Chip Speed bumps? by onepoint · · Score: 1

      Really? I feel that the speed threshold is very near, it's not like we use all the power already that the chip can do, but the consumer will want all the extra power it can get. I think, I believe that we are nearing the start of using parallel programing so as to take advantage of all the extra cores. most likely it will be the Audio/Visual segment of the market that will create the software for it ( Game designers i am willing to bet ).

      We have seen this already done by splitting off the graphics to it's own card, back in the 80's we had intel math chips, I really am not smart enough to figure out what will be spun off the chip ? Maybe some I/O stuff, wireless stuff ... I am not even sure. But I can bet that it will change the market again.

      Who knows, maybe a nifty tablet like in star trek, note that in the shows the captain sometimes had multiple tablet's on his desk, go figure what might really happen.

      I really do hope that we get to the parallel programing stage of coding, that will utilize more of the cpu's and reduce cost over long term and should reduce the amount of energy used. But what do I know, I'm just a simple observer.

      --
      if you see me, smile and say hello.
  6. Make the curve longer. by xkr · · Score: 1

    I would like to see not only the Babbage engine on your curve, but also the abacus and slide rule. Maybe the physical Rod, too, which used to be used in surveying. (Hey, you try calculating property area using pencil, paper, and a deed.)

    --
    I will create a sig when innovation restarts in the U.S.
    1. Re:Make the curve longer. by Samantha+Wright · · Score: 1

      But... why? Those aren't even remotely comparable. What kind of energy do you suppose be measured, the amount of effort it takes to groan when someone makes a comment like this that they think is witty?

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    2. Re:Make the curve longer. by xkr · · Score: 1

      Not witty at all. Evolution is continuous. For example, one can compare energy costs backwards from nuclear, coal, back to cutting wood. People use energy ... not that hard to make an estimate for slide-rule energy costs. There used to be people who were paid to work 8-hours a day doing calculations by hand (including military ballistic tables). Why would *you* assume that tube-based computers are comparable to an IPad? The fact there there are general "rules" that appear to apply across an extremely wide range of technologies is what makes observations like Moore's Law interesting in the first place. I am an educator. You should not assume that unusual questions are inappropriate. In fact, there was a fascinating TED talk on the cost of light back through the 18th century. Why would observations on the cost of computing not be as valid an area of study as the cost of artificial light?

      --
      I will create a sig when innovation restarts in the U.S.
    3. Re:Make the curve longer. by Samantha+Wright · · Score: 1

      Koomey's law only relates to the amount of power required to operate an electronic device. The very purpose of laws like Koomey and Moore is to describe advances in electronics. While perhaps the amount of energy involved in the unwinding of the mainspring of a mechanical computer can be analysed, I think you'll find that you'd be hard-pressed to get meaningful figures for the energy involved in the operation of an abacus or slide rule—which aren't even complete calculating devices and rely very heavily on the operator's brain to yield meaningful results. It will be decades before we can definitely point to an MRI of a functioning human brain and be able to say "it took x kilojoules to work through that reasoning process"—and even then the results are still incomparable.

      I'm not typically the sort of person to dismiss unusual inquiries; in fact, I rather enjoy exploring them and finding new truths out of strange combinations of inputs. But this question is inherently bogus because pre-mechanical computers were operated in completely different ways. Transistors were direct replacements for vacuum tubes; they performed the same functions at an individual level, and the calculating machines that were made from each were equally Turing-complete. An ENIAC in the proper configuration and with sufficient memory, energy and time could conceivably emulate an iPad. Moreover, so could its components. The same cannot be said of a slide rule or abacus. They're not actually computing machines.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    4. Re:Make the curve longer. by dtmos · · Score: 1

      They're not actually computing machines.

      Well, not generally programmable computing machines.

    5. Re:Make the curve longer. by Samantha+Wright · · Score: 1

      The difference engine wasn't generally programmable, either, but we can still establish a sense of its power usage based on how much kinetic energy was required to perform its calculations. Automatic mechanical calculators are much closer to being true computers than completely manual devices like the slide rule, the abacus, or a book of trigonometric tables.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    6. Re:Make the curve longer. by xkr · · Score: 1

      OK, I concede they are not programmable. They certainly (in my opinion) should be considered computing machines. However, I left off of my "request list" both programmable analog computers and plug programmable punch card equipment. Today's engineers may laugh, but I was able to do some pretty amazing things with both of those types of hardware. You work with the tools you have.

      I don't know if these fit his proposed curve or not. I would just like to see the result of thinking about that question.

      --
      I will create a sig when innovation restarts in the U.S.
  7. Re:Obsolete idea by Superken7 · · Score: 1

    Especially in the era of cloud computing. Why does it matter? You know, even if you are not aware of it because Amazon provides you with Infrastructure as a Service, you are running virtual machines, which, wait for it: are running on real hardware :)
    And of course amazon has real limitations with how many machines can be fed on a single datacenter and how much this power consumption cost is.

    Note that power consumption can easily be 50% of the datacenter, that for every watt spent computing there is about 2.5 as much spent in infrastructure and cooling, and that power consumption costs can easily be greater than the cost of hardware itself. (Sorry, too lazy to provide citations but you can look it up, not hard to find)

    So yeah, it does matter pretty much. :)

  8. Moral/Ethical by vlm · · Score: 1

    OK J.K here is the list of moral / ethical arguments about the path we're on, as seen in your law. You saw the path clearly enough to define a time based law. Are there any issues I'm not seeing on our current path?

    1) Lower energy consumption at point of use
    2) Higher energy consumption at manufacturing point
    3) faster cpu = bigger programs = more bugs = lower quality of life
    4) faster cpu = stronger DRM possibilities
    5) Better processing * battery life = better medical devices
    6) Better processing * battery life = better 1984 style totalitarian devices
    7) Lower energy consumption = less air conditioning demand = decreasing average lattitude of data centers = population shifts or whatever or something?
    8) More money required for both hw and sw development = good for big corps and bad for the little guy

    --
    "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
  9. battery capacity vs proc speed by vlm · · Score: 1

    Hey J.K. have you run into a law relating battery capacity (either per Kg or L) vs proc speed over time? I bet there is some kind of interesting curve for mobile devices. Or, maybe not, donno thats why I'm asking a guy with previous success at data analysis in a closely related field...

    --
    "Science flies us to the moon. Religion flies us into buildings." - Victor Stenger
  10. Also called Wirth's law by tepples · · Score: 1

    This law originally having been proposed by Niklaus Wirth.

  11. How will programmers affect this? by skids · · Score: 1

    While sarcastic your question is an important one: as computing power has increased, the tendency of coders to just ride over badly coded underlayers rather than redesign them competently and efficiently has increased. Why bother cutting out bloat that causes an 80% penalty on system efficiency when you can just use a more efficient chipset to get the same result?

    So my question is whether Koomey has put any thought into similarly quantifying the opposing software bloat factor, and what he sees the total balance of system works out to.

  12. Re:Obsolete idea by skids · · Score: 1

    How can anyone take "cloud computing" seriously? It's really just a much less efficient version of the age old distributed computing paradigm. All it does is enable people who cannot wrap their heads around complex clustering topics to write extremely wasteful applications, and give management a new buzz-word dejour.

  13. Feynman Quote by yakovlev · · Score: 2

    Mr. Koomey, if we take your numbers from the attached article, which may not have been quoted correctly...

    Feynman indicated that there was approximately 100 billion times efficiency improvement possible, and 40,000 times improvement has happened so far.

    If we take Feynman's number at face value, this means that if computing efficiency improvements continue at the current rate (doubling every 18 months,) we will reach the theoretical maximum in 2043.

    Based on that, do you believe that we will see a dramatic reduction in efficiency improvements in the next 10-20 years as we approach the theoretical limit, or do you think Feynman was conservative in his estimate?

    Thanks!

  14. Re:Obsolete idea by skids · · Score: 1

    Let's say you get 2 hrs into your sim and you realize you made a mistake in coding, forgot something,
    saw initial results and realized you could trim things up to make it run better or turn out better results...

    Or if you were taking the resources you were about to use more seriously, you might not be so quick to start a run before properly testing your code.

    Hey, I'm all for commodity distributed computing. Would be nice if you could sell back, but even still. However, the branding of a suite of decade-old technologies as "cloud computing" has been rather silly. That's all I'm saying.