Slashdot Mirror


End of Moore's Law Forcing Radical Innovation

dcblogs writes "The technology industry has been coasting along on steady, predictable performance gains, as laid out by Moore's law. But stability and predictability are also the ingredients of complacency and inertia. At this stage, Moore's Law may be more analogous to golden handcuffs than to innovation. With its end in sight, systems makers and governments are being challenged to come up with new materials and architectures. The European Commission has written of a need for 'radical innovation in many computing technologies.' The U.S. National Science Foundation, in a recent budget request, said technologies such as carbon nanotube digital circuits will likely be needed, or perhaps molecular-based approaches, including biologically inspired systems. The slowdown in Moore's Law has already hit high-performance computing. Marc Snir, director of the Mathematics and Computer Science Division at the Argonne National Laboratory, outlined in a series of slides the problem of going below 7nm on chips, and the lack of alternative technologies."

21 of 275 comments (clear)

  1. Rock Star coders! by Anonymous Coward · · Score: 5, Insightful

    The party's over. Get to work on efficient code. As for the rest of all you mothafucking coding wannabes, suck it! Swallow it. Like it! Whatever, just go away.

    1. Re:Rock Star coders! by Z00L00K · · Score: 4, Insightful

      Efficient code and new ways to solve computing problems using massive multi-core solutions.

      However many "problems" with performance today are I/O-based and not calculation based. It's time for the storage systems to catch up in performance with the processors, and they are on the way with SSD disks.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    2. Re:Rock Star coders! by lgw · · Score: 5, Interesting

      I think the next couple of decades will be mostly about efficiency. Between mobile computing and the advantage of ever-more cores, the benefits from lower power consumption (and reduce heat load as a result) will be huge. And unlike element size, we're far from basic physical limits on efficiency.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    3. Re:Rock Star coders! by K.+S.+Kyosuke · · Score: 4, Insightful

      There hasn't been a computing power revolution for quite some time now. All the recent development has been rather evolutionary.

      --
      Ezekiel 23:20
    4. Re:Rock Star coders! by Forever+Wondering · · Score: 4, Interesting

      There was an article not too long ago (can't remember where) that mentioned that a lot of the performance improvement over the years came from better algorithms rather than faster chips (e.g. one can double the processor speed but that pales with changing an O(n**2) algorithm to O(n*log(n)) one).

      SSD's based on flash aren't the ultimate answer. Ones that use either magneto-resistive memory or ferroelectric memory show more long term promise (e.g. mram can switch as fast as L2 cache--faster than DRAM but with the same cell size). With near unlimited memory at that speed, a number of multistep operations can be converted to a single table lookup. This is done a lot in a lot of custom logic where the logic is replaced with a fast SRAM/LUT.

      Storage systems (e.g. NAS/SAN) can be parallelized but the limiting factor is still memory bus bandwidth [even with many parallel memory buses].

      Multicore chips that use N-way mesh topologies might also help. Data is communicated via a data channel that doesn't need to dump to an intermediate shared buffer.

      Or hybrid cells that have a CPU but also have programmable custom logic attached directly. That is, part of the algorithm gets compiled to RTL that can then be loaded into the custom logic just as fast as a task switch (e.g. on every OS reschedule). This is why realtime video encoders use FPGAs. They can encode video at 30-120 fps in real time, but a multicore software solution might be 100x slower.

      --
      Like a good neighbor, fsck is there ...
  2. Moore's Law isnt a law you know by Osgeld · · Score: 5, Insightful

    Its more of a prediction, that has mostly been on target cause of its challenging nature

  3. Ends of Moore's Law in software ? by Taco+Cowboy · · Score: 5, Insightful

    The really sad thing regarding this "Moore's Law" thing is that, while the hardware had kept on getting faster and even more power efficient, the software that runs on them kept on becoming more and more bloated.

    Back in the days of pre-8088 we already had music notation softwares running on Radio Shack TRS-80 model III.

    Back then, due to the constraints of the hardware, programmers had to use every trick on the book (and off) to make their programs run.

    Nowadays, even the most basic "Hello World" program comes up in megabyte range.

    Sigh !

    --
    Muchas Gracias, Señor Edward Snowden !
    1. Re:Ends of Moore's Law in software ? by lister+king+of+smeg · · Score: 4, Insightful

      Would you rather that your CPU and memory were always underutilized by software, going to waste?

      yes more efficient and fast code would be much better

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
    2. Re:Ends of Moore's Law in software ? by bloodhawk · · Score: 4, Insightful

      I don't find that a sad thing at all. The fact people have to spend far less effort on code to make something that works is a fantastic thing that has opened up programming to millions of people that would never have been able to cope with the complex tricks we used to play to get every byte of memory saved and to prune every line of code. This doesn't mean you can't do those things and I still regularly do when writing server side code. But why spend man years of effort to optimise memory,CPU and disk footprint when the average machine has abundant surplus of both.

    3. Re: Ends of Moore's Law in software ? by jarfil · · Score: 4, Insightful

      How about spending 20x the man hours for a 10,000% performance gain? That is what I've recently experienced myself, in the reverse: an embedded device interface getting rewritten to require 20x less man hours to mantain... at a 100x performance hit. Suffice to say it went from quite snappy, to completely useless, but it seems like it's my fault for not upgrading the hardware.

    4. Re:Ends of Moore's Law in software ? by lister+king+of+smeg · · Score: 4, Insightful

      Would you rather that your CPU and memory were always underutilized by software, going to waste?

      yes more efficient and fast code would be much better

      Then you should be using a 20 years old computer, with its lean software and scarce resources. Why buy more powerful hardware if you have no use for its inward capabilities? The rest of us will keep using hardware that allow possibilities that were unheard a few years ago.

      To quote an old adage What Moore's law giveth Gates Taketh away

      I would prefer to use lean software on powerful hardware so as to actually gain the advantages of said hardware rather than bad code and bloat roll back the advantages new hardware has given.

      --
      ---Saying gnome 3 is better than windows 8 not so much a compliment as it is damning with light praise.
    5. Re:Ends of Moore's Law in software ? by freeze128 · · Score: 5, Funny

      yes more efficient and fast code would be much better

      I like this guy. He doesn't stop for punctuation.

    6. Re:Ends of Moore's Law in software ? by TheRaven64 · · Score: 4, Insightful

      You can still write software that efficient today. The down side is that you can only write software that efficient if you're willing to have it be about that complex too. Do you want your notes application to just store data directly on a single disk from a single manufacturer, or would you rather have an OS that abstracts the details of the device and provides a filesystem? Do you want the notes software to just dump the contents of memory, or do you want it to store things in a file format that is amenable to other programs reading it? Do you want it to just handle plain text for lyricst, or would you like it to handle formatting? What about unicode? Do you want it to be able to render the text in a nice clean antialiased way with proportional spacing, or are you happy with fixed-width bitmap fonts (which may or may not look terrible, depending on your display resolution)? The same applies to the notes themselves. Do you want it to be able to produce PostScript for high-quality printing, or are you happy for it to just dump the low-quality screen version as a bitmap? Do you want it to do wavetable-based MIDI synthesis or are you happy with just beeps?

      The reason modern software is bigger is that it does a hell of a lot more. If you spent as much effort on every line of code in a program with all of the features that modern users expect as you did in something where you could put the printouts of the entire codebase on your office wall, you'd never be finished and you'd never find customers willing to pay the amount it would cost.

      --
      I am TheRaven on Soylent News
  4. And best of all... by pushing-robot · · Score: 4, Insightful

    We might even stop writing everything in Javascript?

    --
    How can I believe you when you tell me what I don't want to hear?
    1. Re:And best of all... by Urkki · · Score: 5, Funny

      We might even stop writing everything in Javascript?

      Indeed. JavaScript is the assembly language of the future, and we need to stop coding in it. There already are many nicer languages which are then compiled into Javascript, ready for execution in any computing environment.

  5. Re:Anonymous Coward's Law by Anonymous Coward · · Score: 5, Funny

    Moore's yawn ... er, law. It has ended, again again. It must be the co-joined twin of Voyager which has left the solar system 78 times in the past 14 years.
    Wake me up when some real news gets in.

  6. Re:Blind ants, now need to search more branches by crutchy · · Score: 4, Funny

    just need to shoot more advanced alien spaceships down near roswell

  7. Re: Blind ants, now need to search more branches by gweihir · · Score: 4, Interesting

    As somebody that has watched what has been going on in that particular area for more than 2 decades, I do not expect anything to come out of it. FPGAs are suitable for doing very simples things reasonably fast, but so are graphics cards and with a much better interface. Bit as soon as communication between computing elements or large memory is required, both FPGAs and graphics cards become abysmally slow in comparison to modern CPUs. That is not going to change, as it is an effect of the architecture. There will not be any "massive" performance increase anywhere now.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  8. 3D chips, memristors, photonics, spintronics, QC by Katatsumuri · · Score: 5, Informative

    I see many emerging technologies that promise further great progress in computing. Here are some of them. I wish some industry people here could post some updates about their way to the market. They may not literally prolong the Moore's Law in regards to the number of transistors, but they promise great performance gains, which is what really matters.

    3D chips. As materials science and manufacturing precision advances, we will soon have multi-layered (starting at a few layers that Samsung already has, but up to 1000s) or even fully 3D chips with efficient heat dissipation. This would put the components closer together and streamline the close-range interconnects. Also, this increases "computation per rack unit volume", simplifying some space-related aspects of scaling.

    Memristors. HP is ready to produce the first memristor chips but delays that for business reasons (how sad is that!) Others are also preparing products. Memristor technology enables a new approach to computing, combining memory and computation in one place. They are also quite fast (competitive with the current RAM) and energy-efficient, which means easier cooling and possible 3D layout.

    Photonics. Optical buses are finding their ways into computers, and network hardware manufacturers are looking for ways to perform some basic switching directly with light. Some day these two trends may converge to produce an optical computer chip that would be free from the limitations of electric resistance/heat, EM interference, and could thus operate at a higher clock speed. Would be more energy efficient, too.

    Spintronics. Probably further in the future, but potentially very high-density and low-power technology actively developed by IBM, Hynix and a bunch of others. This one would push our computation density and power efficiency limits to another level, as it allows performing some computation using magnetic fields, without electrons actually moving in electrical current (excuse me for my layman understanding).

    Quantum computing. This could qualitatively speed up whole classes of tasks, potentially bringing AI and simulation applications to new levels of performance. The only commercial offer so far is Dwave, and it's not a classical QC, but so many labs are working on that, the results are bound to come soon.

  9. Re: 3D chips, memristors, photonics, spintronics, by gweihir · · Score: 4, Insightful

    You may see them, but no actual expert in the field does.

    - 3D chips are decades old and have never materialized. They do not really solve the interconnect problem either and come with a host of other unsolved problems.
    - Memristors do not enable any new approach to computing, as there are neither many problems that would benefit form this approach, nor tools. The whole idea is nonsense at this time. Maybe they will have some future as storage, but not anytime soon.
    - Photonics is a dead-end. Copper is far too good and far too cheap in comparison.
    - Spintronics is old and has no real potential for ever working at this time.
    - Quantum computing is basically a scam perpetrated by some part of the academic community to get funding. It is not even clear whether it is possible for any meaningful size of problem.

    So, no. There really is nothing here.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  10. Re: Blind ants, now need to search more branches by TheRaven64 · · Score: 4, Informative
    Speaking as someone who works with FPGAs on a daily basis and has previously done GPGPU compiler work, that's complete nonsense. If you have an algorithm that:
    • Mostly uses floating point arithmetic
    • Is embarrassingly parallel
    • Has simple memory access patterns
    • Has non-branching flow control

    Then a GPU will typically beat an FPGA solution. There's a pretty large problem space for which GPUs suck. If you have memory access that is predictable but doesn't fit the stride models that a GPU is designed for then an FPGA with a well-designed memory interface and a tenth of the arithmetic performance of the GPU will easily run faster. If you have something where you have a long sequence of operations that map well to a dataflow processor, then an FPGA-based implementation can also be faster, especially if you have a lot of branching.

    Neither is a panacea, but saying a GPU is always faster and cheaper than an FPGA makes as much sense as saying that a GPU is always faster and cheaper than a general-purpose CPU.

    --
    I am TheRaven on Soylent News