Slashdot Mirror


Unpredictability in Future Microprocessors

prostoalex writes "A Business Week article says increase in chip speeds and number of transistors on a single microprocessor leads to varying degrees of unpredictability, which used to be a no-no word in the microprocessor world. However, according to scientists from Georgia Tech's Center for Research in Embedded Systems & Technology, unpredictability becomes a great asset leading to energy conservation and increased computation speeds."

43 of 244 comments (clear)

  1. Three cheers! by Electroly · · Score: 5, Funny

    Three cheers for entropy!

    1. Re:Three cheers! by fm6 · · Score: 2, Interesting

      How can you cheer for something that will eventually kill you?

    2. Re:Three cheers! by chiok · · Score: 5, Funny

      Hurrah! Hurra! Hurry!

    3. Re:Three cheers! by mboverload · · Score: 2, Funny

      1 + 1 = e2924e9320?

  2. Well... by Realistic_Dragon · · Score: 4, Funny

    I'd be a lot more trusting of their results if they had worked it out on a processor with 100% certainty.

    --
    Beep beep.
    1. Re:Well... by thpr · · Score: 2, Funny
      I'd be a lot more trusting of their results if they had worked it out on a processor with 100% certainty.

      Think of the potential heartburn for the CEOs and CFOs who might have to sign off the financial statements (ala Sarbanes-Oxley) after the calculations were done using one of these processors... :*)

  3. Soo by NIK282000 · · Score: 5, Funny

    Will the number of windows errors increase or will they just occur at even more improbable times?

    --
    Dear aunt, let's set so double the killer delete select all
    1. Re:Soo by Zorilla · · Score: 2, Funny

      You must have never had to ride the bus to school as a kid then.

      (God, I hated those little buttons.)

      --

      It would be cool if it didn't suck.
  4. Another use by physicsphairy · · Score: 2, Insightful
    unpredictability becomes a great asset leading to energy conservation and increased computation speeds

    Probably and even bigger boon for encryption and key-generation.

    1. Re:Another use by thpr · · Score: 4, Insightful
      Probably and even bigger boon for encryption and key-generation.

      I vote key-generation and not encryption. Otherwise, how would you decrypt it? (given that the key generation and decryption are non-deterministic with one of these...)

    2. Re:Another use by PingPongBoy · · Score: 2, Informative

      Probably and even bigger boon for encryption and key-generation.
      I vote key-generation and not encryption. Otherwise, how would you decrypt it?


      Unpredictability really is useful for encryption because random numbers are very important for better encryption.

      The second application that comes to mind is the one-time pad. Of course you have to save the random padding data somewhere but you always had to do that. The unpredictability just makes one-time pad that much better.

      Random numbers may be used to generate keys that people can't guess. Of course you have to memorize the key.

      --
      Know your pads. One time pad: good for cryptography. Two timing pad: where to take your mistress.
  5. Robots and Unpredictability by Anonymous Coward · · Score: 2, Insightful

    "unpredictability becomes a great asset leading to energy conservation and increased computation speeds."

    When robots have this "unpredictability" tell me not to worry!

  6. Acceptable uncertainty by swg101 · · Score: 4, Informative

    Degrees of probability and uncertainty have been in given in the communications industry for quite some time. This just seems to be pointing out that the same ideas can be applied to the actual processing of the data.

    Now that I think about it, it does seem to make some sense. I am not sure that I would want to program on such a chip right now though (I imagine that debugging could become a nightmare really quickly!).

    --
    Like pi? Try 10,000 digits.
  7. The Uncertain Airbag by rhaikh · · Score: 3, Insightful

    Well, there's a 99.99% chance that airbag shouldn't be deployed right now, I'm just gonna disregard that "1".

  8. TFA by shirai · · Score: 5, Interesting

    It is an interesting idea but I think there would have to be a lot of research that goes into this and here's what I mean.

    The article is right in that certain things don't need 100% accuracy and that small variations in the answers can yield very good results. This could be important when time is more important than 100% accuracy.

    That said, how do we know if the variations are small? Only 1 bit can change a huge negative number into a huge positive number in a standard integer (Okay, I haven't looked at the bit layout of an integer lately but I think it's encoded like this. If not, you still get my point right?).

    So perhaps then this idea sort of works when we are aggregating lots of small calculated numbers but then switch to a traditional chip to add them together.

    You see what I'm getting at? Computers don't really know that the small variation at the most significant bit is actually a huge variation.

    I think there would also have to be a lot of analysis based on understanding how the variations add up and their cumulative effect. For example, a well written app under this scenario means that the errors basically average out over time as opposed to errors that blow out of proportion.

    Anyways, I can think of a few good uses for this. Probably the most notable being down the DSP path (which the article metions). Our eyes probably wouldn't see small errors in an HD display during processing or hear small errors in audio processing.

    This is parallel to the fact that there is less error checking in audio CDs and video DVDs than their computer counterparts CD-ROM and DVD-ROM (or the R/RW/etc.etc. counterparts).

    --
    Sunny

    Be my Friend

    1. Re:TFA by buraianto · · Score: 2, Interesting

      Or, you have a random bit change in your opcode and suddenly you're doing a muliply instead of an add. Or your opcode is an invalid one and your processor halts. Yeah, I don't think this makes sense given our current way of doing microprocessors. We'd have to do it some other way.

    2. Re:TFA by krunk4ever · · Score: 2, Insightful

      also, given these are microprocessors, when they have instruction jumps, wouldn't it be a concern if the address they're jumping to is slightly off?

    3. Re:TFA by fm6 · · Score: 2, Interesting
      That said, how do we know if the variations are small? Only 1 bit can change a huge negative number into a huge positive number in a standard integer (Okay, I haven't looked at the bit layout of an integer lately but I think it's encoded like this. If not, you still get my point right?).
      Sure, if you continue to use an encoding that doesn't tolerate errors. The math is beyond me, but I know there are ways to encode numbers so that a single-bit error nudges a value slightly, instead of changing it in wildly unpredictable ways.

      Also, a lot of computing deals mainly with string values, like the Google example in the story. Even without a random element in the calculations, it's hard to predict exactly what page will come out on top of a Google ranking. If the ordering's slightly different, nobody will care.

      And that's assuming that Google's secret algorithms don't already have a random element. Something I wouldn't rule out!

    4. Re:TFA by Epistax · · Score: 3, Interesting

      I think you're thinking of things to specifically. Think about the human mind. It's utterly insane in speed, yet completely analog. Digital systems cannot yet grasp anywhere near the computing power of the human brain, yet they can beat the brain in any single (non-fuzzy) pursuit (such as chess). The human brain accels at fuzzy (yes, fuzzy) calculations such as identifying faces. It's quite possible we'll never be able to make a computer faster at identifying faces than the human brain without directly stealing our algorithm because it's the single thing we're best at.

      So, we can identify faces really, really well. So well that :) looks like a face despite the fact that it seriously shouldn't. Well, guess what? What if we change identifying faces into identifying something else? Perhaps a computer can identify things in data using fuzzy logic very easily--- what could we do with that? Now we'll always need the truly quasi-100% accurate side unless we're relying on a self-evaluating true AI, so I'm not arguing with that.

      Looking back, this isn't really a response to what you wrote, but moreover it's a thing that I type after I drank alcohol, but I think it stands on its own merit. Anyway a lot of research is needed and I'm, sure we can agree on that. It'a certainly interesting.

  9. Pbit-chip prospects by craXORjack · · Score: 5, Funny
    Whether any Wall Street firms are getting regular briefs on Palem's research, as Intel and IBM (IBM ) are, he won't say. Wall Street doesn't like people blabbering about technology that promises a competitive advantage.

    Actually this sounds more useful to Diebold and the Republican National Committee.

    --
    Liberals call everyone Nazis yet they are the closest thing to it.
  10. Didn't work the last time by Anonymous Coward · · Score: 3, Informative

    Signed,

    FDIV

  11. Improbability drive? by mOoZik · · Score: 4, Funny

    You're sitting at your desk and out of nowhere, bam! You are transported to the edge of the galaxy. Weird.

    1. Re:Improbability drive? by strider44 · · Score: 3, Funny

      Lol I was thinking of the galaxy song!

      <--Excerpt-->
      "
      Our Galaxy itself contains a hundred billion stars;
      it's a hundred thousand lightyears side to side.
      It bulges in the middle, sixteen thousand lightyears thick,
      but out by us it's just three thousand lightyears wide.

      We're thirty thousand lightyears from galactic central point,
      We go around ever two hundred million years,
      And our galaxy is only one of millions of billions
      in this amazing and expanding universe!
      "

      Creds to Eric Idle and Co.

  12. Re:Windows ME did something right by s-orbital · · Score: 2, Funny

    Nothing saves more power than a box that has been turned off due windows commiting suicide

    --
    Patent: from Latin patere, to be open
  13. Re:YUO FAIL IT? by chrome · · Score: 2, Funny

    genius. Pure genius.

  14. We have this now by drsmack1 · · Score: 4, Insightful

    Before I found memtest my computers were VERY unpredicable.

  15. random numbers, yay by layingMantis · · Score: 4, Funny

    so a "random" number could be ...actually random right, as opposed to the now deterministically computed pseudo random numbers....how could this NOT be useful!? The AI ramifications alone are fascinating to imagine...

  16. Please relax. by Tibe · · Score: 2, Funny

    "... three to one... two... one... probability factor of one to one... we have normality, Anything you still can't cope with is therefore your own problem. Please relax."

  17. Little problem by Anonymous Coward · · Score: 3, Insightful

    While certainly many problems can be solved using less than perfect measures, building an entire chip based on this would not work out so well. For example, while a DSP app might deal fine with small variations in results, a device driver or chunk of crypto code is probably not going to be very happy with close-but-not-quite-right results.

    Why do I have a feeling these guys have done simulations with single applications, ignoring the surrounding OS environment?

  18. Intel by TWX · · Score: 2, Funny

    I'd say that with Intel's various errors over the last fifteen years, like the fourth and ninth digit floating point division errors in the Pentium 60, and the heat throttleback due to normal operating conditions on their newer processors, Intel had done a wonderful job of embracing this new unpredictability technology.

    --
    Do not look into laser with remaining eye.
  19. Analog Processor by 10101001+10101001 · · Score: 5, Interesting

    It sounds like this is just another implementation of an analog processor, which is far from a new idea. Really simple analog processors are just a bit of plastic foam used as a manifold. There's even the idea of having 0, 1, and 1/2 (where 1/2 is seen as uncertain) in something called a Lukasiewicz Logic Array. Anyways, I wish the guy good luck with it, though it might be a good idea if he did some more reading on ideas already presented on the subject.

    Obvious google search link:
    Google Search for "lukasiewicz analog"

    --
    Eurohacker European paranoia, gun rights, and h
  20. Indeterminate Voltage and Bad Fabrication by Inmatarian · · Score: 4, Informative

    Intel has hit a brick wall in terms of their processors. They invested heavily in their processor fabrication centers and are now coming to terms that they won't be able to produce reliably anymore. That said, lets discuss the nature of 1s and 0s. Typically, a 0 is broadcast across a chip as a lack of voltage, and a 1 brodcast as a +5 volts. Each transistor has to be capable of being just right of a resistor to not degrade the +5 volts. Heres where "unpredictability" comes into play: you have a handful of volts to play with. The article's talking about having unpredictable algorythms is the press agent not knowing what he's talking about, but certainly allowing a voltage threshold within the confines of the transistors is an okay thing. The only problem is when its across a lot of serial lines, because that compounds into significant loss. This is just my opinion, but I think this guy is talking about chip designs where the data isn't broadcast in 1s and 0s anymore, but in whatever multiples of electronvolts that would correspond to a number. I'm not comfortable with this, and I would like someone to tell me I'm just paranoid.

    1. Re:Indeterminate Voltage and Bad Fabrication by zcat_NZ · · Score: 2, Insightful

      "informative" ?!!

      Do you have even the faintest idea how logic actually works? Or did I just mis-read what you wrote?

      None of the gates have to reliably reproduce that actual voltage (+5, +3.3, +2.8, +/-12v, or whatever) that represents a "1" or "0", they just have to reliable recognise that it's "smallish" (less than halfway, logic 0), or "biggish" (more than halfway, logic 1) and in turn produce a voltage themselves that's reasonably close to whatever represents a "0" or "1". Binary is used for exactly this reason; it's very difficult to propigate an analog voltage through any number of circuits without losing accuracy. Digital circuits don't even try. And as I understand TFA, now they don't even have to get it right all the time either..

      --
      455fe10422ca29c4933f95052b792ab2
    2. Re:Indeterminate Voltage and Bad Fabrication by Waffle+Iron · · Score: 2, Funny
      Typically, a 0 is broadcast across a chip as a lack of voltage, and a 1 brodcast as a +5 volts.

      1974 called. It wants its CMOS logic signal voltages back.

  21. Probabilistic algorithms by timeOday · · Score: 2, Interesting
    In college, my professor challenged the entire class to find an algorithm that takes an array, and returns a single value larger than the median of values in the array, in sub-linear time.

    Naturally, he had us stumped, because the task is impossible. Without checking at least half the numbers, you can't be sure of the answer.

    But, he pointed out, here's what you can do: pick 1000 numbers from the array at random and return the largest - a constant time operation! This "algorithm" just might return a wrong answer. But the chances of that happening are far less than the odds that you're in a nuthouse hallucinating this message right now. The odds are far less than the liklihood that a computer would botch a deterministic algorithm during executation anyways. The odds of making a mistake with the algorithm are 0, for all intents and purposes. So is that OK?

    1. Re:Probabilistic algorithms by theguywhosaid · · Score: 2, Informative

      heh, 63 is the median in your given array. since the returned value does not need to be in the array, just add 1 and return that. or multiply by some large constant. or just return the sum of all the numbers you encountered. theres lots of options here.

  22. more info by mako1138 · · Score: 5, Informative

    This article left me rather insatisfied, so I looked for a better one. I found it here, a collection of papers on the subject, with real-world results, it seems. The first article is a nice overview, and there's some pics of odd-looking silicon. They have funding from DARPA, interestingly enough.

  23. I, for one... by melikamp · · Score: 2, Interesting

    That is one step closer to a human-like AI -- reminds me of a neural net. The technology from TFA may be just what they (computers) need to become like us: i.e. an ability to make quick decisions about complex problems, and succeeding more often than failing.

    I, for one, welcome our unpredictable silicon overlords.

  24. bad story by msblack · · Score: 3, Insightful
    It's rather a poorly-written article with a lot of 1950's science fiction predictions about the future. The field of fuzzy algorithms has existed for ages. Fuzzy algorithms don't rely on random results. Rather, they use the "p-bits" to perform their calculations. P-bits are not the same as random bits. On the contrary, p-bits are "don't care" or "flexible" values that take into account multiple possibilities at the same time.

    Random results are terrible because they are random. The scientific method depends upon experiments that can be repeated by other researchers. You can't base a theory on results that don't correlate with the inputs. You can repeat the experiment to obtain a probablistic model but not certainty.

    A computer chip that yields unpredictable results is not going to magically recognize the image of a chair, much less a face because a chip that can't execute a program is more akin to the movie Short Circuit where the appliances go whacky. To me the author confuses the concept of fuzzy algorithms with random trials.

    --
    signature pending slashdot approval
  25. math analysis. clever algorithm by slashnot007 · · Score: 5, Informative

    Problem: find a number larger than the median

    proposed solution: pick 1000 entires at random and retain the highest.

    analysis: at first glance it might seem that the problem seems ill formed since the size of the array is not specified. But note that this is not a parametric problem. You are asked for the median, so the actual numerical values of the array irrelevant, only the rank order. Some wiseguys here have suggested returning the largest double precision number as a gaurenteed bound. While a wise ass answer it does raise a second interesting false lead. Even if the number were represented in infinite precision and this could be aribtrarily large or small the proposed solution does not care. Again this is because all that matters is the ranking of the numbers not their values.

    COnsider the proposed solution. pick any cell at random and examine the number. if this number is returned there is a 50% chance it is equal to or greater than the median of the set. (if this is not obvious, dwell on the meaning of the word median: it means half the numbers are above/below that number.). So the chance it is below the median is 0.5. if you choose 1000 numbers the chance that all are below the median is 0.5^1000 which is roughly 1 part in a google.

    So the author is right, this algorithm fails less often than the probability that there is a cosmic ray that corrupts the calculation or their is a power blackout in the middle of it or that you have a heart attack.

  26. Hybrid machines. by headkase · · Score: 2, Interesting

    It seems to me that these chips would not replace the standard digital cpu's we have today, however they would instead complement their abilities. Adding a stochastic simulator chip would create a hybrid digital/probabilistic computer. Depending on the type of information that was being processed different chips would be employed. Your intel/amd chip would still do the digital/lossless functions while the stochastic chip would process data that is more resistant to loss of information or lossy.

    --
    Shh.
  27. GPU-like rather than FPU-like by buckhead_buddy · · Score: 3, Insightful
    While FPU calculations still require the precision, reproducability, and speed limitiations currently applied to all CPU chip work, this article seems to be aiming at loosening up the precision of calculations we don't really need right now.
    • the initial JPEG lossy compression
    • the texture mapping of blood splatters in first person shooters
    • mp3 playback for people who don't care about things like fidelity and consistency
    • voice compression in internet telephony
    • barcode analysis when using a symbology developed in the days of 72 dpi printers but where everyone today uses 1200dpi readers and printers.
    • people deliberately trying to add entropy for security or artistic reasons.

    I seriously doubt any accountant, music snob, or cs major would allow the main cpu to become inconsistent, but if Apple or some other trendsetting company offered a new computer with a "Right Brain" chip just for these entropic applications I'd expect it to start a whole new fashion in desktop computers.
  28. Error correction by jmv · · Score: 3, Insightful

    I'm surprised nobody has really mentioned error correction. In the same way that correction codes can work around RAM unreliability, you could have checksums built into each instruction to detect and correct errors. You would basically trade speed for reliability, something that has existed in communications for decades (refering to Shannon's work). I don't see why it wouldn't be the same for CPUs. I also remember clearly Richard Feynman proposing the idea (sorry, don't remember which book), so the idea isn't exactly new.