Slashdot Mirror


Test: Quantum Or Not, Controversial Computer No Faster Than Normal

sciencehabit writes The D-Wave computer, marketed as a groundbreaking quantum machine that runs circles around conventional computers, solves problems no faster than an ordinary rival, a new test shows. Some researchers call the test of the controversial device, described in Science, the fairest comparison yet. "...to test D-Wave’s machine, Matthias Troyer, a physicist at the Swiss Federal Institute of Technology, Zurich, and colleagues didn't just race it against an ordinary computer. Instead, they measured how the time needed to solve a problem increases with the problem's size. That's key because the whole idea behind quantum computing is that the time will grow much more slowly for a quantum computer than for an ordinary one. In particular, a full-fledged 'universal' quantum computer should be able to factor huge numbers ever faster than an ordinary computer as the size of the numbers grow." D-Wave argues that the computations used in the study were too easy to show what its novel chips can do.

28 of 119 comments (clear)

  1. The real question in my mind by TFoo · · Score: 4, Interesting

    Is this a case where D-Wave was fraudulently trying to pass something off as quantum when they knew it wasn't, or did they really and truly not know. How could they not know?

    1. Re:The real question in my mind by Pinhedd · · Score: 2, Interesting

      No, it's simply a case of pitting a very immature technology against one that's very mature.

    2. Re:The real question in my mind by Shajenko42 · · Score: 2

      Well, they would have to open the box to find out...

    3. Re:The real question in my mind by vux984 · · Score: 5, Insightful

      No. They are trying to measure the growth of the problem. So its not important which one is absolutely faster, but which one takes relatively more time as the problem becomes more difficult.

      The conventional computer should take exponentially longer as the problem becomes mroe difficult. The quantum one should not.

      In this test, both took exponentially longer. So either the d-wave doesn't work, or as the manufacturer has claimed, the problems were not setup to demonstrate the class of problems where the d-wave will show better performance relative to problem complexity growth than a conventional computer.

      Seems odd to me though that they can't provide easily verified sample problem spaces where their device works better than a conventional PC as the problem gets 'bigger'.

    4. Re:The real question in my mind by K.+S.+Kyosuke · · Score: 2, Insightful

      Wow. So quantum, very scam, much dollars.

      --
      Ezekiel 23:20
    5. Re:The real question in my mind by Garfong · · Score: 3, Informative

      In this test, both took exponentially longer. So either the d-wave doesn't work, or as the manufacturer has claimed, the problems were not setup to demonstrate the class of problems where the d-wave will show better performance relative to problem complexity growth than a conventional computer.

      Or the maximum problem size handled by the machine is too small so see the sub-exponential growth. Complexity theory deals with performance on very large data sets, and, if I remember correctly, the D-wave machine is limited to a small problem size (max a hundred or so qbits)

    6. Re:The real question in my mind by marciot · · Score: 5, Funny

      How could they not know?

      Heisenberg's Uncertainty Principle: If they knew for a fact their claims were fraudulent, they would not know what their claims were. Since they in fact know that they are claiming to have a quantum computer, they cannot know whether the claim is fraudulent or not.

    7. Re:The real question in my mind by dreamchaser · · Score: 2

      I've been pretty sure it's a scam for some time now. They have yet to demonstrate anything quantum about it at all, nor can they produce problems that it solves faster than a conventional computer. This is not the first time.

    8. Re:The real question in my mind by radish · · Score: 4, Insightful

      Which in turn would mean that for the problem space it's capable of operating within it's no faster than a normal computer. Which reduces down to "it's no faster than a normal computer".

      --

      ---- Den ene knappen er powerknapp, den andre er Bender voice knapp "Bite My Shiny Metal Ass"

    9. Re: The real question in my mind by Anonymous Coward · · Score: 2

      I do think DWave honestly believes their ideas will work so you would not be able to prove fraud. Also it is very hard for another technolgy to catch up with existing tech when that techngy is still doubling about every two years.

    10. Re:The real question in my mind by HappyPsycho · · Score: 4, Informative

      GP is actually correct. This is not even a full quantum computer.

      "The D-Wave machine is not a universal quantum computer, however, but a more limited "quantum annealer."", which according to wikipedia seems to mean some sort of global minimum finder (given how to find all the local minimum solutions, find the lowest one).

      With a mere 512 quibits available on the D-Wave device I'm more than willing to believe they may be still in the area of small inputs where an O(n) algorithm can still beat an O(log n) algorithm (e.g. http://cse.csusb.edu/dick/cs20... )

    11. Re:The real question in my mind by 50000BTU_barbecue · · Score: 2

      Gosh, I hope not, otherwise what are all those tunnel diodes doing in my 50 year old scope? Come to think of it, without quantum effects, you can't even get a vacuum tube to work...

      --
      Mostly random stuff.
    12. Re:The real question in my mind by bill_mcgonigle · · Score: 5, Insightful

      Which reduces down to "it's no faster than a normal computer".

      I'm not sure I get this argument. The guys selling this stuff have said for a while that their device is fast enough at quantum annealing to be useful for learning to program quantum computers, and that when their manufacturing ramps up they'll have many more qubits, and I think the implication is that the speed doesn't scale linearly. They were telling the Googles and the Lockheeds, 'look you need to invest in our product and services so you can be ready in the quantum computing space when the better hardware emerges'.

      That it's not absolutely faster than a conventional computer at this point is interesting, academically, but not terribly relevant to their sales pitch, unless we can show that the problem at hand fits inside their limited qubit space and the types of algorithms its supposed to be able to handle at this point, and still does not do what's expected of it.

      Also: did a tiny Canadian computer company produce a computer that's as fast (within the problem space) as a modern Xeon on their slim budget? That would almost seem revolutionary - AMD can't even do that with GlobalFoundary's fab on their side.

      Maybe it is a scam, but this kind of analysis seems somewhat orthogonal to their claims. By all means, pop one open and find the i7 inside, and there won't be any question, but that's not really where we are today.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    13. Re:The real question in my mind by quax · · Score: 2
    14. Re:The real question in my mind by quax · · Score: 4, Informative

      Do you know how to use a search engine?

      Are you aware of scholar.google.com?

      It's really not hard to find papers like this or this.

      And yes, the Matthias Troyer who co-authored the first paper is the same guy who conducted the performance study that the /. blurb references.

      That D-Wave performs quantum annealing can be regarded as settled. The only question that remains is how useful this may be.

      Eight years ago everybody (myself included) thought D-Wave was a scam or just crazy. As new facts emerge smart people (such as Matthias) adjust their judgment.

    15. Re:The real question in my mind by liquidsin · · Score: 2

      not sure how easily verified these would be, but this page gives a list of things they claim it's a better fit than conventional methods.

      --
      do not read this line twice.
    16. Re: The real question in my mind by loufoque · · Score: 2

      Even with ten million you can't make a processor better than a i7.

    17. Re:The real question in my mind by SuricouRaven · · Score: 2

      The electron emission part is a quantum effect. It can't be explained in purely classical terms. Fortunately the end result can be reduced down to a couple of handy equations simple enough for non-quantum-physicists to make use of the tubes.

    18. Re: The real question in my mind by Shimbo · · Score: 2

      If he had 10 million dollars, he wouldn't need to.

    19. Re:The real question in my mind by timholman · · Score: 2

      Seems odd to me though that they can't provide easily verified sample problem spaces where their device works better than a conventional PC as the problem gets 'bigger'.

      This "failure to do the obvious thing", i.e. the designers not providing their own sample problem spaces to validate their own design, is one of the warning signs of pseudoscience.

      It is equally troubling if they state "Hey, you didn't run the right test" as a post hoc excuse, while failing to specify just what the right test was beforehand. They are shifting the burden of proof to others - another warning sign of pseudoscience.

      There are many, many historical cases of otherwise reputable scientists and engineers falling into a pseudoscientific mindset. It should not be ruled out here.

    20. Re:The real question in my mind by Pinhedd · · Score: 2

      Not necessarily.

      Using quantum annealing to solve non-linear multivariate optimization problems is theoretically faster than using traditional turing computation. It definitely needs more development to overcome a normal workstation or supercomputer, but it will most likely happen eventually.

  2. Re:er no shit sherlock! by Anonymous Coward · · Score: 2, Insightful

    Because the machine costs ten million dollars and the people selling it are obviously not going to publish information that portrays their machine in a bad light. Very few people have access to these, and those who do often have a vested interest in convincing people the machine is worthwhile.

  3. Not that fast yet but true quantum annealing by quax · · Score: 2

    Originally I meant to bet with Matthias Troyer if the D-Wave machine was truly a quantum annealer. At the time Matthias wrote me:

    ""Actually, we can't bet anymore since I know the results that we're going to publish and we'll say yes to quantum :-). We should have done the bet a year ago."

    So we decided to bet if the current crop of D-Wave machines can already beat conventional computing.

    Obviously I lost that bet, but not by much.

    It will be interesting to see how the next chip generation will fare, there is still lots of room for higher qubit integration. In comparison to conventional CMOS the D-Wave chip structures are huge.

    Conventional chip design doesn't have lots of room at the bottom any more. D-Wave on the other hand still has plenty of room at the bottom.

    That's why I will continue to bet on them.

     

  4. What problems are Quantum Annealers good for? by billstewart · · Score: 4, Interesting

    That's been the big question with D-Wave all along. What does it really do, how does it really work, what's it good for, is it real?

    Everybody knows what a universal quantum computer is good for - running Shor's algorithm to do factoring and totally wrecking public-key cryptography, plus whatever other problems people care about in the real world. But general-purpose quantum computers so far can't keep enough qbits entangled together to factor numbers bigger than 21 = 3x7, and if anybody's figured out how to do significantly bigger than that, they're keeping it Really Well Hidden (either because they're a government, or because a government will want them to do stuff, or because a government will want them killed.)

    Meanwhile, D-Wave has 512 qbits that they claim they'll be able to do something with, and maybe it'll have a chance of being cool or useful. And maybe if you kick in enough megabucks to get a non-disclosure agreement, you'll be able to get some information beyond vague quantumy handwaving. They are the only game in town, after all.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  5. Re:Hope you enjoyed the decade, Geordie. by quax · · Score: 4, Informative

    It is not gate based universal quantum computing but special purpose quantum annealing.

    If you accept this as a valid approach to quantum computing has certainly been the subject of much debate.

  6. Rather then feeding the trolls ... by quax · · Score: 4, Informative

    .... maybe the slahdot stub should have had a link to hear from the horse's mouth?

    In this interview Matthias Troyer puts his team's results into the correct context.

  7. Re:They aren't designed to use the same algorithms by TapeCutter · · Score: 2

    But the makers of the computer can't find a single problem it solves well. Why is that?

    Aside from profit, why is that question even relevant? It took a century for the geocentric model to give more accurate results than the old heliocentric model. Here we appear to have quite a few independent observers who know quantum annealing when they see it, I am not one of them. Sure it could be a scam but so far I have seen zero evidence supporting that hypothesis.

    --
    And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  8. Hmm. A "fair" comparison isn't the right test. by hey! · · Score: 3, Informative

    What we need to know about is the existence or non-existence of unfair comparisons, i.e., problems that favor the putatively "quantum" computer.

    Since I don't expect a quantum computer to be faster at everything, then finding a bunch of solutions to problems that aren't any faster on the "quantum computer" doesn't prove anything, even if the problems look like the kind of problems you'd hope would be quantum-computery. There's not much more you can do than point to the absence of evidence when the burden of proof isn't on you.

    The burden of proof is on the vendor here, and standard of "proof" is conceptually simple at least: demonstrate that for some task this device offers any practical advantage whatsoever over the best available conventional technology. That could be in absolute performance against the best available tech(e.g. ASICs and supercomputers), in relative performance over similarly priced systems, or in some practical measure other than performance, such as power consumption. Any clearly identifiable and verifiable advantage counts as positive proof the vendor has something worth paying attention to.

    Of course even comparable performance by a novel architecture on some class of problems is interesting, because of the huge advantages a mature technology enjoys. Performance of a new design even in the same ballpark as a mature design suggests future improvements might be in the works. But it's only a suggestion.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.