Slashdot Mirror

← Back to Stories (view on slashdot.org)

Big Challenges for Vista Bug Hunters

Posted by ryuzaki0 on from the game-over-man-game-over dept.

The New York Times is reporting on the final rush to bug fix Windows Vista. Even with massive numbers of testers and five years of work behind them, the folks in Redmond are pushing it to the wire in order to make sure it releases soon. From the article: "Vista has also been tested extensively. More than half a million computer users have installed Vista test software, and 450,000 of the systems have sent crash data back to Microsoft. Such data supplements the company's own testing in a center for Office referred to as the Big Button Room, for the array of switches, lights and other apparatus that fill the space. (A similar Vista room has a less interesting name -- Windows Test Technologies.) This is where special software automatically exercises programs rapidly while looking for errors."

14 of 213 comments (clear)

  1. special software by macadamia_harold · · Score: 5, Funny

    This is where special software automatically exercises programs rapidly while looking for errors.

    and this software, folks, goes by the name "internet explorer".

    --
    Push Button, Receive Bacon
    1. Re:special software by suv4x4 · · Score: 4, Informative

      I know a guy who used to work on test suites at Microsoft who has since quit, given their awful attitude towards bugs in Vista, and got a Mac

      You'll see this kind of attitude in every bigger software company. I've had personal experiences like this in Adobe and Macromedia with their flagship products. Features are dropped, specs constantly changing and inconsistent between teams.

      In some cases, you can spot the same feature implemented twice in source, with different interfaces, in different locations, and code linking randomly to one or the other, or even both (imagine updating this).

      The bugs to be fixed are selected first for how obvious they are (likely to occur) and not how critical they are. This is why it's common that bugs that can totally wreck operation and lead to data loss may be left, if the occurence is rare or unlikely.

      Everybody is in stress and the main goal is that you get the reviewed bug off your shoulders: if it's mildly reminiscent to something else, it's marked duplicate. If you can't reproduce it quickly, it's marked as fixed or not reproducible. Tricky bugs are marked "fact of life" or "deffered".

      Successful companies and their products grow, but the way the products and resources are managed does not scale. Instead, programmers are expected to churn a major release every X months, screw everything else, and keep the cash flowing, the investors happy.

      With Windows, we have a successful product that supports a huge ecosystem of applications (including legacy support), localization, usage cases etc. It's natural that in time, updates will become more rare, and will be much slower and more expensive to produce.

      The trend of software-as-a-service is not coincidental with this situation. In 5 to 10 years the base software we use might be so complex and tough to work on, that the only way it can be sustained is by small, regular payments, and the updates will be small, incremental, security/performance oriented. No more big releases, no more rushes to fix bugs in the last moment.

      This is the way evolution works. The other route is, of course, revolution...

  2. Time by Kangburra · · Score: 4, Insightful

    This was a similar story for Windows ME, in the end the time to release became more important than the quality of the product. I would like to see Vista delayed until it's ready, even if that's not for six more months. In my view that would earn Microsoft more points than meeting a schedule and then needing to (service) patch it fairly quickly.

    my $0.02

    --
    Common sense is not so common
    1. Re:Time by scsirob · · Score: 4, Informative

      Further delay aint happening. Vista will be out the door, regardless of the remaining bugs. They still have 'patch tuesday' to make updates, and the installation sequence itself already includes an initial update phase. So any really big bugs that remain present in the RTM build can still be fixed later.

      --
      To Terminate, or not to Terminate, that's the question - SCSIROB
  3. Huh.. by Anonymous Coward · · Score: 5, Funny

    Half a million installs, and 450k of them crashed.

    Color me unimpressed.

    1. Re:Huh.. by Angostura · · Score: 4, Insightful

      Depends how you interpret the figures. I have a stable, well configured Mac. Last week, I had a dodgy 3rd party app that crashed 3 times. Each time the Apple crash reporter asked me to send a report to Apple.

      If I had been running a beta version of the operating system I would have gone ahead and sent, on the grounds that it might have been a bad interaction between app and OS. In the event I said no.

      You need to know more about what is triggering the crash reporter.

    2. Re:Huh.. by alohatiger · · Score: 5, Funny

      Or maybe 499,999 didn't crash, and one of them crashed 450,000 times.

      --
      Bigtime Consulting - "We're the best because we cost the most"
  4. I wouldn't want to be the guy by Anonymous Coward · · Score: 4, Funny

    "More than half a million computer users have installed Vista test software, and 450,000 of the systems have sent crash data back to Microsoft."

    That is the kind of information that can get people fired...

  5. Statistics! by shreevatsa · · Score: 5, Insightful
    More than half a million computer users have installed Vista test software, and 450,000 of the systems have sent crash data back to Microsoft.
    In other words, about nine out of ten systems using Vista crashed at some point. And that's counting just those who sent the crash reports. :-)
    1. Re:Statistics! by ImaNihilist · · Score: 4, Funny

      That's really what happened in North Korea, they just don't want to admit it. Some noob installed Vista on one of the nuclear control computers, and then it crashed, and boom.

      Now the world will be destroyed, and we'll find out it was really Steve Ballmer's plan all along...then he'll throw a chair at something.

      Begun the dark times have.

    2. Re:Statistics! by endemoniada · · Score: 4, Insightful

      I'm getting a little tired of people comparing a computer running an OS to a TV set or similar.

      The TV will do one thing, and one thing only. That's displaying an analog signal as moving images and sound. That's all. The day that's all Windows will ever have to do, that's the day you can demand a refund.

      --
      Blog -
    3. Re:Statistics! by Tim+C · · Score: 4, Insightful

      I don't know about Vista, but on XP the default is to submit crash reports for all crashes. That includes software you are yourself developing. Yes, you soon learn to switch that off, but at least some of those reports will be from developers writing code for Vista and submitting crash reports for their own software (or testers doing so).

      --
      It's official. Most of you are morons.
  6. 450,000 of 500,000 people report crashes ? by Anonymous Coward · · Score: 5, Funny

    Obiously 50,000 users didn't test anything at all.

    Just wanted to thank god for linux.

  7. Yes, you can use hardware to track down bugs... by klubar · · Score: 4, Interesting

    Hardware is almost required to debug some low-level system code. Real-time stuff, like device drivers and scheduler really requires hardware tracer to determine what happened and when.

    With XP, almost all of the crashes are due to bad (usually non-MS) device drivers. If you run a system with pure MS drivers and quality hardware you'll never see a BSOD. If you run the usual business suite of software (Office, Outlook, IE) you probably never see an application crash.

    It's the crappy hardware and badly written drivers that cause the crashes. That's the difference with Apple.... since they control the hardware there's less crashes due to bad hardware and there are fewer third-party drivers for Mac hardware. The software is probably the same quality.