Slashdot Mirror


Everyone's A Beta Tester

kukyfrope writes "Many people dream of being videogame beta testers but, in reality, a lot of us already are. GameDaily's Greg Atkinson discusses how developers are using the ability to patch games as a crutch for launching games ahead of schedule, using a 'we'll patch it later' mentality, as opposed to extensive play testing." From the article: "What's going on lately that so many games are being released unfinished? Why are the people now paying to essentially beta test the games rather than purchasing completed games? ... If you scan through the PC reviews, on this and any other site, you will notice an overabundance of games that lost points or otherwise hampered their players' experience by being unpolished, full of bugs, and sometimes downright annoying to play. Everything from controls and camera movements to balancing issues, broken quests, and of course graphical errors are abundant in probably half the titles on the shelf these days. It's become habit to look for any patches to a game while I'm installing it, and that's not right."

114 comments

  1. under construction??? by B0red+At+W0rk · · Score: 1, Funny

    This story is currently under construction?

    1. Re:under construction??? by __aaclcg7560 · · Score: 0

      Are you complaining about being a beta tester for a story under construction? Whiner...

    2. Re:under construction??? by gEvil+(beta) · · Score: 1

      No kidding. I mean, slashdot's got close to a million beta testers...

      --
      This guy's the limit!
  2. Not just games by cjb909 · · Score: 1

    It's not just with games though....just look at everything Google has in beta!

    1. Re:Not just games by geoffspear · · Score: 2, Insightful

      Yeah, but Google's betas are actually labelled as such and given to the people testing them for free. That's a lot different than selling something as a release and letting your paying customers do the testing for you.

      --
      Don't blame me; I'm never given mod points.
    2. Re:Not just games by Syrae · · Score: 1
      Well, it's not even just games and Google (though at least Google is kind enough to call it a Beta). Microsoft products for years have been known to be big giant beta releases that never quite end up in a final form.

      Developers have been using the "patch it later" mentality as a crutch, but it's only because of the explosion of the Internet has allowed developers to make improvements to games for years after they've released them (like Blizzard with Diablo II). Sometimes whole new features are implemented and released along with the default bug patching. There's a delicate balance between getting the game stable enough to play so the reviews don't stink and letting the developers have a few extra weeks between going gold and the street release to patch up some hopefully minor bugs.

      I suspect that it might actually be more cost efficient to have a small team of testers try to get all the showstopper bugs out and balance bugs mostly fixed then allow the market to try and find all the hard to find stuff because NO ONE can find all the strange, odd bugs that real users can uncover.

  3. Nothing new by sqlrob · · Score: 1

    It's been this way for years. I remember getting the Diablo II patch before I had game in hand.

    1. Re:Nothing new by Goldberg's+Pants · · Score: 1

      Indeed. Not sure why this is news. If you bought a game in the last 5 years, you already knew this was the case. (One reason I've stopped buying PC games.)

    2. Re:Nothing new by sqlrob · · Score: 1

      Yup. That and invasive copy protection are why I went to consoles. With the "ship then patch" mentality showing up in the 360 now (cf. Oblivion), chances are I won't get a 360. Ditto for the PS3 if that happens there too.

    3. Re:Nothing new by MC68000 · · Score: 1

      Umm, how do you avoid invasive copy protection when switching to consoles. The Xbox 360 is the first mainstream computer to have the most invasive DRM dreamed up yet, trusted computing.

      --
      E = m c^3 Don't drink and derive E = m c^3
    4. Re:Nothing new by sqlrob · · Score: 1

      Those are part and parcel with the machine. I'm not going to lose dual boot capability (TurboTax a couple of years ago) or lose USB hard drives (StarForce) or damage optical drives (StarForce)

      The only apparent DRM on consoles is the need to have the disk in. Since it can only handle the one game at a time, unlike the computer, there's no loss in functionality.

      Copy protection on games on the computer limits the usefullness of the computer. It does not limit it on consoles. I'm at the point that, unless it is a system utility, it does not get installed with an administrator account - that's how little I trust most shrinkwrap software.

  4. Alpha by networkBoy · · Score: 4, Funny

    The new beta.

    --
    whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
    1. Re:Alpha by __aaclcg7560 · · Score: 1

      Blah... When I worked at Atari as a lead tester, several producers tried to push through an alpha-beta-super-omega-gold-release-candidate build to make the deadline. That got pissed off when I mentioned that a) this won't fly, b) kiss their bonuses goodbye, and c) the title is being release two- to four-weeks later as I correctly predicted.

  5. Yet another reason to get a console by metamatic · · Score: 2, Insightful

    I just hope that the PS3 with hard drive isn't going to allow game developers to skip QA the way they do with PC games.

    --
    GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
    1. Re:Yet another reason to get a console by mikeisme77 · · Score: 1

      XBox had a harddrive standard and it wasn't used for patches (or not that I've seen), so there shouldn't be any reason to fear. Of course, with XBox in order to get ANY type of online service you needed a paid subscription... so maybe now that some online services will be free on all consoles one of those "services" will be patches for games shipped before they were actually ready... In which case, I plan to vote with my wallet and write an nasty letter to any publisher that pulls such a stunt... *Off Topic* Speaking of which, I owe Blockbust a nasty letter for a) never having copies of games I'm looking for in stock and b) carrying PSP games but not DS games (last I checked there were more DS's out there than PSPs...)

    2. Re:Yet another reason to get a console by linvir · · Score: 1

      I suppose you're counting the Xbox as a PC then? Fair enough...

    3. Re:Yet another reason to get a console by Wyrd01 · · Score: 1

      I just hope that the PS3 with hard drive isn't going to allow game developers to skip QA the way they do with PC games.

      It could in fact encourage just that. With an online service that everyone will have access to, they can sell the players "additional" content for their games... something along the lines of, oh I don't know, maybe a Horse Armor model for a couple bucks?

      Instead of just putting these things in the game in the first place they will find it more profitable to leave them out and then charge extra if you want the extra feature. If they leave a particularly annoying, but not game-breaking, bug in the code then more consumers are likely to download the patch to fix that for $2... in theory anyway.

    4. Re:Yet another reason to get a console by __aaclcg7560 · · Score: 1

      I saw the technical documentation for the XBox when I worked at Atari. The A: and B: drives are listed as "legacy" devices. Kinda of funny for a brand new console to have legacy devices.

    5. Re:Yet another reason to get a console by SatanicPuppy · · Score: 2, Insightful

      It's much easier to debug console games, because the hardware is standard. PC game flaws almost always have to do with oddball hardware problems...Or they're content and balance upgrades for the sorts of games that don't often make it to console.

      --
      ad logicam Claiming a proposition is false because it was presented as the conclusion of a fallacious argument.
    6. Re:Yet another reason to get a console by Anonymous Coward · · Score: 0

      Uh - I take it you don't have an XBox 360 yet.

      Microsoft has been allowing publishers to patch (and many have) - Unlike the strict no patch (without new content) policy on XBox.

      As a side note - Halo2 had extra content released early on XBox - Just so they could patch the progressive scan bug.

    7. Re:Yet another reason to get a console by Carnildo · · Score: 1

      Oblivion for Xbox360 is getting its first patch soon.

      --
      "They redundantly repeated themselves over and over again incessantly without end ad infinitum" -- ibid.
  6. My policy by CaptCommy · · Score: 3, Insightful

    I agree that the number of games released in a buggy state is getting way out of hand. When I buy a game, especially for $50, I should be able to take it home and play it. Since that never happens, I just play the waiting game. I almost never buy a game when it releases; instead waiting a few months. The price goes down, and patches come out, so I pay less for a game that plays better than at launch. Sure, I don't get to be the first guy on the block to play, but that's not a big deal when I'm saving $10-20 bucks a game. And it's not like the game is any less fun if you wait. Hearts of Iron II is just as fun when it came out as it is now. Plus it runs smoother thanks to patches. And cost about $30. Seems like a win/win scenario to me.

    1. Re:My policy by gEvil+(beta) · · Score: 1

      Couple this with a similar hardware policy (except video cards generally aren't buggy, just pricey), and you've managed to save yourself a shitload of money!

      --
      This guy's the limit!
  7. So stop buying unfinished games by c0d3h4x0r · · Score: 3, Insightful

    This will only change if all you idiots will stop buying buggy unfinished games!

    As long as you keep buying beta-quality stuff, and the companies keep making their sales and profit goals, they'll keep doing it.

    Duh.

    --
    Moderator hint: a comment is neither "Flamebait" nor "Troll" if it is true.
    1. Re:So stop buying unfinished games by LordNimon · · Score: 1

      Mod the parent up! The real way to solve this problem is to not buy any newly released game. Wait at least 3 months, and then visit online forums to see what other players think. If the bugs have been patched, then it's okay to buy the game. If you convince yourself that no single game is ever worth the headache of bugs, then you'll be a much happier gamer.

      --
      And the men who hold high places must be the ones who start
      To mold a new reality... closer to the heart
    2. Re:So stop buying unfinished games by Jamu · · Score: 1

      And once they have your money, don't expect much in the way of patches. They'll be expecting you to give them more money for the sequel, and will be too busy making that to fix any significant bugs in the game you just bought. The sequel will be full of bugs too.

      --
      Who ordered that?
    3. Re:So stop buying unfinished games by Jaysyn · · Score: 1

      Stardock is the exception to this, the get feedack directly from the players to make their games better.

      Jaysyn

      --
      There is a war going on for your mind.
    4. Re:So stop buying unfinished games by Anonymous Coward · · Score: 0

      But dude, Oblivion is pure crack, and I *gots* ta have my crack.

    5. Re:So stop buying unfinished games by mESSDan · · Score: 3, Insightful
      This will only change if all you idiots will stop buying buggy unfinished games! As long as you keep buying beta-quality stuff, and the companies keep making their sales and profit goals, they'll keep doing it.
      At what point do we learn that a particular game is buggy and/or unfinished? The day the game is released? Do we wait for the game reviews at IGN / Gamerankings? How on earth do you find out if a game is buggy or unfinished unless someone, somewhere, buys it? If no one buys the game because they don't know if it has any bugs in it or not, then who finds the bugs?

      I certainly don't trust the shills at IGN to tell me about any bugs / problems. I do tend to trust the aggregate at Gamerankings, because then I can drill down and see exactly what went wrong, and where.

      And what about the bugs that only impact one particular subset of PC? (Ie: No bugs if you use NVIDIA, but lots if you use ATI), how do bugs like that get found out if no one buys it?
      --

      -- Dan
    6. Re:So stop buying unfinished games by Swift(void) · · Score: 1

      3 months? Are you getting your player reviews via snail mail or something? 1 week is sufficient for all but the smallest of game developers. If gamers get a game that is full of bugs and glitches, they are generally pretty quick to whinge about it on the official forums.

    7. Re:So stop buying unfinished games by LordNimon · · Score: 1

      If you wait three months, you allow time for a bug fix to be released. If no bug fixes have been released after three months, then you can assume that they won't get fixed ever, and you can buy a different game. The whole point is to send a message to the developers that you're willing to wait for a quality product. Waiting one week is not really waiting at all.

      --
      And the men who hold high places must be the ones who start
      To mold a new reality... closer to the heart
    8. Re:So stop buying unfinished games by Babbster · · Score: 1

      If no one buys the game because they don't know if it has any bugs in it or not, then who finds the bugs?

      The answer to that is a simple one: There are always sucke...people...who are willing to run out and buy a game on day 1 of its release. The advice in question is meant for people who actually can stand to wait an extra month or two for a game. The folks who go so far as to preorder (one of the worst develops in retail game sales) a game will continue to do so because they've already decided that they don't care when they end up getting the worst possible gameplay experience. For the rest of us, we can watch these people complain, chuckle a bit and then pick up the game after we've heard that 19 out of 20 game-crashing bugs have already been fixed. In those cases where for some reason the bugs never get fixed, we can either choose not to buy at all or wait for the price point where we would feel a buggy game is acceptable.

    9. Re:So stop buying unfinished games by mESSDan · · Score: 1

      How is this different than how it is now?

      --

      -- Dan
    10. Re:So stop buying unfinished games by Anonymous Coward · · Score: 0

      Well, there are quite a number of places from where you can download ... er ... test versions of games *cough* *cough*

      You install, test it and if you find it fun and worth the price you buy it (the point here is to avoid being deceived by game publishers, NOT to slime your way out of paying for good games)

      I know somebody *smile* who has been saved from paying a bundle for several crappy and/or buggy games for which many games reviewing sites could barelly hold themselfs from singing praises (hi IGN).

      Just keep in mind this: If you like it buy it - game publishers/developers that actually put out good stable games deserve all the support they can get. This of course in counterpoint to some of the industry big names (hi EA) which are the worst sinners when it comes to buggy/crappy/unbalanced games.

    11. Re:So stop buying unfinished games by Babbster · · Score: 1

      It's not, but maybe a few of the people with potential to be sensible will take the advice and reduce those early sales numbers enough to where developers and publishers figure things out. :)

    12. Re:So stop buying unfinished games by LordEd · · Score: 1

      Wait at least 3 months, and then visit online forums to see what other players think.

      Except your just told us not to buy any newly released game. If nobody buys it, who will be in the online forumns to tell us about it?

    13. Re:So stop buying unfinished games by Anonymous Coward · · Score: 0

      just wait another 3 months ;)

  8. Consoles by Quiet_Desperation · · Score: 4, Insightful

    This is why I like console games a bit better. There's exceptions, but they tend to just work. They're kind of the Macs of the gaming world: just one system to design for.

    1. Re:Consoles by stone2020 · · Score: 1

      I would tend to agree with you in the past but now even Xbox 360 games are buggy and I'm sure PS3 games will be too. Why? Games are getting very complicated and are released too early. Plus now most consoles will have hard drives and the developers can say the same thing as they do on PC. We'll release a patch later to fix it.

    2. Re:Consoles by dividedsky319 · · Score: 1

      I disagree... I was just having this conversation with someone the other day.

      When I first saw this article, I thought it WAS referring to consoles. I've been amazed by the number of patches to games via Xbox Live for the Xbox360. I don't have one myself, but I constantly hear about various patches for various games.

      Sure, some of them add content, which are nice... but a lot of them are to fix problems. (For example, I've been hearing a lot about a patch to fix some baseball game some people are having problems with)

      So in the current state of consoles being online and having hard drives, I DO see console gaming going to a more "patch" friendly system... which isn't necessarily a good thing.

    3. Re:Consoles by tweek · · Score: 1

      What gets me is how a game company can fuck up a console game!

      It's not as if there's a broad hardware base they have to test against. As someone said more recently in this thread, now that xbox 360 has a patching system, developers can rush games out the door and patch later.

      --
      "Fighting the underpants gnomes since 1998!" "Bruce Schneier knows the state of schroedinger's cat"
    4. Re:Consoles by Anonymous Coward · · Score: 0

      How do those that bought the "basic" XBox360 install the patches, considering that they don't have a harddisk?

    5. Re:Consoles by captaincucumber · · Score: 2, Informative

      That used to be true.

      But I've found bugs in every game I've played on the XBOX lately. Prince of Persia 3 has sound bugs (sound doesn't stop playing even after you've left behind the area that was 'generating' the sound - e.g. a water fountain), game-freeze bugs, and control bugs. Lego Star wars has a game-freeze bug - very reproducible, just hang out outside the Cantina long enough. Tomb Raider has "Lara gets stuck" bugs. I could go on.

      Bugs, bugs, bugs. They're everywhere. You know how some sites break down their scores - Audio, Graphics, Tilt, etc? They should add another one that conveys how many bugs you are likely to encounter per hour of gameplay, and how catastrophic they are.

    6. Re:Consoles by Suddenly_Dead · · Score: 1

      They obvious can't, which makes this even worse.

  9. Ding! Wrong answer. by pcgamez · · Score: 5, Interesting

    "If you scan through the PC reviews, on this and any other site, you will notice an overabundance of games that lost points or otherwise hampered their players' experience by being unpolished, full of bugs, and sometimes downright annoying to play."

    That is precisely what I am NOT seeing. One if the biggest problems with reviews is that the reviewer rarely depends on the product (or even pretends to). For instance, take a new car review. The reviewer might mention (this happened in a long term study in a major car magazine recently) that they had to have it in the shop on average once every three weeks for eight months. For those of us in the real world, being without our vehicle for at LEAST 2-3 hours (often 2-3 days) every month would cause major problems. For them, it is a minor issue because they are not dependant on the product.

    The same applies to gaming. If I purchase a product and it won't work correctly out of the box on my system (most recent example: galciv2), I can't play it. This is because I have one decent gaming system. Sure, for those out there that have more than one gaming system it is a minor inconvenience, but for the other 99%... Reviewers constantly ignore this. If they have that issue they simply use another review system and note it in the review. The game may lose 2/10 points for that. Unfortunately, saying a game is say 7/10 including that issue does not reveal the actual rating of the product, because many people will be unable to use it, making it a 0/10.

    The response to this is often "just wait for a patch." Fantastic. I paid $50 for a game that by the time it is playable for me the retail price has dropped to $40 and I am just then getting to play. Can I take it back? Nope, not under current laws. Does the consumer get screwed? Yep.

  10. Beta testing is a Marketing Function by Banner · · Score: 2, Informative

    Not a quality function. Yes of course users are doing Beta testing, the whole purpose of Beta testing isn't to find bugs in the product, but to find out if you're hitting the market and providing the features that people want!

    Alpha testing is actual testing, and what game testers who work at places like EA do. Not Beta.

    1. Re:Beta testing is a Marketing Function by DingerX · · Score: 1

      Yeah? So I should stop testing at alpha? No need to do beta or final testing? After all, once I get all the functionality in there, it'll work great together

      No offense, but your definition of beta testing does not correspond to mine.

      The label "beta" has been applied and misapplied as a marketing tool, but that does not mean that the stage, and the QA processes with it, mysteriously disappears by an act of newspeak.

    2. Re:Beta testing is a Marketing Function by Banner · · Score: 1

      Testing isn't exactly a QA function. You cannot test quality into a product. Testing is to allow you to figure out where your development went wrong and fix those mistakes (hopefully) you can find before they go out the door.

      However, Beta is a marketing tool, NOT a QA tool, unless you believe in QA's role as a customer advocate to bring the customer the features they want. I did not say to stop testing after alpha, but if your company is relying on Beta to find bugs, your company is making a crappy non-quality product.

      And I'm not talking newspeak, I've been doing QA over 20 years now. Beta was a marketing tool even when I was a developer prior to that.

    3. Re:Beta testing is a Marketing Function by Aceticon · · Score: 1

      Not a quality function. Yes of course users are doing Beta testing, the whole purpose of Beta testing isn't to find bugs in the product, but to find out if you're hitting the market and providing the features that people want!

      Not exactly. For products, Beta testing is testing the software in a wide range of target production environments and real life conditions. The idea is to have many people in many different machines exercising the software without developer bias (ie doing to the software the kind of things that users do and which developers never though anybody would ever do ;)).

      Definning the set of features of a software product (or any software program) is something that happens at the beginning. At the most, if you're doing cyclical development you can postpone the details of some types of requirements until the beginning of the cycle in which they are to be developed - at this point you might get some user feedback, but this is rarer for products since it's done with the help ofan in house representative user and you rarelly have one for a product. This is as far as it goes.

      Beta testing on the other hand is something that only happens at the very end of the product development cycle. At that point you absolutely don't want any new features or big changes to features. At most small changes to critical usability issues. Getting customer feedback on major features at the end of the development cycle is a great way of starting all over again.

      Usually developers do beta testing with a limited group of voluntary, non-paying users. After the issues discovered in beta testing are solved, the game to sale in stores (note that if beta testing brought up critical issues that required structural changes to the code, there might be a beta testing of the new version).

      Unfortunately some games publishers still put out games that were never beta tested.

  11. I dunno by voice_of_all_reason · · Score: 1

    I see it as sort of a bonus. Especially with Diablo 2, by the time I got the full version they had changed a bunch of stuff from Shareware that I'd liked. So I found an original copy and patched it just up to the point where the bugfixes outweighed the funky balance changes.

  12. Again? by Usekh · · Score: 2, Funny

    You know I was just thinking this morning that it was time for the 6 monthly posting of this complaint.

  13. duh by fimion · · Score: 1

    1) make half a game
    2) put it out in stores
    3) ???
    4) profit!

    1. Re:duh by dootbran · · Score: 1

      What, couldn't think of a Yakov Smirnoff joke? I would mod you down if I had points...

  14. this has been true for a long time by Surt · · Score: 3, Insightful

    Pretty much since the internet made it plausible to distribute patches. Most games have had significant patches since at least 1996. So the article might better say: game devs are still relying on users to discover significant bugs in their products, and this status quo has maintained its strength in spite of a decade of complaints from pseudo journals.

    --
    "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
  15. Inevitable by bateleur · · Score: 1

    That's evolution. The market selects the most profitable approach.

  16. What about graphics card drivers? by tylersoze · · Score: 1

    There is also plenty of blame to go to the graphics card card devs as well if you want to talk about stuff being in continual beta. 3rd graphics were the worst thing to happen to games, I say that only half jokingly. :) I love when you need to update the driver to work with a certain game only to have it break with another. Just this weekend, I got the urge to reinstall AvP and I had to find the magic nVidia driver version that worked, previous and later versions broke the game.

  17. There's actually an additional "benefit" of this by Opportunist · · Score: 2, Insightful

    Aside of having cheap beta-testers (and this practice continuing as long as we're dumb enough to jump on every hype the studios present us): It's another anti-cracking feature.

    When a game is released, the cracking groups jump it and try to beat each other in the attempt to release the 0day. But a crack for a patch? Has no priority. You will more often than not notice that the game is cracked the day, or before the day, it appears in the store. A crack for a patch can be delayed by days, sometimes even more than a week.

    Of course, this also serves as an annoyance to those who use cracked games. They have to get the patch, and the corresponding (not any, but the corresponding) crack.

    Let's face it. Game studios have many reasons to release buggy betas, and zero reason to provide us with finished games. So why should they? As long as we buy their buggy betas, this won't stop.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  18. But, but... by Zaurus · · Score: 0, Troll

    ...hasn't beta testing...er, I mean playing WoW for the last couple of years been worth it?

    I mean, for those of you who actually have the time and money to play it...

  19. Penny arcade was talking about this by antifoidulus · · Score: 2, Insightful

    back in 1998....
    The more things change the more they stay the same I suppose.

  20. This is why I don't buy games by MBCook · · Score: 3, Insightful
    This is why I don't buy games. I rent them. It is because of this kind of stuff (combined with just plain awful gameplay). There is only one way to fix this: stop buying the games.

    A few years ago I downloaded the demo of Sim Golf and loved it. So I went out and bought the game. BIG MISTAKE. That game was horrendously buggy and most of the bugs were glaringly obvious too. Token example: golfer complain about having to walk up hills, so you get them golf carts. When driving a golf cart up hill... they would complain about walking up hills. They fixed this, but it's the kind of thing that struck you instantly and should have been caught. Add in bugs that prevented you from editing your courses, playing your courses, and other such things and the game became almost unplayable and lost all it's fun.

    This is one of the reasons why I stick to console title now, but as I've said I rent them because this kind of stuff is starting to creep in (combined with just plain bad games). This is a real shame because if I find a game that I really like, I won't buy it because I beat it while it was rented and I have no reason to go buy it since I won't play it. It is a very rare exception that I buy the game (Frequency and Amplitude are about the only two).

    There are only a few companies and game series that I will buy without playing first. Nintendo is probably 90% of that. Harmonix is another company that has achieved that status for me. Other companies that had it decided they didn't care and lost it due to blunders (bad games, buggy games, whatever).

    If you buy a game and it's buggy... RETURN IT. COMPLAIN to the company and the retailer. It is DEFECTIVE. If you put up with that kind of treatment, it will only get worse (as history has shown).

    I think a good test is the zero day patch for game-play. If there is a patch out when the game is released (or within any short time frame) that fixes game-play bugs (hardware compatibility stuff is OK) then that company just doesn't care. Don't give 'em your money.

    Let's look at Nintendo. I can't remember experiencing any bugs in their games (I've seen them in plenty of others). Do you remember what happened when it was found out that Pokemon Gold & Silver wouldn't let you harvest berries after you had been playing for a year or two? Many companies would say "too bad" or "here's $5" or "send it it, but you'll lose all your data". Nintendo fixed it. For free. On a two year old game. And then even gave you a rare item or a rare Pokemon as an apology gift. Pure class.

    And notice it took like two years of playing to find that bug. I realize that Pokemon Gold and Silver are less complex than Oblivion and other recent games... but the sheer number of bugs in such a large volume of games can't be blamed on complexity alone but hubris and an uncaring attitude towards the consumer.

    --
    Comment forecast: Bits of genius surrounded by a sea of mediocrity.
    1. Re:This is why I don't buy games by basscomm · · Score: 1

      Let's look at Nintendo. I can't remember experiencing any bugs in their games.

      Nintendo has shipped plenty of games with bugs. How about the Minus World in Super Mario Bros.?

      --
      http://crummysocks.com
    2. Re:This is why I don't buy games by Yosho · · Score: 1

      "I can't remember experiencing any bugs in their games" != "I've never heard of any bugs in their games". Heck, the original poster described a bug in their very next sentence.

      --
      Karma: Terrifying (mostly affected by atrocities you've committed)
  21. One can hardly blame the game programmers... by DarthChris · · Score: 1

    ...they're just following Microsoft's excellent example.

    Seriously though, I would put more blame on the game publishers forcing games out early (LucasArts is especially bad for this) than those who write them.

    --
    Don't you just hate it when people reply to your signature?
  22. Is this the case anymore? by TheSkepticalOptimist · · Score: 2, Interesting

    I know I complain when people whine about news being old, but I think this story missed the mark by about 10 years.

    It used to be that any game I bought had about 10 patches before the month its was released changed.

    Now, it seems like game are in perpetual development, NOT being released to customers, ever (Duke Nukem Forever). Games like Half Life 2 and Quake 4 were in development for years and missed umpteen deadlines before they finally came out, and the developer's excuses were they wanted to make it perfect.

    While I don't play the whole plethora of games available today, I still usually pick up the popular titles. I find very few times that any of the big releases have any issues that prevent enjoyable gameplay. When a patch is made available (months after release), it usually tweaks games settings or fixes (usually) any multiplayer networking problems. These kinds of issues can only be encountered once something enters wide release. No beta environment could every duplicate what the open market can find for bugs (re, beta testers are usually people in the know, real life is actually filled with morons and people without a clue).

    I seldom ever find myself using a game that feels like a beta.

    The problem I have is, I would rather a company release a game that might still have a few lingering issues, and then patch it later, rather then holding a game from release for 12 - 18 months to make it perfect. As long as those issues do not interrupt gameplay, or are only encountered infrequently or very randomly, then I won't mind playing the game. What I can't stand is the idea that developers spend 3 months tracking down a bug that maybe only 5% of the market would ever encounter, and that only being once in their life time.

    HL2 and Duke Nukem Forever are extremes in this case, where people make it a career to hype about a game that takes years to develop, and then keep postponing it indefinitely. For the most part, I don't need a game to be perfect on release, just good enough to play without too many interruptions or problems. I would be hypercritical of a game that has bugs but was still delayed 12 - 18 months to make it perfect over a game that was released too soon but has a quick patch cycle.

    --
    I haven't thought of anything clever to put here, but then again most of you haven't either.
    1. Re:Is this the case anymore? by Anonymous Coward · · Score: 0
      Parent uses Half-Life 2 as an example of a game that had an extremely long development cycle but fails to mention that it was also horribly bugridden -- even two years after release.

      I bought the game about a month ago and patched it completely with Steam before I started playing. Here are four "should have been considered shipstopper" bugs I encountered:

      • I managed to get two distinct copies of Alyx in "Entanglement".
      • the turrets attacked and killed Eli Vance in the teleporter chamber. Alyx and Mossman just stood there motionless afterwards.
      • Dog didn't show up to lift the wall between "Follow Freeman" and "Our Benefactors", but Barney stood there saying "Go on, Freeman".
      • I was unable to jump after my weapons were confiscated, so I couldn't get past the third set of terminals until I loaded an older save game.


      How the fsck do you manage to get 2 copies of one of the most important characters in the game? Anyone that's coded for more than a few days knows how to keep that from happening. Honestly, I think code review should have found all of those bugs. To me it's very obvious was rushed. I really wish they had spent another couple of weeks or even months polishing it.

      Don't get me wrong. I thoroughly enjoyed the game, but I can't let someone hold it up as a shining example. When a game still has four shipstopper bugs two years after its release, the only thing it proves is that if it's not ready when it's shipped, then the bugs will never be fixed.
  23. Beta? by Anonymous Coward · · Score: 0

    Last I knew, Beta testing was for adding and testing content. The code is supposed to be complete by Alpha, and stable by Beta.

  24. Complete opposite of the point.. gg.... by ninji · · Score: 1

    I think you missed the authors point entirely, and somehow got the exact opposite meaning. Googles products ARE stable, and still in beta. The issue as the article mentions it, is several things that are still in beta form are being released as complete games, and the paid players revliantly testing it. (Beta games being released as real, not real being still in beta)

    Google is the opposite, keeping it in beta past the point it reaches stablility to absoloutely assure its completed quality.

  25. Yet another reason not to buy new releases... by frosty_tsm · · Score: 1

    If the higher price isn't enough reason, now we know to wait 3-6 months for the price to go down and the bugs to be fixed.

    There are some games that don't even bother to fix the bugs, so a buyer could scout out whether the community is still dealing with bugs or not.

  26. What Rock Are You Living Under? by armyturtle · · Score: 1

    What rock have you been living under? (To the article submitter.) Game companies have been doing this for MANY years. I can remember buying "The Sims Online" long ago & immediately after installing it it commanded a 26MB patch download. Every day after that for many months it seemed as though they had a new 10-20MB patch to be downloaded each time I connected. I remember they marketed the game to both broadband & dial up users, as broadband was NOT the norm then. I wonder what the hell the dial users did???

    Now let's talk Xbox 360. Every game I own for this thing (including the famous Call of Duty 2) has required an immediate patch download. I knew the instant broadband connectivity was paired up with a console with a Hard Drive installed it would spell then end of users actually being able to buy a complete game in the stores. There was a day when you could walk into a store with confidence & know they had to finish the damn thing before selling it because once they pressed out millions of copies onto CD/DVD, people WOULD NOT accept a piece of crap.

    The forums for Call of Duty 2 are filled with people pissed off about lag, disconnect, glitch issues, & lack of basic features such as voting to change the map, kick a player, etc. However the Call of Duty folk have simply ignored their user base & took their time answering people & patching the game.

    Just goes to show once they have your $$ they don't care much about what you think.

    --
    Wherever you go, there you are. :D
  27. He's pretty close. by RomSteady · · Score: 4, Insightful

    First off, I should probably lay out my credentials. My name is Michael Russell, and I'm the QA Manager for Ritual Entertainment. We're going to be releasing "SiN Episodes: Emergence" over Steam on May 10.

    In some ways, Greg Atkinson is absolutely right, but he seems to be right for the wrong reasons.

    There are three global problems in game development: marketing usually promises a date that cannot be met, throwing more people at a problem cannot fix it, and bugs found at the end of a project are hard to impossible to fix.

    The marketing date is a huge issue because 90% of the time, the people making the game have no buy-in regarding it. They're working towards being done when it's done, and then when they get told that they have six months when they need a year, things get implemented too fast and half-assed.

    Of course, here we are at six months out with no testing so far. In fact, the game is generally in an untestable state due to the huge influx of new, untested, unstable code and/or assets. Several major developers and publishers are now moving to the "monkey" model of testing: hire 100 temps for six weeks at the end, have them hammer on the game, and the end result is 5,000 bugs with little time to fix it.

    So, the team gets the game to a basic level of functionality, throws it in a box, and gets to work on the patch while the box winds its way to retail.

    Until the industry as a whole learns that QA is no longer just a line-item expense but a necessity, we're going to have issues like this.

    Console developers are starting to get it, but mostly because the platform holders have a set of tests that every game released on the console must pass. Fail one test or a permutation of one test, and there is a high likelihood that you won't ship. Suddenly, spending an extra few dollars on testing early to find and fix the problem doesn't seem like a big expenditure compared to the nightmare that is missing your street date.

    I'm happy that we've had testing on "SiN Episodes: Emergence" from day 1. Are there still going to be bugs? Always...there's nothing you can do to eliminate bugs entirely. It's the nature of software development. But by getting on the project early and testing through to the end, we're able to make sure that the game is stable, completable, and fun out of the box.

    And for a game, that's all you can ask.

    --
    RomSteady - I came, I saw, I tested. GamerTag: RomSteady / http://www.romsteady.net
    1. Re:He's pretty close. by Aragorn379 · · Score: 1

      The marketing date is a huge issue because 90% of the time, the people making the game have no buy-in regarding it. They're working towards being done when it's done, and then when they get told that they have six months when they need a year, things get implemented too fast and half-assed.

      I think that's a poor excuse. The date needs to be agreed on between marketing and development well ahead of time. A rough date should probably be part of the initial game design where the game is being defined.

      Even if marketing solely decides the date and doesn't give the date until 6 months out, development shouldn't just ignore that they need 1 year and stick their heads in the sand. At that point development needs to go back to marketing and try to work things out. If the date is fixed, then the game needs to be rescoped until it fits in the time available, even if it means removing features. It's better to have a slightly smaller, playable game then a larger, bug-ridden beast.

      If both schedule and feature list are fixed, then it is managements fault for not manageing properly.

      The game companies are killing their own market. I haven't bought many games since the games starting getting buggy and unbalanced on release. At $50 a game, I expect pretty near perfection. Lower the price and I'll be more lenient. Lately, I've been playing online games instead since once you find a good one you can play it for a long time and don't have to worry much about bugs anymore.

  28. Well, you could have no game at all. by Malkin · · Score: 1

    Sometimes, in spite of all the blood, sweat, and tears that went into it, a high-minded developer who lacks sufficient funds to finish polishing a product chooses not to ship at all, rather than release something unfinished. Is this the best approach? Would you prefer nothing at all to a buggy product?

    Unfortunately, games cost money to make, and there isn't always enough money to make it to the finish line. Sometimes, they need to release SOMETHING, just so that the company won't go out of business. The failure rates for game companies are absolutely phenomenal.

    Is that really what you want? Fewer games? Because that's possibly what you're asking for, whether you realize it or not.

    1. Re:Well, you could have no game at all. by Anonymous Coward · · Score: 0

      You've apparently never heard the phrase "Quality over quantity".

    2. Re:Well, you could have no game at all. by SanityInAnarchy · · Score: 1

      Sometimes, they need to release SOMETHING, just so that the company won't go out of business.

      That's no excuse.

      At least put a warning label on it. Call it Beta, and promise to finish it or go bankrupt. Sometimes I want one of the fewer games of release quality, sometimes I want a beta. Let me choose, don't take my money and then tell me it's beta.

      --
      Don't thank God, thank a doctor!
    3. Re:Well, you could have no game at all. by Malkin · · Score: 1

      You've apparently never heard the phrase "pink slip."

    4. Re:Well, you could have no game at all. by Malkin · · Score: 1

      At least put a warning label on it.

      Well, in most media, this is what reviewers are for. Roger Ebert, for example, is happy to point out that he watches bad movies, so you don't have to. If you just buy any old thing that comes in a pretty box, you've got nothing but yourself to blame. There's a lot of crap out there -- even finished crap.

    5. Re:Well, you could have no game at all. by rehtonAesoohC · · Score: 1

      To be honest, if there were fewer games out each year but each game released had 50% less bugs than previously released games, I would be completely satisfied. On the other hand, I'm a fairly patient person when it comes to game glitches, so unless the game refuses to work at all, I'd be fine with the way they are written at this point in time.

      I suppose I'm easy to please :)

  29. World of Warcraft by metasecure · · Score: 0, Flamebait

    I've been beta testing this game since August 2004 =)

  30. Don't we call this... by ManoMarks · · Score: 1

    Gamma Testing?

    --

    That's gotta fit into your schema somewhere

  31. News? by Anonymous Coward · · Score: 0

    This is news? Tell us something we DON'T already know.

  32. To think this all started with Unreal (kind of) by ShyGuy91284 · · Score: 1

    Although patches weren't terribly uncommon back then (Quake has used them for a while), I remember the original Unreal to be the first mainstream game that really worked like this (there may have been others I don't know about though). Right in the box, there was a slip that said it was somewhat incomplete and thus somewhat still in the testing phase. I found that to be rather interesting that they did that.

    --
    In undeveloped countries, the consumer controls the market. In capitalist America, the market controls you.
  33. Um, that's Alpha. by SanityInAnarchy · · Score: 1

    You're right about this:

    The code is supposed to be complete by Alpha, and stable by Beta.

    But shouldn't that be true of the content as well? Or at least, complete by Beta, and stable by release -- that is, beta testing is saying, it's done, we know there are still bugs, but we can't find any more on our own.

    --
    Don't thank God, thank a doctor!
  34. only... by Metroid72 · · Score: 1

    in the PC gaming world.

    In the past QA for games was much more vital due to the media (cartridges). I don't doubt that developers are also pushing for online features so they can push more games out the door, rather than focusing on delivering a finished product.

    It's all about getting the buck as soon as possible for them. Bugs... let's worry about those later.

  35. Blaming the wrong people by TubeSteak · · Score: 2, Insightful

    It usually isn't the game developers that push out buggy games, but the publisher.

    When the publisher isn't the developer, it's the publisher who sets the release date. Then everyone complains about bugs and the developers go back and fix everything they would have caught with sufficient testing..

    --
    [Fuck Beta]
    o0t!
    1. Re:Blaming the wrong people by DingerX · · Score: 1

      I love that excuse. This is the classic "pass the buck" line used to justify every disastrous release in the last two decades.

      Publishers set the release date. Really? And HOW do they set the release date? By asking the developer, "when will this be ready?" So the developer's failing to deliver the product on in time is not the publisher's fault. The publisher, on the other hand, has the job of working out all the time-sensitive deals that make a product go: advertisements, baksheesh to the gaming rags, duplication and distribution. When the developer says "Oh, uh, wait, when I said it'd be ready in June, I mean 2007, not 2006," the publisher has to evaluate the cost of every delay versus the advantage of dumping a crappy product early.

      Yeah, I know, developers are stuck with A) a shifting technological landscape, making every product speculative B) often an amateur design team: highly motivated, highly creative, but not always willing to give every aspect of the product the same attention C) whiny fanbois and Riff Randellesque community managers and D) distributors who change requirements at the last minute.

      But buggy games aren't the publisher's fault; really nasty product abortions are indicative of systemic failure, starting with the developers.

    2. Re:Blaming the wrong people by Schraegstrichpunkt · · Score: 1
      Publishers set the release date. Really? And HOW do they set the release date? By asking the developer, "when will this be ready?" So the developer's failing to deliver the product on in time is not the publisher's fault.

      The problem, as you say, is with inexperienced developers:

      Publisher: "When will this be ready?"
      Developer: "It could take anywhere between 16 and 24 months."
      Publisher: "That's unacceptable, don't have such a negative attitude!"
      Developer: "Well, if we're really lucky, and we cut features X, Y, and Z, we might be able to get it done in 12 months."
      Publisher: "Good, you have 12 months"
      11 months later...
      Publisher: "Can I see a demo?" Developer: "Huh? Okay, I guess." Publisher: "Could I ask you to make one small change?" Developer: "Sure, what?" Publisher: "I want feature X" Developer: "..." Publisher: "Oh, and features Y and Z as well." Developer: "Okay, but that will take us another year." Publisher: "YOU PROMISED ME THAT YOU WOULD BE FINISHED IN 12 MONTHS!" Developer: "..."

      This is obviously the fault of the developer, who should have simply maintained, "It will take 24 months."

    3. Re:Blaming the wrong people by robnauta · · Score: 1
      This is obviously the fault of the developer, who should have simply maintained, "It will take 24 months."

      Sure, but this developer might soon be unemployed. Of course, within a company you should be firm towards managers. But in the game industry there are two parties involved. The publisher wants a game, say a first-person shooter. They contact a developer, who says he can make that game in 18 months. The publisher says 'OK, here's 20 million dollar, go make that game'.

      The opposite happens too, that a game studio has a good idea and needs a publisher to fund 18 months of employing 50 people to make the game. If the publisher says "we want these features and we want it in 18 months", you can't really remain strict and insist that you will need 24 months. Just cut some features and levels. This might not fit the idea that's inside your head, but life's full of compromises anyway.

  36. He's pretty close-"/." Interview: Ask Michael. by Anonymous Coward · · Score: 0

    And just how much of a role does buying a "pre-existing" game engine play towards keeping down the bugs, and shortening development time? And why don't more game companies do that?

    1. Re:He's pretty close-"/." Interview: Ask Michael. by RomSteady · · Score: 1

      Generally, the bug count is the same whether you are using a pre-existing engine or a new engine.

      With pre-existing engines, the engine-related bugs are more focused on usage scenarios that were never anticipated with the original engine (surface penetration, rotating geometry, gravity normals, etc.) or bugs that were there, but never found or were found, not documented, and as a result, never fixed. With new engines, you get some of that (design almost always goes beyond the originally decided-on limits of the code), but you get bugs that are significantly lower-level (memory allocator going haywire, etc.)

      You still get the same level of content bugs, however.

      --
      RomSteady - I came, I saw, I tested. GamerTag: RomSteady / http://www.romsteady.net
  37. Re:Ding! Wrong answer. by SlayerofGods · · Score: 1

    And even if you had gotten galciv2 to run the game was a disaster: dozens of crashes, messed up interface, pitiful documentation, blatant AI stupidity (which I found really surprising given how much talk about how smart it was suppose to be). All of which most reviewers don't even mention.
    They all seem so taken by the fact that some no name company made a good game they don't want to point out it's many glaring problems.

    --

    Technology, the cause of and solution to all of life's problems.
  38. I could see patching to balance the game... by Rumtis · · Score: 1

    I have to agree with most of the sentiment here.
    1) It's nothing new. (For us old folks, remember Microprose?)
    2) It's not ever going to go away.

    Where there are some stupid bugs that have made it through to the release, I can see patching a game to help keep the balance.

    I give credit to certain game makers for trying to make a RTS whos units have different strengths and weaknesses, but I can remember the tank rushes from the original Command and Conquer and the Zergling rushes of Starcraft that lost players since their opponent would always resort to cheesy tactics. No fun = lost interest.
    Sometimes it's just too hard to figure out what the cheap shot of these types of games are ahead of time. They're better now, but there always seems like they need to tweak the balancing of units.

    This does, in no way, let them off the hook for letting stupid bugs through.

    Anyway, my $0.02

    I wonder: What (in)famous cheesiness do you remember from games? I'm not talking about cheating (like wallhacking or the like), but obvious imbalances built into games that made the game not fun to challenge an opponent since they could always take advantage of the same move or the like.
    For example:
    Ryu (and Ken?)'s fireball/uppercut combo; in Street Fighter II

    1. Re:I could see patching to balance the game... by SanityInAnarchy · · Score: 1

      No one's complaining that patches exist. We're complaining that what's being released is not a complete game until you get the patch. Usually, I'd prefer you leave my gameplay alone. Minor gameplay tweaks don't hurt anyone, but major rebalancing should probably be saved for a sequel, or introduced as a UT-like "mutator".

      But I don't care so much about gameplay patches. The things that bother me are bugs in the code, which make a game unplayable until a patch is released.

      Doesn't bother me so much, though. I always wait a few months (or years) before buying a game, so I install, patch, and play -- works fine, out of the box. Costs less, too, since I waited.

      The fact that there's an easy way around it doesn't make it right, though, just as Blue Hippo should still be ashamed of themselves for being such a ripoff, even if the smart people will simply buy their computers elsewhere.

      --
      Don't thank God, thank a doctor!
    2. Re:I could see patching to balance the game... by dootbran · · Score: 1

      This really depends on the game, in most single player games I'd agree. Leave it alone, save for some glitches. ie. the hurricane packs for NG that fixed the camera issues. Balancing a game for single player isn't as big a deal.

      As for multiplayer, I'm all for periodic tweaks to the game to try to balance things out. How many times has Blizzard tweaked Warcraft 3 over the years? Change the health on this, the speed on that, hmm maybe this unit should have a different armor type... all in the name of making the game more balanced. These gameplay changes might have even helped to keep the community interested in the game by forcing players to rethink their strategy .

  39. Complex games, cutthroat market by HunterZ · · Score: 1

    My guess is that it's due to a combination of factors:

    - Games are a lot more complex these days, with a lot more places that things can go wrong. More and better testing is required to assure the same level of product quality as in yesterday's games. This testing isn't happening; perhaps because schedules haven't changed with the games to reflect the additional required testing time.

    - Games don't have as long of a shelf life these days, especially PC games (which, incidentally, are easier to release patches for), and every aspect of their development is probably managed with this fact in mind. Unless you make a smash hit game of the year best seller, your game isn't going to be in the public eye long enough for people to care about the bugs. At least, that's what the publishers are hoping when they throw deadlines at the developers.

    - Publishers these days own so many labels that they are able to assign various publishing labels to games depending on their level of market risk. This means that they don't have to worry about sacrificing brand loyalty on a crap game. If it's a smash hit, they can re-release it or release a sequel under a more respected label that they own. My point? Less accountability for quality on the publisher's part, which allows them to put heavier pressure on developers to release games before they're finished.

    --
    Arguing about vi versus Emacs is like arguing whether it's better to make fire by rubbing sticks or banging rocks.
  40. We're already seeing patches for consoles now... by Nananine · · Score: 1

    Oblivion for the 360 is getting a patch, for example. Having hard drive for downloadable content is a double edged sword in this regard.

    Also, obligatory "Oblivion is an awesome game anyways" that everyone always says. Because, really, it still is an awesome game.

  41. I agree. by Matilda+the+Hun · · Score: 1

    Not to bob my head, but I'm especially seeing this with Knights of the Old Republic II. It's been out for, what, a good year? And yet gameplay is still plagued with cinematic bugs and a good chunk of the last third of the game was cut completely. The site itself says that there's an ongoing bug where, if you stay in any one area without hitting a cutscene for more than 40 minutes, your game is prone to crashing. Maybe it's just me, but this strikes me as a very "Should've-been-fixed-before-the-release" type of bug.

    What makes this more irritating is the fact that once the game's released, developers keep saying "We'll fix it next patch, we'll fix it next patch"...and then the company decides to take the developers off that project and onto another one, since fixing games that're 6 months old won't make them as much money anymore. So these bugs and dropped features never get fixed.

    --
    Tluin natha Linux xxizzuss uriu olt bwael mon'tun.
  42. Developer's Dilemma by sunderland56 · · Score: 1
    If you put out a game on schedule, everyone bitches that it's buggy.


    If you delay the game until it's ready, everyone bitches that it's late.


    If you split the difference, everyone bitches that it's buggy and late.


    If you manage to stop adding features early enough so that you actually ship a game that's on time and pretty much bug free, everyone bitches that the gameplay is lame, and they should have added feature x from other game y.


    And if you hire enough programmers to put out a massive killer game on time without bugs, but have the audacity to actually charge enough to pay all those people a decent wage, everyone bitches that it's too expensive.


    Okay, rant over. Back to fixing bugs to please you people.

  43. Re:There's actually an additional "benefit" of thi by PinkPanther · · Score: 1

    So if a game studio figures how to hold off the crackers for a week, then software piracy is history?

    --
    It's a simple matter of complex programming.
  44. You say that, but... by Inoshiro · · Score: 3, Insightful

    Honestly, what impact would random hardware configurations have?

    We've got either Direct3D or Direct3D for our graphics API. DirectSound or DirectSound for our audio API. DirectInput or DirectInput for our input API. (I do realize I'm discluding OpenGL and SDL, which are both great tools, but it's to make a point).

    So with Direct3D, DirectInput, and DirectSound wrapping different hardware, what's the big deal? I can buy the argument that console games will be more optimized because you can get up close and personal with the hardware, since everyone will have the same damn thing.

    No, the differences will be things like games crashing or the computer crashing due to bugs in the DirectX side of the driver, or the kernel-side of the driver.

    So what about gameplay? With gameplay bugs, that's logic in the program. If I shoot you and you don't die, that's not because I have an ATI video card instead of an nVidia card, it's because the hit detection algorithm is broken.

    Non-fixed platforms mean I have to deal with lower performance (often poorly tuned game design is the major factor here) and maybe crashes, but it doesn't mean I should put up with broken game logic.

    --
    --
    Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.
    1. Re:You say that, but... by FooBarWidget · · Score: 1
      Although DirectX abstracts hardware acceleration, there are still differences between video cards. For example, take a look at the requirements of Ragnarok Online. The page lists only 3 supported chipsets. Other chipsets are marked as "not recommended". Why? Because of differences between DirectX driver implementation and because of bugs in the video card. Back when I had an ATI Rage 128 (I use Nvidia cards now), some icons in the game don't display correctly: they were displayed as 8x8 icons, scaled up to 32x32. When I bought an Nvidia card, the icons suddenly displayed correctly! But that's not all. The first Nvidia card (the one I'm using now is my third) I bought didn't work at all. Playing other 3D games worked fine, but when playing Ragnarok Online, the screen became red and the graphics became corrupted. I downloaded the latest drivers, but that didn't help. I brought the card back to the shop and got a new one, but that one had the same problem.

      Conclusion: it is an illusion to think that if you develop for DirectX, it will work on all Windows installation. It doesn't.

      Heck, DirectX isn't even the only problem. What about networking? I develop a custom client for an online game, and about one out of a hundred people send me emails about networking problems. Those include:
      - The app cannot connect to the server because they're behind a firewall, and they either don't know how to configure the firewall, or they don't have administrator access.
      - The app cannot connect to the server because they're behind a proxy. My app automatically uses IE's proxy settings but apparently sometimes it just doesn't work. I've never been able to find out what exactly causes the problem because I can't even reproduce it.
      - The app cannot can connect to the server but for some reason the connection closes prematurely. The client didn't send any incorrect data and the server had no reason to close the connection. I can't reproduce the problem at all but they can reproduce it every time.
      - Other WinSock problems. Recently someone told me he gets a "Socket Error # 11004". Error 11004 is WSANO_DATA. According to MSDN, that is:
      Valid name, no data record of requested type.
      The requested name is valid and was found in the database, but it does not have the correct associated data being resolved for. The usual example for this is a host name-to-address translation attempt (using gethostbyname or WSAAsyncGetHostByName) which uses the DNS (Domain Name Server). An MX record is returned but no A record--indicating the host itself exists, but is not directly reachable.

      Yet the web browser can access that domain just fine. Again, this is yet another networking bug that I've never been able to reproduce.

      Final conclusion: it is an illusion to think that if you develop for Windows you will have consistency. Apps break for all kinds of weird and unknown reasons that you can never reproduce yourself.
  45. Re:Ding! Wrong answer. by Anonymous Coward · · Score: 0

    Shhh, we are not supposed to criticise the game because they "don't use DRM." Yeah, and having to enter your long serial number every time a patch comes out, or being required to register your product and link the serial number to it in order to download a patch is so much better. Thanks guys!

  46. Simple: by SanityInAnarchy · · Score: 1

    Don't let your PR department release dates that you can't meet.

    If you don't know whether you can make a release date, don't publish a release date. I applaud Duke Nukem Forever for that, at least. People laugh, but if it's good enough, they won't complain about lateness. Remember how long we waited for Half-Life 2? And remember how we didn't even know they were developing it for years?

    The mistake made with HL2 was not the huge development time, it was the announcement of features that weren't included and release dates that weren't met. It was a fine game, but the expectations were just too high.

    So, Duke Nukem Forever made one mistake -- they told us they were working on Duke Nukem Forever. But I don't think it will suffer nearly as much from high expectations when its actually delivered, since, honestly, most people believe it never will be "done".

    --
    Don't thank God, thank a doctor!
  47. Re:There's actually an additional "benefit" of thi by Sigma+7 · · Score: 1
    Let's face it. Game studios have many reasons to release buggy betas, and zero reason to provide us with finished games. So why should they? As long as we buy their buggy betas, this won't stop.


    Actually, they can release finished products.

    They just need to find a trick so that the amateur cracks miss a copy-protection that occurrs at the 75% mark of the game. Even if the game is still possible at that point, it will be much harder to complete. (Just make sure that normal users aren't bitten.)

    Or failing that, have the patches add on extra content or performance enhancements (e.g. improved multiplayer performance, rendering speed, or rendering quality.) As an alernative, release a Director's cut version of the game as a freely downloadable patch (but the original will still be available.)
  48. He's pretty close. Retreat, regroup, reduce. by Anonymous Coward · · Score: 0

    "Even if marketing solely decides the date and doesn't give the date until 6 months out, development shouldn't just ignore that they need 1 year and stick their heads in the sand. At that point development needs to go back to marketing and try to work things out. If the date is fixed, then the game needs to be rescoped until it fits in the time available, even if it means removing features. It's better to have a slightly smaller, playable game then a larger, bug-ridden beast. "

    That sounds like Microsoft's plan for Vista.

    1. Re:He's pretty close. Retreat, regroup, reduce. by Anonymous Coward · · Score: 1, Funny

      "At that point development needs to go back to marketing and try to work things out."

      Haha, you obvious don't work in the business world, do you? Am I right, Michael?

  49. Re:Blaming the wrong people (2nd try) by Schraegstrichpunkt · · Score: 2, Insightful

    [Crap, I knew I should have pressed "Preview"]

    Publishers set the release date. Really? And HOW do they set the release date? By asking the developer, "when will this be ready?" So the developer's failing to deliver the product on in time is not the publisher's fault.

    The problem, as you say, is with inexperienced developers:

    Publisher: "When will this be ready?"
    Developer: "It could take anywhere between 16 and 24 months."
    Publisher: "That's unacceptable, don't have such a negative attitude!"
    Developer: "Well, if we're really lucky, and we cut features X, Y, and Z, we might be able to get it done in 12 months."
    Publisher: "Good, you have 12 months"
    11 months later...
    Publisher: "Can I see a demo?"
    Developer: "Huh? Okay, I guess."
    Publisher: "Could I ask you to make one small change?"
    Developer: "Sure, what?"
    Publisher: "I want feature X"
    Developer: "..."
    Publisher: "Oh, and features Y and Z as well."
    Developer: "Okay, but that will take us another year."
    Publisher: "YOU PROMISED ME THAT YOU WOULD BE FINISHED IN 12 MONTHS!"
    Developer: "..."

    This is obviously the fault of the developer, who should have simply maintained, "It will take 24 months."

  50. When will they learn? by SanityInAnarchy · · Score: 1

    If you're making a console game, unit test, torture test, playtest, and 3-year-old-test. If there are bugs after the game is released, you're morally obligated to replace everyone's media with a patched version, or make sure ALL your customers know of a workaround.

    If you're making a PC game, release it early and call it a beta. Charge no more for the beta (hopefully less) than for the finished product, and upgrade them to the final version for free. And pay attention to your beta testers, and patch every bug found quickly. At least for now, most people will wait for a version they can buy in stores, even if it costs more money.

    --
    Don't thank God, thank a doctor!
  51. Copy protection that makes pirates work harder by garylian · · Score: 1

    Forget StarForce, or any other copy protection. What works is releasing a game that you know has serious bugs in it, and then applying a patch or two that will fix them. Viola, the CD/DVD rippers that love to get original CD images are now hosed up a bit, due to the fact that those bugs have to be patched. Apply patch, fix copy protection that requires the CD to be in the drive. Each patch restores it, and may even check a different spot on the CD surface. Busts up those NoCD cracks pretty quick.

    That means that people that are ripping the game have to look for new cracks, which is a journey fraught with viruses and the like.

    Sure, game companies are inherently lazy and rush product to the shelves. But, now they have added incentive to make us buy unfinished games. And they know that most game players want to have it NOW, so they will live with it. What's to stop them?

    And I can't say I'm different. I can certainly see myself buying NWN2 when it comes out this summer.

  52. Re:There's actually an additional "benefit" of thi by Opportunist · · Score: 1

    Oh, they certainly won't allow you to play 75% of the game. With current games, you lose interest around 50%. So why'd you buy the game?

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  53. Re:There's actually an additional "benefit" of thi by Opportunist · · Score: 1

    Of course not. It's just a little nuisance for the crackers. And it's also the only kind of anti-copying ploy that hurts the copyer more than the buyer, the others are more a nuisance to the "honest" customer than the "illegal" ripper.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  54. Don't pay for betas? by 4D6963 · · Score: 1
    Why are the people now paying to essentially beta test the games rather than purchasing completed games?

    Do like me, don't pay, download from P2P. I refuse to pay for an un-finished game, therefore I only pay for games when no patch has been released in years. I might buy Warcraft I now.

    --
    You just got troll'd!
  55. Patches are bad? You're missing the point... by DeeDob · · Score: 1

    Games are getting more and more complicated and sofisticated every year.

    But games always had bugs. Take perhaps the most successful game in history, Super Mario Bros. Walking through walls, getting stuck on a pixel...

    It's not NEW that games are buggy. You have hundreds of different possible system configurations on PC that can lead to bugs. Games like any Elder Scrolls have an almost limitless number of player driven possibilities. Is it possible to find every single bug in them before release? Not unless the developpers would hire say 500 000 play testers (about the number that would be required for a game like Morrowind, DaggerFall or Oblivion) and push back the game over 2 years just to be sure the game is bug free.

    Most games are playable and enjoyable even with a few bugs. A few are totally broken and it's usually mentionned in their reviews.

    So fact that games can be patched is a "good" thing, not necessarilly a proof of developpers lazyness. They brought out a playable and enjoyable game and i play it and have fun with it. If it's patched later on, so much the better for me.

  56. Those are pretty valid bugs. by Inoshiro · · Score: 1

    But I didn't read anything that sounded like a gameplay issue caused by the video. By gameplay issue, I mean "was unable to get the powerup" or "boss at end of stage 2 was invincible due to video driver."

    The boss at the end of stage 2 may be impossible to see, but that can be fixed without patching the game engine itself. Merely changing the video card will fix it. The OP was referring to problems caused by hardware that made a game unplayable, but those are fixable without patching the games, so I argue that those arent't in the set of bugs to consider. The only ones we should be worried about are the ones that the game programmers are directly responsible for.

    Your ATI Rage 128 didn't break because the RO programmers sucked, it broke because ATI sucks. That's why I don't buy ATI hardware :)

    --
    --
    Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.