Slashdot Mirror


On Champions Of Norrath, Forgiving Game Reviewers?

Thanks to Curmudgeon Gamer for its article discussing technical problems with PS2 title Champions of Norrath: Realms of Everquest, and why official reviews of the game didn't seem to mention those problems. According to the writer, who had been "experiencing frustrating lock-ups and hangs which have caused the loss some of my progress through the game", it turns out that "two of the reviewers did see the game hang and didn't mention it in their reviews." However, he argues: "That's a judgment call, really, and since each saw the problem precisely once I can understand leaving it out of the review", and ends by suggesting that "the real burden rests not on the shoulders of the reviewers but on the creators of the game and, potentially, the console itself."

7 of 52 comments (clear)

  1. Integrity by Dachannien · · Score: 4, Insightful

    This has less to do with game reviews and more to do with journalistic integrity. If a reviewer comes across a serious bug in a game - especially a console game for which a patch is unfeasible - one would think that such a bug would get mentioned in the review.

    Now the question is, was the bug not mentioned because the reviewer didn't consider it to be important, or forgot about it, etc. (e.g., just crappy reporting)? Or was the reviewer under pressure or edited by his superiors so as not to report bugs in the article, due to the financial pressures (no free copies, etc.) that a large console game company could potentially exert on a small online review site (e.g., complete lack of journalistic integrity)?

  2. Pressure on both sides of the story by Anonymous Coward · · Score: 4, Insightful

    I think it was pressure on both the studio to get the game releases and pressure on the press by the publisher to ignore the bugs in the review.

    The game has graphic bugs and freezes there is no one denying that. Supposedly they used some sort of modified DVD9 format which may be part of the problem. I'm not sure if the modded DVD9 format was used for software protection or just to cram more info on the disc. However these bugs are so big that both the studio and the publisher had to have known about them. So you have to point a finger at the studio and the publisher for releasing the game too soon. In this case Snowblind and Sony. Snowblind's last game (Baldur's Gate Dark Alliance) was rock solid on the Ps2. So I'm guessing it wasn't the incompetance of the studio but rather the Sony likely pushed them to make the release date. There were rumors floating around to that effect because supposedly snowblind wanted to optimize the online code to support modem connections, but Sony told them not to bother and make it broadband only. On top of that Baldur's Gate Dark Alliance 2 was relased about a week before this one. Sounds like Sony pushing to make sure Champions had a chance to snuff BGDA2.

    As far as the reviewers go, well Sony is the biggest dog in the console arena. There may as well been some pressure to give it a good review. I'm sure they probably told the reviewers the version they had may have bugs because it's a beta, etc. etc. Now that the real version is out most reviewers with major sites probably don't have the time or inclination to question Sony. It will only help to ensure that you don't get the next exclusive preview of the next huge game Sony is releasing.

    The saddest thing is this game is really great. I played though it once and I still want to play it again. My only real gripe is the freezing which has made me paranoid about saving. Otherwise this game rocks. The graphic glitches are annoying, but they go away in about a second. Sony should have let Snowblind do the job right. Perhaps with Champions 2 they'll let them do their job.

    1. Re:Pressure on both sides of the story by Anonymous Coward · · Score: 2, Insightful

      Supposedly they used some sort of modified DVD9 format which may be part of the problem. I'm not sure if the modded DVD9 format was used for software protection or just to cram more info on the disc.

      The Curmudgeon article sez some reviewers got shipped a 2 DVD set (single layer) as a final review copy. Apparently it was a last minute decision and apparently there was NO QA after this decision was made as the code had already been QAd.

      Champions is an awesome game, I feel bad for the guys at Snowblind that put so much effort into it only to have it and their reputations ruined by some marketdroid's snap decision.

  3. Pah game reviewers are a joke anyway by SmallFurryCreature · · Score: 4, Insightful
    I did use to buy PC Gamer but stopped round about Operation Flashpoint. At the same time another soldier sim was released. Lets just say that I had widely different views on how they were judged and started to realize that the reviews were not what you would call objective. Imagine a car reviewer slagging of a jaguar because he is allergic to cats.

    But a little bit farther back you have a real test of game reviewing. "Hidden & Dangerous" was widely reviewed as a great game. Maybe it was. No mere mortal ever managed to play it.

    It had a gigantic number of game killing bugs. So many it would seem impossible that reviewers couldn't have noticed. So yes afterwards game reviewers admitted that yes they had encountered the bugs but had decided not to mention it since the game was so great.

    Only by the time the sequel was being previewed did game rags start to really talk about the piece of crap the original was.

    I said this before, "game reviews ain't worth the paper they are printed on wich is really bad news for online reviews". Until people start to realize that game reviewing includes product testing game reviews will continue to be little more then some idiot being paid to blub about games he liked or hated.

    As for wich reviews are honest? Demos. Tells you 99% if what you need to know.

    Most people I know treat game reviews as advertising. No different then an "making of" program on the latest movie. We use other gamers to review games.

    Should the game industry care? Well yes, even better then demos is downloading the entire game. Perfect review. You can only sell crap so many times before I start thinking that stealing from lying scumbags isn't all that bad. You don't think I am going to pay for a single game ever from Illusion soft or take 2 again? Let them first patch the product they sold me.

    --

    MMO Quests are like orgasms:

    You may solo them, I prefer them in a group.

    1. Re:Pah game reviewers are a joke anyway by cgenman · · Score: 4, Insightful

      One of the major problems with game reviewing, and this is why they all sound like adverts, is that the people who want to review a particular type of game are given that game to review. If someone is an Everquest junkie, they're going to be given the new Everquest to review. Wonder of wonders, he likes it! On a fundamental level, you don't get to the point of being a game reviewer without loving games in general, so even if you removed this point you would have an unnecessarily glowing review. Having 2 or 3 reviewers on a game would be an improvement, but few publications have that kind of manpower.

      Furthermore, and I've seen this firsthand, reveiwers aren't exactly the strongest willed of people. They tend not to rock the boat. I don't know if this groupthink is from self-selection, from the fact that there is no objective way to judge the value of a reviewer so you must hire by whether or not s/he reviewed games in exactly the same way that you would have, but they all blow with the wind. Companies know this, and they do their best to blow at the reviewers. Companies create the perception of a popular uprising, and reviewers feed it until it actually is a popular uprising. Most reviewers don't realize they are doing this, nor do they realize where the uprising came from.

      And yes, Demos are the best indicator of a 95% finished game. Unfortunately, you do have to cut the company the littlest bit of slack, as the demo will be done a month before the game finishes, so it is almost guarenteed to have crashes that won't appear in the final version.

      Companies should care, but we don't. We're too busy trying to figure out how to manipulate the reviewers into giving our games a perfect score. Most of us are terrible at it, but what we want is hype for our products rather than objectivity for everyone else's. After all, after pouring your heart and soul into a game for years you're going to think it's the bees knees, even if a more objective viewer doesn't like it. And five points on a review might be the difference between doing the game you want next time or doing a licensed movie port for the GBA.

      Don't look to us to fix the objectivity problem, that will only come with subscribers choosing magazines that actually use the full range of their scoring charts, rather than just 70-100%.

  4. Re:reviewers are bitches.. by robson · · Score: 3, Insightful

    Anyone remember the game Trespasser? Before it came out there were nothing but glowing reviews, talking about how the game was going to change the face of the industry, blah blah blah. When the game finally came out it didn't really play on any of the then current compute (unless you like slideshows) and it was buggy as hell.

    Far be it from me to try to reduce anyone's cynicism with regard to the game press, but there's actually a reasonable explanation for this. Game previews are generally positive and non-judgemental, with good reason -- they're not looking at a final version. It would be wrong to taint readers' opinions on things that will eventually get fixed.

    Reviews are what you want to read for an actual critical evaluation. Remember that when Trespasser shipped, the reviews were terrible.

  5. Re:reviewers are bitches.. by __aamkky7574 · · Score: 3, Insightful

    The regenerating shield bar, and limiting your weapons - two features that are now becoming standard.

    Two minor features (I mean, if the replenishing shield and/or weapons limit were removed, would it be substantially a different game?) do not a game make, never mind a supposedly genre-shattering game. I'm really trying hard to see what makes this game revolutionary, and I honestly can't see it.

    The graphics were quite outstanding for its time, too - nothing then had particularly successfully done bumpmapping, and the enviroments were huge, with very very little popup or fogging, and some very nice high res textures.

    Huge environments? About as big as Unreal, a game which it much reminded me of. And even that 6 year old game had much more variety in its environments. And most importantly, atmosphere. I never got the impression with Halo I was in an alien world. The only unique touch (one I liked) were the whimsical chapter headings (any fans of Iain Banks among the Bungie crew, I wonder?). For huge environments, see the current Far Cry. Again, not a game I'm enamoured with (at least, with the demo), but it's taken the meaning of huge environments a whole quantum leap ahead, far bigger than any Halo made. I still wouldn't give it 10/10 for that. High-res textures? I really must be seeing a different game. I thought the models were nice, and Master Chief/vehicles had great shapes but the textures awfully bland looking. (On the other hand, I thought the aliens were naff.)

    The controls (although not a patch on keyboard and mouse) successfully allowed the pretty much PC-only genre to move to new platforms - something many, many, people dont notice is that it will auto track a distant moving enemy if you leave the sticks alone - a little change that you dont notice but which greatly helps the controls.

    Auto-tracking? Oh god. I consider that a bug not a feature. It's up to console makers to provide a decent FPS peripheral rather than games makers to provide users with the equivalent of training wheels that they never have to take off ("Look at little Johnny! He can cycle!"). Anyway, auto-tracking was a feature 6 years ago - in Half-Life. I'm really trying hard not to be negative but.. well, as you can see, I am. Sorry.

    If I remember correctly (it IS a long time ago, now) both Deus Ex and Half-Life got 9/10, which as I said is outstanding. Half-Life didnt really move anything other than plot and atmosphere along (although I must say it is one of my favourites), and Deus Ex was very, very good (another favourite), but again the graphic engine hasnt quite stood up to the ravages of time, and the RPG-like elements havent been taken up by many (if any) other games.

    As for Deus Ex, it shouldn't matter that the graphics don't hold up now - that's happens with PC games, such is the relentless drive for more and more graphical power. My PC, which was almost absolute-top- of-the-range two years, cannot play Deux Ex 2 at all. Games should be reviewed based on their era. Possibly it's unfair to hold up Halo to the current standard# of graphics, as the PC release was two years after the XBox, but even so, if they release a game now, they should be willing to be reviewed based on current criteria. The fact that the unique features of Deus Ex weren't taken up speaks for the conservatism of the games industry and, yes, players. Sadly, Deus Ex didn't sell that well, therefore no other companies out there thought that it was a winning formula to copy. Ironically, the creators themselves obviously thought this, hence the poor reviews of Deux Ex 2 due to the dumbing-down of the whole RPG aspect.

    Simply means its genre-changing. Many developers have taken elements of Halo and applied them to their games - the limit of 4 weapons in FarCry, and the regenerating shield in Mace Griffin (ok, not the best example