Slashdot Mirror
On Champions Of Norrath, Forgiving Game Reviewers?
Thanks to Curmudgeon Gamer for its article discussing technical problems with PS2 title Champions of Norrath: Realms of Everquest, and why official reviews of the game didn't seem to mention those problems. According to the writer, who had been "experiencing frustrating lock-ups and hangs which have caused the loss some of my progress through the game", it turns out that "two of the reviewers did see the game hang and didn't mention it in their reviews." However, he argues: "That's a judgment call, really, and since each saw the problem precisely once I can understand leaving it out of the review", and ends by suggesting that "the real burden rests not on the shoulders of the reviewers but on the creators of the game and, potentially, the console itself."
...of the game industry. when they rely on the industry to get previews of the games, that's what happens. they all try to get the reviews first, even if the game was just headed for production. and they get press reviews so they can't even know which annoying bugs make it to the final release(and oh yeah, game publishers do ship products they're fully aware of being buggy).
well, at least they PLAYED the game, not so long ago it was pretty common that magazines made fake reviews that were in reality based on just few screenshots so that they could stay on top of the business.
as a sidenote, anyone know a reliable, good review site not afraid to say that "those fucking rocketthrower handed mutant monsters suck big time and the plot is a joke"?
world was created 5 seconds before this post as it is.
I am currently working my way through this game and have experienced the missing graphics bug several times. The bug caused most or all of the background textures to be completely black. The only thing you could see would be things that moved, like your character and the monsters you were fighting. The ground, walls, rocks, etc were completely invisible when I experience this. Although sometimes it would recover on it's own, most of the time I reloaded the game to correct.
It seemed to happen most frequently when I had been playing for about an hour and had changed areas, causing the game to load a different tileset.
..."the real burden rests not on the shoulders of the reviewers but on the creators of the game and, potentially, the console itself."... Look, its not our fault we didn't tell you about the problems we encountered with the game. If anything they should mention that on the packaging. Or, failing that, on the box the PS2 itself came in. If you bought the game because you read our raving reviews, our job is complete. Now if you will excuse me, I have to go to make a deposit before the bank closes...
This has less to do with game reviews and more to do with journalistic integrity. If a reviewer comes across a serious bug in a game - especially a console game for which a patch is unfeasible - one would think that such a bug would get mentioned in the review.
Now the question is, was the bug not mentioned because the reviewer didn't consider it to be important, or forgot about it, etc. (e.g., just crappy reporting)? Or was the reviewer under pressure or edited by his superiors so as not to report bugs in the article, due to the financial pressures (no free copies, etc.) that a large console game company could potentially exert on a small online review site (e.g., complete lack of journalistic integrity)?
In the good old days, a problem encountered by one console gamer would likely be replicated by others. This, however, is not the case anymore. Dual-layer DVDs are known to cause problems on both consoles that facilitate them - X-Box and Playstation 2. Unfortunately, these problems don't affect everybody, so the reviewers could've just assumed that they were the unlucky ones.
I'm really glad this story is on Slashdot, and I'm glad someone had the balls to write a story about it to begin with.
I haven't trusted game reviews fully since I got an issue of the "Next Generation" magazine after its acquisition and relaunch, and Ultima IX got 5 out of 5 stars. Ports of old Atari 2600 games with nothing but the graphics updated were getting 3 and 4 stars.
However, I let myself get suckered into buying this game AND a PS2 to play it (since Dark Alliance II was cancelled for Gamecube). There are glitches galore, more than I've seen in most recent PC game releases even.
The tech support forums are a joke and a half. The official Sony reps make a point of only replying to messages with 'solutions' to the glitching problems in them - they will resolutely ignore 20 questions regarding recalls, refunds, QA, lens cleaning, whatever, and promptly respond to any message saying "eject the CD and push it back in and the game might work", saying "Thanks for your help, we've also found this works." I'd rather they not reply at all, that sort of reply just makes me want to strangle them ala Homer Simpson.
Champions is a pretty cool game... too bad it could potentially wreck your PS2, or lock up at any time a spell effect or loading screen appears. There should really be a recall.
I think it was pressure on both the studio to get the game releases and pressure on the press by the publisher to ignore the bugs in the review.
The game has graphic bugs and freezes there is no one denying that. Supposedly they used some sort of modified DVD9 format which may be part of the problem. I'm not sure if the modded DVD9 format was used for software protection or just to cram more info on the disc. However these bugs are so big that both the studio and the publisher had to have known about them. So you have to point a finger at the studio and the publisher for releasing the game too soon. In this case Snowblind and Sony. Snowblind's last game (Baldur's Gate Dark Alliance) was rock solid on the Ps2. So I'm guessing it wasn't the incompetance of the studio but rather the Sony likely pushed them to make the release date. There were rumors floating around to that effect because supposedly snowblind wanted to optimize the online code to support modem connections, but Sony told them not to bother and make it broadband only. On top of that Baldur's Gate Dark Alliance 2 was relased about a week before this one. Sounds like Sony pushing to make sure Champions had a chance to snuff BGDA2.
As far as the reviewers go, well Sony is the biggest dog in the console arena. There may as well been some pressure to give it a good review. I'm sure they probably told the reviewers the version they had may have bugs because it's a beta, etc. etc. Now that the real version is out most reviewers with major sites probably don't have the time or inclination to question Sony. It will only help to ensure that you don't get the next exclusive preview of the next huge game Sony is releasing.
The saddest thing is this game is really great. I played though it once and I still want to play it again. My only real gripe is the freezing which has made me paranoid about saving. Otherwise this game rocks. The graphic glitches are annoying, but they go away in about a second. Sony should have let Snowblind do the job right. Perhaps with Champions 2 they'll let them do their job.
Just kidding. Blame the computer scientists.
The weakness isn't in the reviewers, or the testers, or even the coders. The complexity of much modern software is such, that the languages are inadaquate to manage the tasks set befor them. Buffer overflows, as attacks, or just unintended events, they are par for the course now. I've only had one game that would crash my old NES, none that would nuke my Atari. But as the consoles enjoyed ever more complicated titles, ever more errors with ever increasing severity have made their way into games, at every level.
It would be easy to see how a reviewer would assume that it's a manifestation of an abberation increasingly common in games and beneath mention. I've had Crazy Taxi crash and wipe out spectacular runs, and snatch defeat from the jaws of victory when I just barely compleated a infuriating crazy box. I've had RPG's with event triggers kick me into a spot where I can trigger the necessary event to proceed. Crashes that eat saved games. And let's not forget Phantesy Star Online and the horrors it brought.
People accepted Windows crashing.* They will accept console games crashing if presented with no better alternative. One segment of the population might have just reached the plateau first. Small wonder.
Kick the reviewers in the nuts if you want. Cry shenanigans and let loose the children in grade four. They're but a symptom of a much larger problem. No black helicopters needed.
* Blah blah Linux. BS, I'm using it right now, and there is plenty of "give up and die" or "Whoops!" as prefered modes of failure to go around.
But a little bit farther back you have a real test of game reviewing. "Hidden & Dangerous" was widely reviewed as a great game. Maybe it was. No mere mortal ever managed to play it.
It had a gigantic number of game killing bugs. So many it would seem impossible that reviewers couldn't have noticed. So yes afterwards game reviewers admitted that yes they had encountered the bugs but had decided not to mention it since the game was so great.
Only by the time the sequel was being previewed did game rags start to really talk about the piece of crap the original was.
I said this before, "game reviews ain't worth the paper they are printed on wich is really bad news for online reviews". Until people start to realize that game reviewing includes product testing game reviews will continue to be little more then some idiot being paid to blub about games he liked or hated.
As for wich reviews are honest? Demos. Tells you 99% if what you need to know.
Most people I know treat game reviews as advertising. No different then an "making of" program on the latest movie. We use other gamers to review games.
Should the game industry care? Well yes, even better then demos is downloading the entire game. Perfect review. You can only sell crap so many times before I start thinking that stealing from lying scumbags isn't all that bad. You don't think I am going to pay for a single game ever from Illusion soft or take 2 again? Let them first patch the product they sold me.
MMO Quests are like orgasms:
You may solo them, I prefer them in a group.
I also saw the lockups while playing it. The solution is simple. Eject the disc and put it back in and the game will continue to function without a problem. A real problem I found though that isn't talked about enough in reviews is the shoddy casting system. You have two buttons to cast spells with, and you HAVE to use those two buttons (There is no casting directly from the spell book) So if you have 2 defensive spells you want on as well as your two attack spells ( If you play a mage for example) You have to continually rebind the passive spells to Circle or Triangle, cast them, rebind the attack spells, and repeat 30 seconds later when the defensive spell runs out. The game requires you to push SIX times on the controller to cast one defensive spell. I wish they could somehow release a patch to allow casting from the spell book.
There are two places I look to see if a game is good. One is GameRankings. They have lots of really small sites that they list, who I trust far more, and also always have tons of user reviews, which are generally useless but not always.
The other place I look to is Penny Arcade. Now, they don't talk about nearly every game that comes out, but when you do choose to talk about a game, they're as honest as can be. They will mention bugs. Just a few weeks ago Tycho said he had to get a no-CD crack just to get the game to start, even with his legit copy. No big reviewer would ever mention that, but isn't it kind of important? Not only are they scathingly honest if need be, but they really understand that there is no game in the world that everybody will love. They understand that some of the games that they enjoy, well, most people think they're terrible. They don't really write about whether a game is good, they write about what's to like about the game, what's not to like, and whether you, the reader are likely to like it in general.
Funny how the people that don't consider themselves journalists are usually the best ones.
I would like to say that my copy crashed all the time. I would like to say that the graphics dropped all the time. Heck, I'd like to say that the disc just didn't work. Then I'd have a big reason to hate it.
But alas, it's just a bunch of penny-ante stuff that adds up and makes CoN so annoyingly bad. The biggest offender overall, though, is the drop system. Defeated a monster in the tree-tops in the first fight...he drops a magical dagger with 32-40 damage + lightning damage. At this point, I'm like "whoa." Three acts later, I still haven't seen anything as good as that dagger.
And heck, what about the pathetic bosses? Dodge, hit, dodge, hit. They were built so that a group of people could just gang up and beat on them from all sides. That's it. Even in singleplayer (Seeing as how dialup play, and hence online play I could access, was sadly left out) it was painfully obvious that the boss characters were simply regular enemies with stronger attacks.
Meh.
Kids these days. They don't know the difference between classic, and just plain old.
everyone keeps reading them.
I think this contrasts greatly with possibly reviewer ommitance between two SOE products: PlanetSide and CoN.
Snowblind has said that when they burned CoN, they weren't seeing the lockups and glitches that consumers are - which means it's entirely possible that reviewers didn't see them too (as many of them don't get the consumer version).
PlanetSide on the other hand, had technical issues up the wazoo on it's get go, and there was only one version to play there. Many of the bugs were acknowledged by the devs as big old Oopsies.
But then again, reviewers probably had another excuse for the version of PS they played.
It was just a beta.
I think the problem is this need for all reviews to be published the very day a game comes out. I think anything printed on that time line should still fall into the realm of preview, whereas what I would like to read is a review of a copy some reviewer got off a shelf, not in a publisher's envelope. Unrealistic - probably...but definately more accurate.
But for the record, I love CoN (almost as much as I kinda hate SOE). My GF, her sister and I played it for hours yesterday - no real problems. But clearly these problems DO exist, and I have to say - they're indicative of a Sony Online Entertainment product.
Okay, I bought this game. I have 2 PS2s. One is faulty (it won't read ANY media on CD) and one is mostly not (since it's mine, and not my family's, I've kept much better care of it.) Anyway, when I bought the game, it rather consistently locked up in the faulty one, eventually refused to load. In the working one it loaded and ran, with the occasional lockup. I have some lense cloths (of the disposable, alcohol coated variety) that I wiped down the disc thoroughly with, and since then have had no problems on the working or non-working PS2 at all. Admittadly, I had to clean the disc about 4 times, but since then (probably about 4 days after release) I haven't had a single lockup while playing.