Slashdot Mirror
Analyzing Game Journalism
SSDNINJA writes "Joseph Jackmovich of gamrFeed analyzes 161 articles from Kotaku, Joystiq, and Destructoid to discover how well they report gaming news. He looks to find out if the stereotypes of game journalism being poorly sourced and sexist are anecdotal or based in fact."
TFA strikes me as a bit of a missed opportunity. It makes some extremely valid points about the dependancy of gaming news sits on the good-will of developers and the impact that this has upon review scores (hello Kane & Lynch). Unfortunately, it drowns this in a morass of po-faced moralising about what "proper" journalism could be. Having a pop at Kotaku for mixing in silly or immature stories among the rest of the headlines is kind of missing the point; these are ultimately entertainment sites, talking about an entertainment medium while seeking to entertain their readers at the same time. A bit of sillyness is going to be par for the course.
For the most part, gaming news is not real news. That's not to say there isn't a place for it. But it isn't in the same category as the kind of news coverage we expect of politics, wars or crime and it doesn't need to be held to the same standards. Occasionally, the gaming world produces a genuine news story (anybody remember Infinium Labs?), but I've generally found that the gaming press isn't too bad at covering these when they do occur. For the rest of the time, think of it as belonging to the same category as sports or showbiz news.
The area where there is cause for concern is that surrounding developer/publisher pressure over review scores. Reviews, unlike gaming "news", fall more into the category of consumer advice than journalism and I think it's reasonable to expect appropriate standards. It really is quite obvious these days that games which come with a big name attached often seem to get review scores they don't deserve. Final Fantasy XIII is a dreadful game. You spend the first twenty five or so hours running down a straight path, fighting endless waves of identical enemies with an almost-uninteractive combat system. No matter how much the game may improve after that point (and the improvement is only mild), there's no way that 25 hours of boring on-rails gameplay shouldn't have a profound negative impact on review scores; and yet the game carried off a slew of 8/10 and 9/10 scores. Mario Galaxy 2 is not a bad game (it has some clever level design), but it has a good number of flaws, including a lack of innovation compared to its predecessor, an imprecise control system (in a game that requires a high degree of precision on many occasions) and outdated game-mechanics such as a lives-system. And yet it had ecstatic reviews, including a frankly incomprehensible 10/10 from IGN.
The thing is that it's by no means clear that publisher pressure was responsible for the scores in the two cases listed above. Square and Nintendo both tend to have a pool of rabid fans (albeit a shrinking pool in both cases) and it's quite possible that the games were just handed to fanboys for review, who were never going to hold the game to objective standards. But the fact is that there are enough incidences of genuine publisher pressure (yes, Kane and Lynch, I'm still talking about you) that gamers' suspicions are inevitably going to be aroused. I think review sites need to do more to enhance their credibility.
Some obvious steps might be:
- Removing advertising on the actual review pages (advertising elsewhere on the site - ok - but it sends the wrong message when you plaster advertising over the review itself and people will see corruption even where it doesn't necessarily exist).
- When a game review comes back with a score of 9/10 or higher (or whatever the equivalent in the site's scoring system), get a second opinion in there as part of the review.
- Greater acknowledgement of bugs and stability issues in reviews and scores. If you look at the reviews of Medal of Honour and Fallout: New Vegas, two recent games that launched in a highly buggy state (on consoles as well as PC), it's clear that some sites acknoweldge the bugs in their review while others don't, but that it's very rare to see bugs actually taken into account in scoring.
One of the main(if not the main) problem with games journalism is the fact that now everyone is rushing to be first. How many times have you seen reporters rush to break some "big story" only to have them sheepishly, if at all, admit a couple of days later that the story wasn't real or at the very least was greatly exaggerated? Games journalists are no different, everyone wants to be the first one to break a story, review a game etc to the point that they barely spend any time with the product that they are reviewing. How long does it take to complete a single player game nowadays? Usually 40 hours at least, and then if you consider online and how long it takes to really evaluate a game(balance issues, matching algorithms, stability etc) then you are looking at least a week, probably more for anyone just to slog through the thing, let alone arrange their thoughts into a coherent review.
So either a) the reviews are rushed to get something out the door as soon as possible after release or b) the journalists are given review copies but basically told that they better not give the game a bad review or else the gravy train is going to be derailed.
It's obviously a very difficult place most game journalists are in and the internet isn't making it any easier. Maybe someone should start a "slow cooked game review" site where they spend at least a week reviewing each game. Even if it means that you won't get the reviews until a week after launch.....
Monstar L
This article attempts to make a assessment of the quality of game journalism, without mentioning Edge, which is one of the most well received papers by the games industry. Indeed, Kotaku (which is banned from even mainstream forums such as Neogaf due to its poor quality) and Destructoid are not aiming for quality but general coverage. To my knowledge, Edge is the only gaming publication that attempts to write reviews and games theory articles on par with what movie and music critics do.