Slashdot Mirror
L.A. Times on Game Reviewer 'Playola'
madmancarman writes "Celebrity parties, target practice with automatic weapons, and free trips to spend the night in haunted castles are just some 'perks' game reviewers enjoy as described by this article from the L.A. Times. The reviewers say this has no effect on their reviews, but we've all heard politicians say the same thing with respect to their jobs. Maybe Ion Storm should have spent some more money on Daikatana junkets?"
What, Ion Storm was going to send reviewers 50-pound sacks of buffalo crap in anticipation of Daikatana's release?
Bowie J. Poag
I'm all for it. Where do I apply for this job? I have the highest ethics....for sale.
Joe Carnes
I'd hate to see what the junket was like for Grand Theft Auto 3...
Man, and I was wondering why all of the game reviewers kept obsessing about that "pick the hooker up in the car" trick.
I'm still waiting for my payoffs.
Seriously, while there is the danger of that - and I've been to a few events (like when they brought out the models dressed like Hooters girls to promote the terrible Hotters racing game) that do offer goodies.
The problem is, both reviewers and companies know you won't last long if you give a good review to a rotten game. It does happen that a reviewer likes a game that nobody else does, or hates a game that everybody else seems to like.
But most of the time, reviewers have to be honest, or else nobody will respect them, and then you lose readership. So all that these perks is that when you say "This game fucking sucks", you say "I just didn't seem to get into it". Instead of "The AI was dumber than Cattottop on Crack", you say "The AI wasn't challenging".
Lucky for some of us who run web sites out of our own pocket (yes, I'm self promoting damn it, and sorry about it), but at least when you don't actually "work" in the industry, you're allowed to say that the best part of Final Fantasy X was Lulu's cleavage every time she bent over. The rest of the game was so-so, but that alone kept me playing.
52 Weeks, 52 Religions with John Hummel
If a magazine or website is going to be fair and open about their reviews, it would be nice if there was a bit of disclosure about perks/payoffs that they are getting. I have seen (can't remember the site) situations where EMPLOYEES of game houses have written full reviews and palmed them off on gaming sites as a unbiased review.. only to be caught out by some alert reader.
Maybe too, people are going to hold back on reviews that shitcan bad products for fear of litigation (PetsWhoreHouse etc...). It does seem that a lot of big game sites tend to get more sychophantic as the years go on.. especially to the big software houses.. is that because of either a) Advertising Revenue (Biting the hand that feeds) or b) the junkets get better..
It gets harder to find objective reviews ESPECIALLY in print magazines..
But what can you do???
sigh
Burma?
Yeah, I spent a couple of years "in the biz". I was not paid, but worked voluntarily on an online-only game rag that has since bitten the dust. Anyway, before the speculation gets too thick on this thread, I'll throw out some info on the job of game reviewer, and how the subject of perks and such fit in.
Our mag was not one of the biggies, though we had a pretty fair readership. Aside from the publishers sending us games, and hardware companies sending us joysticks and stuff for review, there was not much else. Much of the hardware had to be returned after the write-up, but the games didn't. So, sure, I didn't buy a game for a couple years, and ended up with a few controllers and even a few sound and video cards.
The print guys definitely got more attention from the publishers, especially at E3, where they all got the special invitations to the vendor parties, and they may have even gotten some of the perks that the article implies, I don't know. The parties we did get invited to were often much like those timeshare gigs where you have to listen to a bunch of marketing hype in order to get a few chicken nuggets and two free beers, and maybe a can cooler printed with the game logo.
There was no real incentive to skew reviews. We got more games than we could reasonably play, and kept getting them from a publisher even if we had just poo-poo'd one from that publisher. One thing we tried to do, was to be objective. No game is completely bad, and we tried to point out any good points, even if the overall score was low. For instance a game might have had crappy controls, bad graphics, poor AI, and even an ugly box, but if it had good audio and soundtrack, we said so.
Then, the publisher would quote the line that said "Killer soundtrack and realistic audio effects..." on the "press" section of the game's web site and they just wouldn't mention that we thought the thing was sheer tedium to play. And they would send us another box full of games the next week.
If I had not written fair, honest reviews, pretty soon, no one would believe me. It makes no sense to lie to your readers. It was funny, I would usually head out on the web to read the other site's reviews of a game after I had posted mine. More than once I would flame a particularly bad game, only to find that some other guys were raving about it. I wondered at the time if there was some sort of "playola" going on or if my opinions were just that much different. But I never ran across any proof.
Incidentally, as for game reviewing = "vagina testing", well, allow me to dispute that somewhat. First of all, I often had been assigned two or three games per week. Which means I almost never finished a game, since I also have a day job and a family. Had this been my living, I imagine I would have had considerably more assignments, and so the result would have been the same. Also, you have to write the reviews, which takes time, writing skill, and overall, a desire to write. I dare say that not everyone who wants to play lots of games also wants to produce the equivalent of an english paper after each one. Luckily, I can spell, and write reasonably well, and so I enjoyed the writing as well as the game playing.
Of course to write a critical review, you must do more than just play. You must play while honestly evaluating the various elements of the experience, and maybe even pausing to take notes, or replaying a section just to verify some item or glitch you did not get a good look at the first time.
Often you are playing beta or even alpha quality games for previews, and so crashes and configuration hassles are not uncommon. You don't generally have time to play much on advanced levels, because you want to get to as much of the game environment as you can in a short time.
Yes it was a lot of fun, especially at first, and rewarding most of the time, but it was definitely not the easiest, sweetest gig you could imagine. Eventually, I burned out, and bid the reviewer's podium adieu. It was at least a year before I played another computer game after that.
-- Don't call me "Sir," I increase entropy for a living!
The magazines I worked on didn't play that game but in the ultra-competitive British games magazine industry, there were several who most certainly did. I remember in particular being pretty sweet with GT Interactive's PR with regards to TA: Kingdoms. I was a massive fan of the former game and thought I had an understanding that I would review this game for our magazine first because I had the best background. Bingo it turned up on the cover of another magazine, exclusive review with a Big Score.
I couldn't even review the game, it had too many show stopping bugs namely the fact that it ran at about 25% normal speed. The game sucked anyway. Up until that point I was sufficiently naive to believe that everyone was like me. The process of getting reviews for the blockbusters is very much a business negotiation in the UK. Mags barter scores (I assume, although I never saw it myself), pages, coverdisk space and cover realestate.
Still, at the end of the day if you buy a mag and it says a game is great when it's absolutely crap - then you wont buy that magazine right? That's what I don't quite get about American magazines. They've always been very bum licky crawly to publishers, but then again their reviews are pretty useless coming out 2 months after a game hits the shelves anyhow...
Later on, after I escaped journalism to work in the games industry properly, I came to realise a real home truth. Actually reviews are pretty irrelevant. In this day and age, under 20% of those buying games have EVER bought a magazine for their console, still less have looked at a web site.
//disc: I am an Australian journalist who
//works fulltime for an Ozzie PC magazine.
Articles like this really annoy me. They take the actions of several PR companies, the reactions of certain journalists/game reviewers/industry observers, pick one or two of the more outlandish *stories* and then proceed to generalise across the entire damned industry.
Let me tell you right now: the actions of PR companies, game publishers/distributors and other parties interested in getting favourable attention from gaming and hardware journalists does NOT have much of an affect on the majority of the PC mag industry. At least, thats the case here in Australia.
Case in point: A company holds a press party for their latest game. They invite a bunch of journalists, put on free drinks and food, throw a few PCs around with playable demos of the code and generally hold a shmooze-fest. People eat, drink, be merry and discuss everything under the sun - naturally including the product they are there for in the first place!
Party finishes. Journalists go home. A few weeks later, the gold code arrives. Editor picks a staffer to review the game, and he/she takes it home to play the S*#T out of for a week or more - whatever it takes to finish the game.
The journalist then proceeds to write his/her review. Said review passes through subedit and a few other misc publishing routines, and appears in the next issue of the magazine.
In my experience, parties and junkets are the norm when a company wants to promote its latest product - whether that be the latest router or the next hot FPS shootemup. However, these parties usually don't promote the product they are organised for!
Damn near every promotional party/trip i can remember had one affect and one only - networking. The entire reason journalists turn up to these events is simply because they meet new people, gain new contacts and thus extend their usefullness to their own company! We emphatically do NOT think to ourselves "wow, that party/trip overseas/weekend in a hotel rocked! I'm going to give this game/hardware/widget 90%!"
Anyhow, to sum up: the article is pure BS. Journalists possess something called ethics. Those who don't, aren't journalists for long. Once you lose credability in this industry, no-one - and I mean no-one - will touch you. In short: you're fucked.
Don't lable an entire industry corrupt because of a few over-extravegant parties/trips. Fine, if one or two individuals bias their reviews due to trips/parties, then they deserve all the ridicule in the world. It won't matter all that much anyway, as they will be out of a job before long if they continue on that tack.
We have ethics. We have morals. We do not bias reviews based on how good a time a company has shown us previous to sending us product. And don't you dare bloody insinuate that we do!
Janie took my gun...
...I was invited by a friend who's a game reviewer to Microsoft's little self-congratulatory gig in SF yesterday (Bungie got a platinum disk for a million copies sold).
Anyway, the reviewers there were bitching like mad about the article, because it was taken totally out of context - yeah, there's payola for front covers and the like, handed out to the high ups in the press, but the average reviewer is lucky to get a flight and a shared bedroom on a lot of the junkets.
On top of that, the reviewers don't typically earn very much at all - and the last year has been real bad because of the decline in content providers. I got the impression not many of them make over $30 or $40k... in a good year (my friend made $10k last year). There's free food and trips which make up for it a little, but no-one seems to do it for the kickbacks. The general impression was that for the LA Times it was an extremely unbalanced article.
Winton