Slashdot Mirror
Magazines Faking Game Reviews?
lunchlady doris writes: "With videogames becoming a huge business and magazines having large lead times, something has got to give if they want to compete with web sites. Planet GameCube has a story where it seems that some magazines have decided that eschewing actual journalism is the way to go, with both Extreme Gamer and Request Magazine having reviews for Nintendo's Eternal Darkness, a game that is currently incomplete and is only expected to arrive in stores at the end of June."
Why not? Publishers have been faking good games for years now...
I know someone who used to work for a film review magazine in London who said that the last year she worked there they hardly went to see any films at all. They were so understaffed that they didn't have time to see the films and wrote reviews of them without seeing them.
She got fed up and left. I think you will find this practise is not as unusual as one would hope.
Akvo.org - the open source for water and sanitation
Some years ago we had some similar situation when a journalist, Francis Rozange, got some acrimonious game reviews stolen, then corrected to please the announcers who would not spend a single cent for advertising in a magazine that would just let such disadvantageous reviews... ...
Actually, the French law allow a typical magazine to be classified as information-press if its percentage of ads remains lower than 66%.
Where that's becoming quite outrageous is that most "honourable" magazine maximize this percentage to 65% so that they get the bucks along with the status.
Now, the problem with the press is that the newspapers mostly belong to some big media lobbies
So, I wonder why one should be surprised of such headline...
Trolling using another account since 2005.
In further news ....
It is believed a politician has lied
The bank doesn't really care about you
There is some rude stuff on the internet
Cigarettes are not good for you
Don't chew glass
Most games mags get "special" versions of the game at least a month before the game goes gold, along with a list of things that will be fixed before it hits the shops (frame rate improvements, bugs fixed, etc.).
The only time mags get final versions are if:
(a) The game is finished long before its release (i.e. they are delaying the game for the Xmas rush).
(b) The mag in question can't be trusted to ignore the faults in their review copy (mainstream "lifestyle" mags for example)
If you look carefully at the screenshots they use you will occasionally see how they are subtly different to the finished product.
My particular addiction is NASCAR simulations. I used to love reading reviews raving about certain tracks and features being in the game, when in reality they weren't. When they touted great coding features that in reality were the opposite and serious gameplay bugs, that really cracked me up. Any player of those games would immediately have know the reviewer hadn't even bothered installing to game. As of now, I couldn't care less about magazine reviews. The critical (and sometimes overtly negative) observations made by posted in those game's forums help me out better in making my purchases. Fake journalism? Nothing new, kinda reminds me of the fake citations I had to make up for a college paper (although in this case I truly made my own observations and analysis throughout the paper, but yet the instuctor insisted on me citing people, so I "did").
It's obvious that Eternal Darkness skated much better than Half Life2 and that tripple Lutz was obviously a mess. I blame the judges they made their mind up way before the competition. Blame the French.
To be honest, all Game Reviews are suspect anyway, as Games magazines get review copies from the developers. If the Magazine writes bad things about a game the developer has been pinning big bucks on, the developer gets pissed off and stops supplying review copies (as well as other perks like invites to seminars, launches and other Things To Write About) to that Mag.
Essentially, the safe option is to spout whatever Press Release blurb the developers give you right back, translated through a Journalist with maybe 2 hours experience of that game. Just enough to put a personal spin on the Party Line.
If you're an online review site not out to recover printing costs, it's not quite so crucial to your bottom line to pander to the games developers, but for a print mag whose very existence depends on them, the guy who gets the first exclusive sneak peek because the developer likes his mag, shifts more copies of his publication.
So, if the developer says "Hey, want an exclusive sneak peek in return for saying what we want you to say about something you can't really test properly anyway?" most Editors are going to jump up and down singing "Free Content! Gimme Gimme Gimme".
And then theres the guy who writes a review because he's a writer, based on what his mate said about the game, but he's a different story.
Chris.
I forgot to add this in as an example of other types of fakery. NASCAR Racing 2002 Season came out this Wednesday. But if you checked EB's top selling charts last week, you would have seen this game listed at #4 among the top sellers. Huh?
"Oh god. Oh god. Daikatana is great. The game is incredible. Please keep it coming. Oh yes, yes, yes, yes, keep on fragging. Boring medival Japanese plotline, oh god. More, more, more!!!
Good Salad."
See, it's quite easy to fake a good game review.
I ran into a problem with folks not reviewing games when the GBA (Game Boy Advance for the un-anointed) first came out. My brother and I were trying to decide which games we should both get vs. which we should just share. Bomberman Tournament was the title we'd anticipated most, so if there was any possibility of increasing the gameplay value by buying two, we were gonna do it.
And, after a quick perusal of two of the largest gaming sites around - Gamespot.com and IGN.com - we decided two cartridges were the way to go. After all, in Gamespot's review, Frank Provo writes:
Sounds good, especially when paired with David Zdyrko's comments in IGN's review:
So, we went and bought two copies, whipped those babies out, and set up a game. And, lo and behold - no multi-cartridge support. Yes, indeed, the single gamepak mode had lots of slow load times. But having more than one doesn't do you any good unless you lose a game in the couch cushions.
There was some moaning about this issue on the Gamespot forums, and as it turns out, the multi-cartridge support had not been brought over to the US version. Some of the reviewers had been given bad data by the company.
To which I first though, "OK, no big whoop. Shit happens." But the more I considered it, the more it bugged me. These two reviewers made claims based on information they got from the company that made the game - NOT their own experiences. They didn't test these features; they just threw them into the review.
I understand the most probable reasons: lack of time, only one cartridge to test with. But all I'm asking is for a simply "We didn't have two copies, so we can say for ourselves, but apparently..." Yes, it sounds a little wussy, but it makes the difference between journalism and an ad. At the very least, they could have corrected the error when they were notified; I'm aware of several people who have contacted both sites, including myself, and one Gamespot official even bothered to reply about it in the forums, but both still stand unchanged.
OK, this is a minor thing, I know. But it did cost me about 30 bucks, and it makes me wonder: how much else in these "reviews" is straight out of a press release?
I have a friend who while working for a Games magazine was assigned to review an upcoming game. The game was planned to be released no sooner than two months. :). :)
So she got a copy of the "close circuit game preview" CD and thought to give it a fair ride.
It took 3 days to install the game - it was so poorly written it only worked on a single test machine and it was UGLY and slow like hell.
So acting in consequence, my friend wrote the review and give it a 3 out of 10
Suprise, surprise ! The editor was pissed and started to yell something along the lines of "yo' tryin' to ruin us or what ?!".
It turned out it was (guess still is) common practice to write good reviews in order to get early previews. You see, the magazine sells because it features early reviews, hence it has to get early game releases and has to write GOOD reviews in order for early stuff to keep coming and readers keep buying.
OTOH, the game companies obviously need to have good publicity so they use (among other stuff like PR and paid trips to nice resorts in order for editors to get a "preview" of the new stuff) this mechanism of early reviews.
Needless to say the game ended up as a complete failure, but all things considered who remembers the article that gave the game 8.8 out of 10 ?
Who said politics is the only whore ?
__________
Don't belong. Never join. Think for yourself. Peace!
'Exclusive' reviews of incomplete (or in some cases entirely non-existent) games have been around almost as long as computer games magazines themselves. I remember back in the glory days of the classic UK games mags of the 80s and early 90s - the likes of ZZap, Crash, Your Sinclair, Commodore Format, Amiga Format etc - the surprise was when a review of a real, *finished* game was published (it was not unusual to see rave, 95% reviews of games which were never even written :-)
UK and Australian readers will probably know what I am talking about: I'm sure I'm not the only one who misses the zany yet sophisticated humour, and complete and utter lack of moral fibre, of the great UK games mags. The copious pop-culture references, the disturbing running gags and in-jokes, the barf-inducing layouts.... all seem to be missing from today's sanitised publications.
There was a terrific site set up by the staff of the short-lived (but truly surreal while it lasted) Amiga Power magazine, telling the inside story of the fake reviews, blatant plagiarism etc of the UK games mag scene of the period. Unfortunately it seems to have vanished.... hopefully someone might turn up with a URL.
-- briggers Remove blinkers to email me.
Could be worse, I guess. They could post duplicates of the same articles and reviews over and over without even checking for copies....
FreeBSD for the impatient.
You'd have to be pretty bad with a calendar (and know nothing about games development) to believe that a review written at least six weeks before a game goes gold could be of anything even remotely resembling the finished version. I know for a fact that "Braveheart" was given 95% by one (ahem) reputable UK games rag based on a 10fps demo that crashed every 2 minutes and a promise that the development team was working 20 hour days to get a patch done in time for the boxes hitting the shelves (which was true, but signifies nothing).
Look, picture for a second how this works. A sales weasel turns up from the publisher bearing a package. In the package is a shitty beta version of the game, a promise that it will be fixed (so the magazine won't look like chumps), the advertising material, and a blank cheque. The cheque is ostensibly to pay for the advertising, but the number that goes on it depends on a lot of things. How many eyeballs the magazine is attracting; how understanding the reviewer is going to be about the bugs; how much the reviewer is prepared to just flat out lie; who is buying lunch for who.
The problem is really that the readers put up with it. Specifically, that we reward magazines for running rave review in every issue purely to tempt you to pick them up. Imagine a games mag with the cover page: "All the games reviewed this month suck." Would you buy it? Probably not, but that's exactly the kind of issue you should buy.
You want to know what a game is like? Play a downloadable or cover disk demo, or a friend's copy (local laws allowing, hey ho). Wait until it reaches budget, and see if people are still talking about it. I bought Diablo II + the expansion + Diablo + a strategy guide on Monday, for less than the original cost of Diablo II. Strangely enough, it's still the same game that it was when it first shipped - only without many of the bugs.
Games magazines are an irrelevance now, other than as a means of distributing advertising and cover disks. Online mags are a little better, partly because they don't have print deadlines to hit, but mostly because you can generally read player comments and get a feel for what the title is actually like.
If you were blocking sigs, you wouldn't have to read this.
The quite famous (at the time) french writer
JP Manchette got away with this for three years or
more ! He wrote film critics for "Charlie Hebdo"
from a remote mountain commune, based on what
his 12 years old son would say to him on the phone, and critics from daily newspapers. So he was the only french intellectual to (rightly) praise "Indiana Jones I" or "1941" !
The critics were actually so good that they were
recently released as a book.
I think he did it as a mixture of situationnism and despise for the readers, whom he may have considered of the same mental age as his son.
He ended the game when the journal went bankrupt
by announcing a sneak preview of a Georgian stalinist movie of the late 40's, without
subtitles, in a remote suburb of Paris, staged at 11:30 PM (so everyone would miss the last subway). Pitch : love story between a sovkhoze farm worker anda tractor repairer. Indeed, he just
wanted to make fun of snob, left-wing
pseudo-intellectuals. He then revealed that
he had cheated on all of his movie reviews.
Maybe this stuff with videogames is related : journalist just exploting the sheepy attitude
of teenagers (or not grown ups 20-30 yo),
only wanting to impress their friends with
their knowledge of the newest games.
Google passes Turing test : see my journal
Seriously. The people writing the game articles looked like they were -- like me -- also in thier teens. Unlike me, they had access to press releases, and did a fine job of mangling them.
As an adult, I've been interviewed by reporters and had projects I've worked on reviewed. Nothing makes me wince more then having to read something that is simply wrong -- even if it's a "positive" error. I don't lie, so why should I expect someone else, supposedly objective, to hype or lie for me?
That the articles are still being faked isn't a surprise at all. Ethics and objectivity in popular tech journalism (ZD) is rare, and sometimes missing even at the bottom of the totem pole (Mozillaquest).
A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
In the case of computer magazines, they're trying to get the FIRST REVIEW!!! (a bit like First Post!) which will sell more copies of the magazine.
But sloppy work happens everywhere. David (Hutch) Soul recently successfully sued the one time showbusiness columnist of the "Daily Mirror" (crappy UK tabloid) over a review of a play Soul starred in.
The review said at the Monday performance, only 45 people turned up and the audience laughed derisively at Soul. They didn't do Monday performances...!
"Information wants to be paid"
This problem of fictional reviews is the main reason we started Geartest.com. The problem doesn't only exist with video games but with most consumer technology products. Most tech 'reviews' out there are nothing more than regurgitated press releases with 'reviewer' doing nothing more than spending a few hours of playing around with one product or another.
That's in stark contrast to our review philosophy: Real gear. Real world. Real reviews. We don't write reviews about products based on press releases or in a pre-release stage. We use the products for an extended period in real conditions. And we tell the people what we found, with updates as warranted. That means if it's good we'll say so, and if it sucks we'll say that too... but usually the truth is somewhere in between.
We have had difficulty in getting manufacturers to send products to us for review. That is despite having grown to the point where we consistently have 5-figure impression levels, projecting breaking the 100,000 impression level soon. All of that is without us doing any advertising. Pure word-of-mouth. It's no Slashdot but we think it's decent traffic.
We suspect that the biggest problem (from the point of view of manufacturers) is that they simply don't want to risk getting a negative review. We believe it's in a manufacturer's interest to receive unbiased, journalistically sound reviews of its products. Ultimately that can enhance their credibility and add value to a brand in the eyes of the product-buying public.
We have had some people suggest to us that we 'play ball' if we want their cooperation. Frankly, it's not going to happen. We may miss out on getting 'insider' opportunities to cover and review items -- and we may not get to review some items that our users have asked us to -- but the feedback and response we have received from our readership (a good mix of techies and laypeople) tells us that we are on the right track.
The way we see it is this: if you have confidence in your product, then you should have no problem putting it to an unbiased test. It's surprising how many product managers recoil and refuse when you put it to them so plainly.
We're in the process of designing our 3rd-iteration site to enhance user-friendliness and add some more features and functionality. The one thing that will stay constant is that we won't trade our integrity for 'A-list' access to products. If that means we don't get access, we'll just deal with the people and companies who see the value in what we're doing.
Check out Geartest.com and let us know what you think.