Slashdot Mirror


The Integrity of Game Journalists

ScoobyScooby writes "An interesting story went live on Games.net yesterday in response to a 'letter from the editor' penned by Dan Hsu of EGM. In his letter he accuses a number of publications and publishers of being essentially buying coverage and vice versa. A Games.net editor responds with his own take on things and the resulting comments and discussion are worth investigating. Are veiled accusations about improprieties really helpful at bringing gaming journlism to a more respected level? Or, do such accusations hurt more than they help? The Blame Game: Where Do You Keep Your Integrity?" GameSetWatch has commentary.

27 comments

  1. Back in the late '90s by Anonymous Coward · · Score: 3, Interesting

    At a tiny game start-up where I worked in the late 90s, one of our beta testers let us in on this dirty little secret. The big game publishers "buy" reviews of their products by purchasing sufficient advertising. Of course it's never officially acknowledged, so as a start-up you can't just call up and ask how much advertising you need to buy to get a review. They'll just insist that's not how it works. So unless you're already on the inside, you can't get in. Not surprisingly, the game didn't get reviewed in any U.S. magazines.

    1. Re:Back in the late '90s by Shad_the_protector · · Score: 2, Interesting

      I think it more happen like this.

      "Well, mr. Reviewer, you know I've got this bunch of ad from your magazine, giving you a great deal of money...., and you know I'm begining to be short on money with all the developpement of our next game... and I fear that if it doesn't work well I may loose a great deal of money, and I was thinking of removing those ad, you know, just to make sure I've got some money left....., but you know maybe we could do a deal."

      "go for it"

      "Well, if my next game would happen to hit a great review in your magazine, well maybe I would not have to fear for a possible selling problem...."

      "Well that could be arranged"

    2. Re:Back in the late '90s by KDR_11k · · Score: 1

      Did you send testing copies to the various publications?

      --
      Justice is the sheep getting arrested while an impartial judge declares the vote void.
    3. Re:Back in the late '90s by Anonymous Coward · · Score: 3, Interesting

      Like Anonymous Coward #1 I've been there as well.

      It's not just magazines, the major 'professional game reviews' websites operate the same way these days. Call them up looking for ads and you get standard banner rates, or overpriced sponsorship packages. After you spend enough on several campaigns they'll start to offer such perks as guaranteed index placement for articles/news about your game, etcetera. This applies even more if you're representing multiple titles - like any major publisher does. Buy enough ads for one title and spend that extra credit on a different one. It won't look like overt favoritism, but when everyone is giving way too much coverage to a title everyone sees is going to be a wreck, you can bet people are calling in some of those past puchases.

      In the journalists' favor, I haven't seen this happen to the point where a review score was rigged by the writer - the ad influence is usually at the editor level. It might guarantee coverage or a review, and we've all seen the occasional web-outcry when an editor dramatically changes a final review score, but most of the content is written by external contracters on assignment. What's worse is that a lot of the so-called 'previews' or 'feature previews' are actually written by the marketing team for the game, and published as being written by the site - that happens more than you'd think, and even on 'reputable' sites.

      It's hard to blame them at this point though - the only people buying ads are the ones whose products they review. They can't be to harsh on them, or they take the money away. That's why most of the 'bad' reviews are for bargain-bin or independant titles - they're not buying ads anyway.

      Gamers need media about games that don't rely on game companies for advertising - that's what would help fix the problem.

  2. Is this a suprise? by sehryan · · Score: 2, Insightful

    Really, did anyone not know that this sort of thing was going on? I mean, just look at the coverage of the three new consoles, and you can easily tell which "news" site is being paid by which manufacturer.

    --
    The world moves for love. It kneels before it in awe.
    1. Re:Is this a suprise? by chrismcdirty · · Score: 2, Insightful

      It's sometimes harder to tell when rabid fanboyism is in place.

      --
      It's like sex, except I'm having it!
  3. What? by vertinox · · Score: 2, Insightful
    FTA:
    More importantly, when you begin questioning someone's journalistic integrity, does that make you any better than the person you're accusing? The answer: no.

    What? You mean, if we state that it appears that someone has a particular bias towards a certain product because we suspect they appear to be getting kick backs that we are no better than them?

    Even if we have proof?

    I would think that if had knowledge of such behavior that it would be in the best interest of everyone to know about this..
    --
    "I am the king of the Romans, and am superior to rules of grammar!"
    -Sigismund, Holy Roman Emperor (1368-1437)
    1. Re:What? by KDR_11k · · Score: 1

      Oh, so I have no journalistic integrity? Well, duh, do I look like a journalist?

      --
      Justice is the sheep getting arrested while an impartial judge declares the vote void.
    2. Re:What? by ShakaUVM · · Score: 3, Interesting

      >>What? You mean, if we state that it appears that someone has a particular bias
      >>towards a certain product because we suspect they appear to be getting kick
      >>backs that we are no better than them?

      Exactly. The ability to expose bias (or just plain old sell-outs) in the media is one of the critical components to running a free press. Flogging the messenger is the wrong thing to do.

      For example -- I played a RPG back in the day called Olympos or something. It was literally the worst RPG I'd ever bought (some freeware/shareware games were worse, but not many). On the Baldur's Gate forums (before BG1 came out) a guy posted a question: "Hey, before BG comes out, has anyone played this game, Olympos?" I (and about five other people) responsed with withering criticism of the game. A sole person responded saying they LOVED it, and it wasn't nearly so bad as everyone was saying it was. The forums showed the IP addresses people posted from, and I noticed that this guy was posting from the same regional ISP that the Olympos people used (I had traded emails with the company trying to resolve one of their numerous bugs.) I posted on the forum my suspicions that the person was a plant from the company. People flamed him. He wrote back a scathing "How Dare You" email, then suddenly people were flaming ME. All I'd done was note that the only person in the greater United States that liked the game had been from the same podunk ISP as the company, not said the guy was absolutely a member of the company, simply a suspicion, and yet I was the person who ended up getting attacked. It's an interesting social mechanic, and I don't doubt something similar is going on here.

      As long as the SCOPE of the suspicion is not deceptive (i.e. as long as the author doesn't say he has stronger evidence than he actually has), and he simply posts his evidence and lets people draw their own conclusions, I think that's the proper way to root out weasels, bought reporters, or people posting under fake identities.

    3. Re:What? by easychord · · Score: 2, Insightful

      But if at that time you were an employee of Bioware it would have been harder to trust you. Maybe you were making things up to sell more copies of Baldurs Gate?

      Thats absurd of course, but one magazine editor trying to make his publication sound more honest than the competitors isn't always the best person to listen to. A lot of games reviews and opinions are slanted, but can you really trust anyone in the industry to tell you which ones to believe?

    4. Re:What? by ShakaUVM · · Score: 1

      >>But if at that time you were an employee of Bioware it would have been harder to trust you. Maybe you were making things up to sell more copies of Baldurs Gate?

      Indeed, and if people had reason to believe I was a Bioware employee, it would be the correct thing for them to do to point it out.

      The problem is when we work to shame people who point out potential bias problems, if they have been honest in their reporting.

  4. Take your pick, corrupt or incompetent by SmallFurryCreature · · Score: 3, Interesting

    Black & White. The original game. Glowing reviews and yet some time later virtually everyone acknowledged that the game kinda stunk. To much micro management, bad interface making it hard to do your task (praise or punish your pet) and generally just not worth the scores it got.

    So explain it dear game reviewer who gave this game and others like it such high scores? I can think of three reasons.

    • You were bought, wether directly, through advertising deals or by being invited to exclusive launches and going all gooye I don't know
    • You are incompetent, you did installed the game, played it for ten minutes and spend the rest of the day jerking off.
    • or perhaps this, you weren't so much bought as unwilling to be the one that the great "XXX XXXXX" has made a bad game and that perhaps "XXX XXXXX" is not the gaming god everyone claims but just another developer who can screw up. I note that most of the reviews that have you wondering if the reviewer actually played the finished game past the first level come from the big companies/names in the industry.

    Frankly I don't care anymore, wod of mouth is worth far more to me. Friends will tell me about games and luckily as an EU customer I usually can wait for the time it takes for worth of mouth to start taking effect because games are released a few months later anyway.

    Game review sites are little more then ways to keep track of release schedules and beta signups. Judging wich game I am going to buy has stopped long ago.

    Oh and game companies that want to know how best to get a good review of your game? Playable demo. If your game is good a well done demo can create far more excitement then the best bought review.

    --

    MMO Quests are like orgasms:

    You may solo them, I prefer them in a group.

    1. Re:Take your pick, corrupt or incompetent by Anonymous Coward · · Score: 0

      I grabbed this game off the shelf when it came out, sans review reading. Oh, I'd heard the game mentioned, but (as far as I could tell) they were mixed anyways. Game sounded interesting, so I bought it. And you know what?

      I liked it. No slick ad dollars or biased reviews brought me to that conclusion. Sure the interface felt clunky, but that didnt stop me from playing this for about two months straight. So either I'm the exception to the rule, or your arguement is flawed. Either way...

    2. Re:Take your pick, corrupt or incompetent by Ayaress · · Score: 1

      A demo can also make a game look better than the final product. Certain aspect of gameplay just doesn't seem worthwhile? Leave it out of the demo. Buggy level of the game? Dron't include it, or even skip over it and put in the really cool levels.

      Something that I think Blizzard did an amazing job with the Starcraft demo was actually making it a different storyline than the game. Instead of including the first few missions from Starcraft itself, the demo had a different campaign titled Precursor which ended on a cliffhanger and set the stage for the beginning of the full version of the game.

  5. Wait... by Somatic · · Score: 2, Funny

    Are you telling me that IGN's 9.0 review of Carrot Top's Mad Kareoke Jams was somehow tainted? Cause I was about to send the author hate mail for being such an idiot... but if he was just being a capitalist, that's different.

    --
    My script don't crash! She crashes, you crashed her!
  6. Payola by Anonymous Coward · · Score: 0

    It's no different from Payola and just as illegal.

    1. Re:Payola by SetupWeasel · · Score: 1

      But because they are the ones with the money and lawyers, just as unlikely to ever be stopped.

    2. Re:Payola by rtechie · · Score: 3, Insightful

      "It's no different from Payola and just as illegal."

      No it isn't, illegal that is. People don't seem to understand that payola laws are VERY narrow and ONLY cover record labels paying individual radio DJs and radio stations for airplay of specific songs. That is the ONLY thing that is illegal, and this law is widely violated by using "third parties". And by "widely violated" I mean virtually every single song you hear on commercial radio is the result of payola. The laws are really about going after DJs who essentially are screwing the STATIONS by playing a different "payola list" than what the labels paid the STATION for. Radio is such a wasteland that DJs are completely willing to get fired for kickbacks, hence payola.

  7. From another magazine editor's perspective by Anonymous Coward · · Score: 0

    I read his letter in EGM, and I have to say, as an editor for a magazine (albiet smaller) I fully hear where he is coming from. I am constantly being asked by assorted companies to cover their product, and in exchange, they'll "buy whatever I want them to" (actual quote). Now, that's all fine and dandy if they happen to have a kick ass product; more likely, their product sucks, and we don't want anything to do with it. Why cover something that isnt good? So imagine the frustration when you see that most/all your competition covers said product, and receive tons of ad dollars from that company (and they didnt pay a dime in your mag). Multiply this by dozens of companies, and editors of honest magazines (few and far between, it seems) tend to get pissy.

    And the kick? Joe Reader doesnt know this is all going on behind the scenes, the companies are happy because their product is getting promotion and the dishonest magazines have a bunch of cash.

    It's the same thing with newstand sales. Magazines love to hype their print numbers, but one look at their actual newstand sales can show what's really going on. Most magazines are lucky if 20% of their issues on the stands sell, but they don't pimp that, they just talk about the total issues out there. So if your average magazine sells 10-20% of their huge 200,000 presence, that's only 10,000-20,000 magazines in the hands of readers, and Activision isnt about to drop a $40,000 full page ad for 10-20,000 readers.

  8. Driv3r, lest we forget. by easychord · · Score: 2, Interesting

    Driv3r controversy.
     
    This report makes the online review sites sound more honest than print media which I don't think is all that true these days. (Yes, web sites with massive flash ads every 5 pages and their software bundled with games, I'm talking about you.) It was fun watching the people from the UK's biggest games magazine publishers getting caught in their lies in the forums though.

  9. Journo mumbo by mattpeckham · · Score: 1

    Observe the following list from Bill Kovach and Tom Rosenstiel's The Elements of Journalism (Three Rivers Press, 2001). Note #4 and #5. 1. Journalism's first obligation is to the truth. 2. Its first loyalty is to citizens. 3. Its essence is a discipline of verifications. 4. Its practitioners must maintain an independence from those they cover. 5. It must serve as an independent monitor of power. 6. It must provide a forum for public criticism and complaint. 7. It must strive to make the significant interesting and relevant. 8. It must keep the new comprehensive and proportional. 9. Its practitioners must be allowed to exercise their personal conscience. http://mattpeckham.1up.com/do/blogEntry?bId=622404 2&publicUserId=5653164

  10. Bigger Companies Throwing Weight Around.. by Anonymous Coward · · Score: 0

    Sony and Microsoft pay for this kind of crap all the time; they can afford it.
    Nintendo does not have those financial resources.

    1. Re:Bigger Companies Throwing Weight Around.. by SetupWeasel · · Score: 2, Interesting

      That just isn't true. Nintendo keeps billions of cash on hand. They are famous for it. The last number I heard was roughly $7 billion. That doesn't include any of their other investments and assets.

      Now, I don't know if they do buy magazine or website reviews. As a fan, I hope they don't. However, I do know they have plenty of money to do so if they wanted to.

    2. Re:Bigger Companies Throwing Weight Around.. by Anonymous Coward · · Score: 0

      judging by the continous drain made by payroll of the seattle mariners, I suspect that the "cash on hand" is much less than that.

    3. Re:Bigger Companies Throwing Weight Around.. by -kertrats- · · Score: 1

      Hiroshi Yamauchi is retired; the Mariners aren't connected to Nintendo at all.

      --
      The Braying and Neighing of Barnyard Animals Follows.
  11. Just like sports journos by DingerX · · Score: 1

    ... Or the "society page" folks: games pubs need access to a group that in turn needs them. There are strong financial pressures for folks to be buddy-buddy. And the journalists will argue that the Sports and Entertainment audience demands and even expects the journos to be in cahoots with their subject. After all, who reads the sports pages? Sports fans! They don't want an impartial assessment of anything. They want opinionated bits of blather by moronic columnists coupled with "behind the scenes" peaks at the lives and games of their favorite stars.

    Same for games journalism, they will argue.

    The result? Uh -- don't read the reviews uncritically. Don't trust previews to show you anything. Don't whinge about the hierarchy at E3. For that matter, don't pay attention to any of the coverage of E3 or any other media circus.

    But real journalism? not from these guys. There's too much money at stake, and since nobody seems to bu these publications, someone has to pay for them.

  12. Not just reviews... by cmonkey_1973 · · Score: 1

    Discovered this one in the same way as the original commenter.

    There are certain UK stores that stock games in a "top 10 chart" arrangement. These charts are calculated by sales on a weekly basis - with one exception. Several publishers like to have their game "debut" at number one in the chart, and they can, with the simple expedience of paying for it. So, if you go into Game two days mid-week, and the number one game is not the same on the second day, you'll know why...