Slashdot Mirror


Tech Review Sites and Payola

cheesecake23 writes "How often have you read a hardware review and thought: 'No way was that an honest opinion, the reviewer was bought'—? The Daily Tech has gone undercover to find out whether or not payola is accepted among the 35 largest online English-language hardware review sites. Questions asked and answered — Q: How many sites would take money (or sell ads) in exchange for a product review? A: 20 percent. Q: How many sites would additionally consider selling an Editor's Choice award? A: None. Q: Were any regions of the world more corrupt than others? A: No, it was 20-25% almost everywhere. Q: Does it depend on the size or age of the site? A: RTFA. Although no bad actors were explicitly unmasked, the article contains enough information to make a whitelist of quite a few good guys."

28 of 189 comments (clear)

  1. Slashdot Payola by Anonymous Coward · · Score: 4, Interesting

    Slashdot takes it, just admit it.

    How else can the editors explain Roland Piquepaille, among others?

  2. Is this a surprise? by Bender0x7D1 · · Score: 5, Interesting

    In today's corporate-controlled world does anyone take reviews without a hefty dose of skepticism?

    I'm not trying to say that there aren't neutral reviewers but, with marketing budgets as they are, is anyone surprised that some "neutral" reviewers are actually paid enough to be biased?

    --
    Reading code is like reading the dictionary - you have to read half of it before you can go back and understand it.
  3. "Immorality" of radio payola? by PCM2 · · Score: 3, Interesting
    From TFA:

    The immorality of paying radio station disc jockeys to air music did not become apparent until investigations by Federal Trade and Federal Communication Commission.

    Pardon my naivety, but exactly what is so "immoral" about it? I've never really understood that. "I've got a radio station. You've got a song. Let's talk." Seems perfectly natural to me.

    A radio station could play a song a hundred times, or a million. If everybody hates the song, they're still going to hate it no matter how many times it gets aired. Meanwhile, the record company is out a pile of cash. It almost sounds like a win-win for the consumer.

    Obviously, bribing magazines for good reviews seems like a different matter...but the radio thing -- and especially the choice of the word "immoral" -- is kind of lost on me.

    --
    Breakfast served all day!
    1. Re:"Immorality" of radio payola? by Frosty+Piss · · Score: 2, Interesting

      if the DJ's only spin songs they've been payed to play, the those who can't pay won't get paid.

      So, how is that much different than Clear Channel or the majority of stations out there today? DJs - where there still are any - don't pick the songs anymore.

      --
      If you want news from today, you have to come back tomorrow.
    2. Re:"Immorality" of radio payola? by stephanruby · · Score: 2, Interesting

      "If everybody hates the song, they're still going to hate it no matter how many times it gets aired. "

      Obviously, you're not as weak-willed as I am. I once bought a tape from "The New Kids on the Block". This is not something I'll admit to in public circles, but nevertheless -- it did happen.

      Another time, when I was in France I bought a stupid CD made from a toddler singing complete nonsense, his proud parents owned most of the radio stations in France -- so you can bet their stupid little kid got constant around-the-clock will-make-your-ears-bleed kind of air play. And this is not like I was the only one doing this, the toddler's album was the number one best-selling album for many months.

      Now I don't know where you live, or what kind of music you listen to, but I find it hard to believe that you've never been influenced in your music selections, or that you don't know anyone out of your friends or family members that haven't been influenced (or made temporarily insane) by constant air play repetition.

    3. Re:"Immorality" of radio payola? by ocbwilg · · Score: 2, Interesting

      Now I don't know where you live, or what kind of music you listen to, but I find it hard to believe that you've never been influenced in your music selections, or that you don't know anyone out of your friends or family members that haven't been influenced (or made temporarily insane) by constant air play repetition.,br>
      While this may not have been understood scientifically at the time it is very much possible to influence people in very subtle ways with repeated exposure to certain stimuli. I'm not saying that Clearchannel playing the same crap some twice an hour will make everyone go out and buy a CD, but without a doubt it will increase the perceived popularity of the song, and it will increase sales. There are many studies that have been done regarding ways to psychologically "prime" people via relatively trivial (and usually innocuous) means to become predisposed to certain behaviors. I mean, we're not talking about getting Reggie Jackson to kill the Queen of England here, we're talking about getting someone to drop $15 on a CD. It won't work on 100% of the people, but it will work on a significant enough portion of the people to be financially worthwhile.

  4. Even if they don't, the reviews are semi-useless by jandrese · · Score: 5, Interesting

    I've always been a bit annoyed that hardware review sites almost always get cherry picked engineering samples to test. Normally this isn't a big deal, but they always test the overclockability of hardware these days (I swear Ars, HotHardware, HardOCP, and the like would overclock hard drives if they could) which is fairly pointless with a sample size of 1. Worse, they have no way of testing if that overclocking is going to cause the hardware to fizzed out after 2 months. They also rarely include factors like "will the manufacturer maintain driver support 3 months down the road and fix the bugs in the current driver?" which is far more important than clocking it up to 105% and running Supreme Commander.

    I know I'm being a little unfair here, but it's one of the main reasons that I rarely bother with hardware review sites anymore unless I'm actively looking to buy a particular piece of hardware. Well, that and their tendency to spread articles out over hundreds of pages with as little content as possible on each page.

    A good example of this is the 120 page article on Core2Duo heatsinks posted to Slashdot a few days ago. At no point did the hardware review guys examine the fans to see if they were bottom of the barrel "will die in 6 months" models, or if they were high quality fans worth the $50 price tag on the cooling solution.

    --

    I read the internet for the articles.
  5. Re:Meta-Cynicism by cheesecake23 · · Score: 2, Interesting

    How do we know daily tech did not take any payola from the reviewers surveyed? I submitted this to /., so I'm one of 3 or so people who RTFA. They mentioned something about this, let's see ...

    There are approximately 150 circulated English-print technology websites; our team specifically targeted the 35 largest publications. We determined the size of these publications via Alexa's online index and publication-supplied web statistics. DailyTech was included among this list. Yes, there it is! They tempted themselves with payola. No word on whether or not they accepted though.
  6. Re:A survey of editors?? by Anonymous Coward · · Score: 1, Interesting

    The only English-speaking country that did not report any Payola was Australia

    I call BS from personal experience ( and hence why I post ANON )

    Every publication I dealt with in Australia always asked for you the product maker to supply "editorial" as extra incentive to advertise. I have worked with reviewers directly as few of them have good experience with the hardware/software and they simply regurgitate what you give them. This is reporting these days and is simply an extension of current affairs programs (which tend to be user supplied footage) which have more in common with infomercials than investigative journalism

  7. Re:Even if they don't, the reviews are semi-useles by TheGratefulNet · · Score: 2, Interesting

    I once overclocked my ethernet card.

    at the time, getting 11Mbps was pretty good!

    and you're right - I had to have special LANCE controllers to achieve that speed. its true. most could only go to 10.5.

    --

    --
    "It is now safe to switch off your computer."
  8. Re:Toms by Lisandro · · Score: 4, Interesting

    Yeah, i also remember when Tom's Hardware didn't use to stretch articles in 17 ad crammed pages. Or when MTV played, you know, actual music, for that matter...

  9. Re:Give the names, you chickensh!t by Anonymous Coward · · Score: 3, Interesting

    Because they might get sued? Sued for what? If the article had been properly researched, that court case would last about 30 seconds:

    Some review site: They lied and said that we'd accept money for better reviews! Sue! Sue!
    DailyTech: Here's the tape recording.
    Judge: Case dismissed. Depending on your local jurisdiction (but ask your local sheriff's department and your lawyer before you rely on anything I say here), it is not illegal for you to tape a conversation without telling the other party - if you are one of the parties in the conversation. There's no reason they couldn't have backed their article up with some solid evidence.
  10. Re:Toms by bladesjester · · Score: 2, Interesting

    I also remember when Mtv played music. I miss that. I used to flip over to Mtv in the early morning while I was getting ready for school in high school and jr high.

    I also miss Mtv Oddities and wish they'd release The Maxx on dvd since Aeon Flux is out on dvd now.

    --
    Everything I need to know I learned by killing smart people and eating their brains.
  11. Ask Roland Piquepaille. by Anonymous Coward · · Score: 1, Interesting

    If you're lucky he might send you a copy of the contract he has with Slashdot.

  12. Re:Do you lie cheat or steal? by pytheron · · Score: 2, Interesting
    best way I saw to accept a bribe was from the Korean film "The King and the Clown". A government minister is making a show of presenting a golden turtle to the King, who won't accept it due to the unsubtle nature of it being offered. After several attempts, the King obliquely points out that the minister ought to change his method, to which the minister replies "I don't have enough money for the journey home, my Lord... but if you will buy this turtle from me for the cost, you would help me greatly". The King turns round, and laughs "At that price, I'll take 2!".

    I expect alot of bribes are along similar lines these days.

    --
    "I am not bound to please thee with my answers" [William Shakespeare]
  13. Re:Meta-Cynicism by Kalriath · · Score: 2, Interesting

    There are approximately 150 circulated English-print technology websites; our team specifically targeted the 35 largest publications. We determined the size of these publications via Alexa's online index and publication-supplied web statistics. DailyTech was included among this list. Yes, there it is! They tempted themselves with payola. No word on whether or not they accepted though. They actually gave a hint when you combine the article with the comments. The article states that no publication with a seperate editorial and sales department would accept bribes, and in the comments mentioned that DailyTech has a seperate editorial from sales team. So, apparently their sales team refused.

    --
    For a site about things like basic rights, Slashdot users sure do like to censor "dissent".
  14. Re:They only take it from known conspirators by Anonymous Coward · · Score: 1, Interesting

    Posting AC as I still like my job
    Or ones who pay more My company once went to offer one of our products worth $10k to a for a needy organisation who were shown on TV, we called the station while the show was on Live, A few days later after no response Our competitior was shown handing over there product claiming it was worth $25k, A quick check on there web site showed there price was still only $12k.

      As for reported Sales figures in a previous job the owner could never understand why our competitors always supposedly sold more PC's (according to magazines) when our suppliers leaked that we actually bought more components by a factor of 3 (Good to sell the accounting system to your supplier) the next time the owner multiplied his fiqures and not one person questioned the huge monthly increase at the magazine

    As for MPAA type figures while working in a video store the weekend rental $ amounts often came out before stock was in any store

    Duh moment most of what you read is Lies, Damn Lies, and very little selective statistics

  15. Re:The beef by xenocide2 · · Score: 4, Interesting

    Fuck, have you looked at the firehose? It's no wonder he gets stories posted. He knows grammar and spelling and doesn't get his news from slashdot. Which is better I can say than most submissions.

    --
    I Browse at +4 Flamebait

    Open Source Sysadmin

  16. Not a huge surprise. by jd · · Score: 2, Interesting
    The thing that scares me is that I've seen "reviews" in the regular and tech press that are so blatantly paid advertising as to be absurd, yet people actually take them as gospel truth. The Guardian newspaper in the UK is great in many ways, but don't bother with their tech section - it's almost 100% payola. I'm increasingly skeptical about the WSJ after seeing some of their "articles" as well. This isn't new - Computer & Video Games (aka Commodore & Vegetable Games) was notorious for highly questionable reviews. Nor is it limited to the low-end - I've seen plenty of falsely promoted high-end systems.

    In the same way that payola for music is illegal (in the US, although actual prosecutions are almost non-existent), it would benefit the tech industry if payola "reviews" were outlawed. The problem there is that there were attempts to make non-payola reviews of tech articles illegal, by banning reviews that were not authorized by the manufacturer. Dunno if that ever passed, but it wouldn't surprise me. Nonetheless, without independent monitoring, the industry is nothing more than trickery and fakery. Why? Because those are so much easier and cheaper than actually doing any real work. If you make the money anyway, why not take the easier road?

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  17. Re:They only take it from known conspirators by adelord · · Score: 2, Interesting

    I have a sincere question about Consumer Reports: For many of their car and computer hardware stats don't they depend upon readers sending in surveys? Doesn't that mean their reports may suffer from heavy selection bias? My wife will veto any big ticket item purchase if it doesn't have a favorable review. Thankfully Apple and Honda do very well so I got what I wanted when it has mattered so far, but part of me is worried that even though Consumer Reports is independent their methodology may be crap. My guess is no, but since there isn't a single better data source consulting CR is an important component of an informed decision. Are the statistics published in Consumer Reports for cars and computers mathematically sound?

    --
    Eugene Debs: "Money constitutes no proper basis of civilization"
  18. A whitewash by Eukariote · · Score: 4, Interesting

    The rot is far deeper. This article vastly understates the problem: there are so many levers manufacturers can pull in order to influence or bias reviews, payola is only the start of it. Development of corrupt benchmark software used by the review sites can be bought, biased compilers (Intel compiler) generate some of the code being benched, advertisement money can be withheld or expanded, early or free samples can be provided or denied.

    The review sites, in turn, can do a lot to make review seem fair while applying a subtle bias. They can limit themselves to certain benchmarks, (de)emphasize or arbitrarily weigh some results, frame the the article, or spin the conclusion.

    It is not hard to see this in action. Take the pervasive and saturating Core 2 hype on all sites, last year, for example. Many sites were running the same biased selection of benchmarks. Nearly all sites avoided 64-bit benchmarks.

    I would like to see a bootable Linux benchmark CD that runs stock GCC compiled code in 32 and 64-bit mode and provides various workload, scalability, and throughput tests. Something that is open and runs precisely the same code on all machines. Something anyone can pop in his own PC or laptop. But then, even if that were to exist, would the sites start to report that benchmark in their reviews?

  19. German language example by Vlad_the_Inhaler · · Score: 3, Interesting

    The German-language 'PC-Professionell' (they belonged to Ziff-Davis back then) used to always carry a full-page advert for 'Waibel' computers on the back cover. Inside the magazine, they would review various hardware and Waibel *always* got the editor's choice award. The way I remember it, even if they were not reviewing any other PCs they would still review the finest offering from Waibel so they could rave about it. As far as I remember, other Ziff-Davis magazines did the same but it is PC-Pro I really noticed.

    Another computer magazine called C't also reviewed Waibel hardware once or twice. In the last review they gave, they indicated the hardware was ok at best (I think they were overclocking) but that the XP Licenses were illegal - something they got Microsoft to confirm. This was in late 2002. Waibel ceased trading in January 2003.

    I am sure that Waibel paying for full-page back-cover adverts, and the rave-reviews inside were just a coincidence.

    Quoting the DailyTech article: Once presented with the data for this article, Schnieder paused before responding. "I think if you look back even five years, you would have seen this type of thing be much more common than it is today." He concludes, "Like most things, the marketplace will eventually weed out the businesses and websites who choose to operate in this manner."
    Waibel closed. I occasionally look at a PC-Professionell nowadays but I can't see any obvious weighting in their reviews so hopefully the company works differently nowadays - almost 5 years later.

    --
    Mielipiteet omiani - Opinions personal, facts suspect.
  20. Re:Payola is a widespread problem by loganrapp · · Score: 4, Interesting
    I would've liked to have had a little more information on the ones to trust.


    For obvious reasons, I can see why they may want to avoid 'outing' those who are involved in payola, but it would be nice to get a few more names from the article on who we can legitimately trust.

  21. Bias - welcome back my friends... by Media_Scumbag · · Score: 3, Interesting

    To the show that never ends
    So glad you could attend
    Come inside
    Come inside

    I quit journalism because I got pressure to favor advertisers' products. I had the Exec Editor of a trade print publication attribute my name to a press release and it was called a "review." I told her that if she did it again, I'd sue for defamation of character. \

    For related reasons about the integrity of the mag, I quit.

    That was 2000. I can do more good as a poster than a writer...

    =D

  22. Re:Aussie Aussie Aussie by mac1235 · · Score: 2, Interesting

    Well, the only site down under is Dan's Data, and he's HARDCORE!
    http://www.dansdata.com/index.html

  23. Surprised it's that low by smchris · · Score: 2, Interesting

    One of my favorite personal sayings, "I've been around computers so long I can remember when non-Microsoft products were PC Magazine's "office applications of the year".

  24. Re:The beef by TufelKinder · · Score: 2, Interesting

    Right -- or how about the simple fact that he's one of
    the top two submitters? Maybe when some of the whiners
    start submitting a couple hundred stories, they'll get a
    few accepted as well.

    --
    If liberty means anything at all, it means the right to tell people what they do not want to hear. -- George Orwell
  25. What am I doing wrong? by clickclickdrone · · Score: 2, Interesting

    I've been writing for both print and online mags for 15+ years and have never been hassled by a supplier over a bad review or been offered anything for a good review (UK based). Most editors I've worked for have been very clear about working to a 'ad dept does not talk to editorial' policy.
    I've often been told about how much US editorial is 'bought' but wasn't aware it was so endemic globally.
    The closest I've ever come to any possibility of being bought is that some manufacturers let you keep the hardware/software and some insist on having it back after the review period. In recent years this has shifted to the latter in the UK due to changes in tax law that prevent review kit from being treated as tax deductible.

    --
    I want a list of atrocities done in your name - Recoil