Hardware Review Sites and Vendor Relationships
VL writes "Manufacturers demanding content changes is nothing new in the tech site community. We take a look at this topic, including one very public example that started in the past three weeks."
← Back to Stories (view on slashdot.org)
One of the first cases of this was when Tom's Hardware (then only a startup site) reviewed a Riva TNT and said it was twice as fast as 3DFX voodoo (obviously untrue, but it's unknown if Nvidia paid him anything to say this). Eventually 3DFX picked up on this and demanded that Tom changes it, which he did.
But the damage was already done.
eden.h4xx.com - whacky free for all image board
Change your content, or else: Manufacturer's demanding content changes is nothing new in the tech site community. We take a look at this topic, including one very public example that started in the past three weeks.
Date: March 15, 2004
Manufacturer: N/A
Written By: Hubert Wong
Just under a year ago, we provided some insight on the inner workings of running a tech site. Yes, there are thousands of sites out there, and despite the diversity, there are several constants in our universe... costs, advertising, readership, and most important of all, integrity.
Running a site, especially a tech site, isn't free and there are plenty of costs involved. Everything from the hardware purchases (not everything is free, which is a general misconception I think), to the server and bandwidth... it all has a price.
This is where advertising comes in. If the site is lucky enough, advertising will net a nice income each month, but for a greater number of owners, they'll be lucky if it helps them break even.
Of course, an advertiser is not going to consider a site that doesn't meet their traffic requirements. Readership is what makes our world go round. Without our loyal readers, VL wouldn't be where it is today, and I would say that the same goes for the majority of sites out there.
Casual readers come and go, but a loyal reader is somebody that means a lot to a site. It's common knowledge that most sites track their traffic. This gives us an idea of trends, and how to cater our content. We're not too concerned about our uniques a day, but rather our bookmarks and returns. People who bookmark and/or return multiple times a day make up a site's readership. Uniques are new visitors who either stop and go, or decide to stay. What turns a unique visitor into a regular reader? Content? Yes. Attention to detail? Sure thing. Integrity? Nobody likes a site that lies about a product just to suck up, right?
Granted, the last point isn't something that is respected by a great number of sites (the actual number is more than you think), but the site's I do frequent on a regular basis (Ed. Note: Including our own :D) do try hard to stick with their journalistic integrity.
There are instances though where manufacturers will try to influence
a site's review. Sadly, this happens quite often, and it becomes
a problem when this influence attempts to change a
writer's perception of the product. This is something site owners
need to deal with constantly, and yes, here at VL we've been asked
to have a change of heart on more than one occasion.
Errors or omissions happen, and we're more than happy to make
amendments, but as a reader, you can rest assured knowing we'll
never mislead you because somebody asked us to so they can improve
sales.
Luckily, most Tier-1 manufacturers; i.e., the ones who have a good amount of exposure within the enthusiast community, do respect a journalist's right for free speech. Sure, even some of the big dogs take issue with what we in the community say, but that's the price of exposing yourself with press releases. Whether a product is released and performs less than expected, or if it
How about Oracle asking for MySQL to remove their stats from the benchmark table
"Note that Oracle is not included because they asked to be removed. All Oracle benchmarks have to be passed by Oracle! We believe that makes Oracle benchmarks very biased because the above benchmarks are supposed to show what a standard installation can do for a single client."
Error: Id10t detected
While its not exactly reviewing all the latest and greatest, www.dansdata.com is my favorite "independent" web review site. He usually sticks to cameras, small computer parts, and other neat electronics, but he's a no BS kinda guy who will say something sucks when it does.
Seconded. Dan rules. He reviews everything from small computer cases and bisarre amount of heatsinks, over LED flashlights and soap bubble pistols, to radio controlled tanks. His writing is excellent, and he's also very knowledgeable, which at least keeps me checking back every day for new articles. And no, I have no relation whatsoever to Dan, I'm across the planet from him. I'm just an appreciative reader, who really should get a PayPal account and plonk some $AU his way some day.
main(O){10<putchar(4^--O?77-(15&5128 >>4*O):10)&&main(2+O);}
Just to say so up front, I write for The Inquirer (www.theinquirer.net), and do a fair amount of hardware reviews. I also go to the trade shows and the like, and talk to other journalists. You learn a lot there.
:). You learn even more if you do not drink. I don't.
You also go to parties afterwards and people get very drunk. You learn a lot more there
The things you learn are open secrets, all the vendors know what is going on, and all the writers and reporters do also. Some employees may not know thier bosses are not quite clean, but that is another issue.
I was talking to several DRAM vendors about benchmarking at CES, and was told, by name, and usually by several sources that certain web sites would not review a product without advertising dollars. In fact, advertising dollars could significantly skew the results of a review.
These were not offhand comments like 'we think that they don't like us', it was direct 'If we don't cough up the cash, they won't review us'. Several different sources in the DRAM and other industries told me similar things, and for the most part, 2 or 3 names kept coming up. No, I will not name them.
If you follow the hardware sites, you can pretty much pick up who is 'dirty'. When 5 sites review the same new video card, all with the same *yawn* benchmarks, and 4 get one result, and the 5th gets a different result, and praises the 'loser' in the commentary, what do you think is going on? I mean, it is rather obvious.
The flip side of it is I get accused of bias just about ever day. Other than it getting rather old, it is usually not worth commenting on. I get accused of loving AMD, loving Intel, and being a liberal weenie and a republican nazi over the same article.
The truth of the matter is I get what hardware I can from who I can, and write about it. I bitch out HP all the time for blatant management stupidity, but I can't recall ever reviewing one of their products badly. I buy a lot of them with my own money. Strangely, they won't talk to me.
I also review a lot of AMD gear, and almost no Intel stuff. Why? AMD sends me things when I ask, without any pain or hoops to jump through. Intel won't. I know they can, friends in the industry have intel sending truckloads of chips to them on offhand remarks. I would almost say they don't like me or want me near thier products. If I ever do get one, I will write about it fairly though, I think that is what they are afraid of.
Last but not least, I know at least 3 of The Inq writers, me included, have been offered money to do something, or not do something. All the ones that I have heard of turned them down. At CES in January, a vendor who I know and like tried to hand me a wad of bills. I (politely) turned him down, even though it was probably more money than I had seen in a month, and it would have made the difference between another day of dollar menu items and water, and the not totally cheap buffets in vegas. Others have been offered 6 digits to do things. Personally, I don't know why he turned that one down.
What it all comes down to is ethics. Once yousell out, you are done. How can you trust them ever again? Easy you can't. That is why I turned down the money, and why the site puts reporting first. If it were any other way, I would be gone.
Other sites make other decisions, and they quickly get the reputations that they deserve. The community knows, and if you look closely, you can pick out who is clean fairly easily, it isn't all that hard.
-Charlie
"Dans Data / will say something sucks when it does."
Just had to buy some speakers for work, and there was only one site which ignored the manufacturers' claims of power rating, and talked instead about the wattage available from the power supply, the likely efficiency, and the ratings printed on the back of each driver. Most other sites seem to take specifications at face-value.
In fact, Dans Data has been known to:
(-) Tell you a speaker gives 20W output even when it's described as "250W total system power"
(-) Actually test CPU heatsinks with a resistive heater
(-) Relentlessly mock manufacturers who describe 10^9 bytes as a gigabyte
(-) Take everything apart
(-) Know enough about overclocking to laugh at people who do it badly
(-) Pick-up digital camera manufacturers for lying in their "megapixel" ratings (I think some of them count each colour in a pixel as a separate pixel?)
(-) Write reviews in valid HTML that are all on one page, and use the full width of your browser window without Flash animations
(-) Test PC power supplies under load, and compare it with manufacturer specifications
(-) Get out the multimeter for pretty much everything, from LED flashlights to power supplies and batteries
And of course, the famous:
(-) debunking a load of wacko free-energy products and "this'll make your toaster healthier" new-age power connectors.
As Dan would say, "reccommended."