Slashdot Mirror


People Are Complete Suckers For Online Reviews (nypost.com)

schwit1 shared an article from the New York Post: No reviews, no revenue. That's the key takeaway from a new study published in Psychological Science, which finds that if two similar products have the same rating, online shoppers will buy the one with more reviews... "[When] faced with a choice between two low-scoring products, one with many reviews and one with few, the statistics say we should actually go for the product with few reviews, since there's more of a chance it's not really so bad," wrote researcher Derek Powell of Stanford University, lead author of the report. In other words, when there's only a handful of reviews, a few bad ones break the curve and bring down the overall rating. "But participants in our studies did just the opposite: They went for the more popular product, despite the fact that they should've been even more certain it was of low quality," he wrote.

Matt Moog, CEO of PowerReviews, previously conducted a study with Northwestern University [PDF] that drew from an even larger data pool of 400 million consumers, which also found that the more reviews there are of a product, the more likely it is that a customer will purchase that product... He has also found that customers who read reviews often click the bad ones first. "They want to read what's the worst thing people have to say about this," he said... Most online shoppers (97 percent to be exact) say reviews influence their buying decisions, according to Fan & Fuel Digital Marketing Group, which also found that 92 percent of consumers will hesitate to buy something if it has no customer reviews at all.

87 of 162 comments (clear)

  1. "...often click the bad ones first.." by turkeydance · · Score: 1

    bad news sells. more bad news sells more.

    1. Re:"...often click the bad ones first.." by Anonymous Coward · · Score: 1

      If i want a product, i pretty much know what it is supposed to include, but i want to know if the promised features and quality are as claimed. That's why i check the bad reviews first. And most of the good reviews are pretty much "works for me, thanks". That does not tell anything really.

    2. Re:"...often click the bad ones first.." by Anonymous Coward · · Score: 5, Insightful

      I always check the bad reviews and only the bad reviews. Good reviews generally aren't helpful, they're either fake and posted by the seller or genuine but not useful. Seeing twenty 5 star reviews that say "it worked great for me" is great, but what I really want to know is how it failed for people and if I care about those failures.

      If all the bad reviews are by people who are clearly crazy or doing something stupid, I can be fairly confident in the product. If they instead reveal significant flaws, I may want to reconsider.

      As always, XKCD has a relevant cartoon about this.

    3. Re:"...often click the bad ones first.." by JaredOfEuropa · · Score: 1

      Pretty much this, the exception being movie reviews. There I tend to read both the positive and negative ones. Well, until recently. Is it me or is there something fishy going on at IMDB? New movies receiving positive reviews, written by long time members, yet uncannily smelling like something written by studio drones, using words you'd expect from a marketeer rather than from a movie enthusiast. There's an odd sort of similarity to these reviews.

      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
    4. Re: "...often click the bad ones first.." by dougdonovan · · Score: 1

      i love gullible people.

  2. More Complex by zieroh · · Score: 5, Insightful

    I think it's a bit more complex than that. Oftentimes, you can determine from poor reviews exactly what the shortcomings are, and decide if those shortcomings affect your intended use of the product. If a competing product has no reviews, then you have no way of knowing what the shortcomings are.

    --
    People who say "sheeple" have about as much sophistication as an AOL user, and in fact are probably actually AOL users.
    1. Re:More Complex by TWX · · Score: 5, Insightful

      Correct. What went wrong for other people? Why did it go wrong? Will this function impact me?

      As a case in point it's not really possible to buy an inexpensive TV that lacks "smart" features anymore. Smart features are very inconsistent from manufacturer to manufacturer. Thing is, if I never connect my TV to anything but an antenna, do those smart features matter? I need to read other users' experiences with a given TV or a range of candidate TVs to see what features work and what don't, and just because a TV gets poor reviews doesn't mean that the functions that I'll use are the ones poorly reviewed. It could be that the Internet connectivity stuff is what's garbage, or like the one I actually bought, the stock remote sucks but if I get a $10 remote from the previous model TV, I get 80% of the features back that normally require a cell phone with Bluetooth or other "smart" feature to work.

      --
      Do not look into laser with remaining eye.
    2. Re:More Complex by Mr+D+from+63 · · Score: 5, Insightful

      I think it's a bit more complex than that. Oftentimes, you can determine from poor reviews exactly what the shortcomings are, and decide if those shortcomings affect your intended use of the product. If a competing product has no reviews, then you have no way of knowing what the shortcomings are.

      I read reviews, but only really pay attention to ones that make sensible explanations of what they do or don't like. Positive reviews can be very helpful if you are looking for a certain functionality, but they have to be precise and not cheerleading. A lot of reviews often means there are more good ones to find, more useless ones as well. For the most part, when I read reviews and then purchase, I wind up getting pretty much what I expect. You can never eliminate the possibility of a surprise when buying products you've never tried before.

    3. Re:More Complex by Anonymous Coward · · Score: 5, Insightful

      Correct. What went wrong for other people? Why did it go wrong? Will this function impact me?

      It's striking me as somewhat ironic that a couple stanford researchers appear to have missed the significance of having thorough documentation.

      Because that's basically what you're getting with masses of reviews readily available.

    4. Re:More Complex by Wycliffe · · Score: 4, Interesting

      If a competing product has no reviews, then you have no way of knowing what the shortcomings are.

      Not only this, but I'm always suspicious of a product with very few reviews. If people are actually buying the product then there should be some reviews. If there are no reviews, I start to suspect it to be a fraudulent listing.

    5. Re:More Complex by DontBeAMoran · · Score: 1

      Asking for the knowledge and experience of others doesn't make someone an idiot. An idiot would not research anything and go to his nearest local store and grab the first piece of crap on sale.

      I did my own research, however there's hundreds of Android tablets out there, some of them made by companies which I have never heard about before.

      --
      #DeleteFacebook
    6. Re:More Complex by Zxern · · Score: 1

      If you're only going to watch videos, then you probably don't want a Tab 7 E Lite. The display quality is terrible and low resolution. You'll want the shell out the extra bucks for a pro version with the far better display and higher resolution.

      Unfortunately Android tablet makers won't put a good display on a cheap tablet, they only put them on the top end devices.

    7. Re:More Complex by omnichad · · Score: 4, Informative

      Negative reviews by morons actually tend to be extremely helpful. You know exactly why it was rated poorly (they didn't read directions / too dumb to use it). I find this especially true for restaurant reviews, where they describe something "wrong" with the food that really means that the food was made correctly and they've just never had a good version of that food.

    8. Re:More Complex by omnichad · · Score: 1

      You could even go down to a Kindle Fire and install the Play store for a pretty good price. It also has microSD support. I'm too cheap to even buy that, though, so I don't have firsthand experience.

    9. Re: More Complex by Anonymous Coward · · Score: 1

      Oftentimes in *bad* reviews, people will suggest features they wanted but did not get. That too can be a deciding factor whether or not I want one product over another.
        Furthermore, reviews can also advise you on the update policies, and/or competence of the provider. Some products get better, others get worse.
        The beginning of a new product is almost always prone to problems, and using a new product instantly makes the user into a beta tester. Using long and well established products usually provides some measure of stability.
        The difference is often a question of innovation. Once again, reviews can help by providing a framework for understanding the innovation vs stagnation factor.
        Simply saying that that all peeps are simps for reading reviews (*bad* reviews 1st) isn't just an oversimplification, it's actually rather insulting.

    10. Re:More Complex by DontBeAMoran · · Score: 1

      That was my first choice too, however the Kindle Fire is not available in Canada.

      --
      #DeleteFacebook
    11. Re:More Complex by houghi · · Score: 1

      I live in Europe and tend to exclude American reviews as their expectations are completely different. e.g. what Americans see as rude, Europeans see as professional. For hotels: I do not need a coffee maker.

      But those are things I know what I want/need

      --
      Don't fight for your country, if your country does not fight for you.
    12. Re:More Complex by houghi · · Score: 1

      That is all great if you know if you are going to use certain features or not. Or can put a value or importance on them for yourself.
      You know that you do not use the smart features, so you know not to look at the info concerning it.

      It becomes different if you do NOT know the importance of something. Perhaps it is something that is utterly useless even if it would work, perhaps it is something that you absolutely need. What if there is something seriously wrong with the left phalange. Does that influence you?

      It becomes important when you decide if you want to buy something that you have not so much experience with.

      --
      Don't fight for your country, if your country does not fight for you.
    13. Re:More Complex by temcat · · Score: 1

      You could use a forwarder like MyUS.com, Shipito.com etc. — however, the warranty may not apply to you in that case.

    14. Re:More Complex by im_thatoneguy · · Score: 1

      Al Dufuq:

      the statistics say we should actually go for the product with few reviews,

      I pick the most reviewed item with the same review because if it's 5 reviews I have no idea if the failure rate is 1/100 or 1/6. If there are 10,000 reviews I feel pretty good that if there is 8% 1(star) reviews then it probably has about an 8% failure rate.

      What statistician says "you should study with the smallest sample size all else being equal"?!

    15. Re:More Complex by JesseMcDonald · · Score: 1

      What statistician says "you should study with the smallest sample size all else being equal"?!

      That's not what they said. What they said was that if you have two products with the same low review, the one with fewer reviews has a higher chance of actually being good. Consider the case of a 1-star item with a single review vs. a 1-star item with 1,000 reviews. The first case could just be failure to understand the product, a bad shipping experience, or even a data entry error, whereas the second case indicates widespread dissatisfaction.

      In other words, the smaller sample size is more likely to be wrong—and that is just as true of negative reviews as of positive ones.

      --
      "The state is that great fiction by which everyone tries to live at the expense of everyone else." - Bastiat
    16. Re:More Complex by TWX · · Score: 1

      Why does it have a higher chance of being good? I see not enough data points if there are not enough reviews. Its quality is ill-defined, not good.

      --
      Do not look into laser with remaining eye.
    17. Re:More Complex by TWX · · Score: 1

      It means I research the significance of the left phalange, so that I can determine what issues with the left phalange mean for me. Knowing that the product has a left phalange means I have a starting point for further research, and I may find that it doesn't matter if the left phalange will fail under particular circumstances if those circumstances are unlikely or impossible in my application.

      When I did QA testing I had to create plausible scenarios for my testing. This meant researching how something really could expect to be used or realistically misused, and then testing with those criteria in mind.

      --
      Do not look into laser with remaining eye.
    18. Re:More Complex by JesseMcDonald · · Score: 1

      I see not enough data points if there are not enough reviews. Its quality is ill-defined, not good.

      In the absence of any context I might agree with you, but we can make inferences from experience with other similar products to reason about the probable product quality even if there are no reviews yet for that particular item. The initial estimate is going to be along the lines of "average quality"—perhaps a bit lower than average if it's a new, untested item. A thousand reviews with a mean rating of one star would suggest well below average quality.

      Note that I never said that a dearth of reviews mean that the product is good, just that as a relatively unknown quantity it's more likely to be good than a different one-star product with many low reviews, which is very unlikely to be good. (Neither one would be my first choice.)

      --
      "The state is that great fiction by which everyone tries to live at the expense of everyone else." - Bastiat
    19. Re:More Complex by Wycliffe · · Score: 1

      Just out of curiosity, do you submit reviews?

      Yes, I try to submit reviews. Also, even when I submit a 5-star review, I try to mention something that can be improved in the hopes that the creator might see my review and improve their product. I also do occasionally buy stuff with no reviews but I'm more reluctant to do so.

  3. Obvious by burtosis · · Score: 5, Insightful

    If one product has 12 reviews and one 45k reviews, the 12 review has 5* and the 45k review has 4* I'd be more likely to buy the 45k review one. It's simply significantly harder to astroturf and bot 45k reviews than 12. Online typically all you have to go on is a shitty picture, product details that are nearly always incomplete and exaggerated, and reviews. The reviews are the least shitty way to not get ripped off. For the record, yes I know that many reviews on most every site are fakes, paid for the review, or bots.

    Plus sometimes the reviews are pure comedy gold and are worth reading on their own which can inspire some sales on their own.

    1. Re:Obvious by tomhath · · Score: 3, Informative
      TFA noted the same thing:

      The exception to that rule is if every one of the reviews is giving this place or product five stars. “If the rating is unusually high, that actually can have a negative impact,” said Moog, as shoppers suspect this is too good to be true. “What we have from our data is that the optimal rating is about 4.4 stars.”

    2. Re:Obvious by _Sharp'r_ · · Score: 4, Insightful

      Yeah, the study appears to naively assume all online products, sellers and reviews are completely legitimate and that reviews solely indicate a statistical level of quality and aren't influenced by other factors.

      Any product with tons of verified reviews means at least that the product has survived and sold enough to gather those reviews. That's an endorsement it's very difficult to fake.

      Now if they actually purchased and tested products themselves to determine which was better as part of the study, they might have a decent conclusion, but as all they did was make a statistical assumption then go judge people's rational behavior against their assumption, the study's conclusion is way off. They're trying to make a case about statistical uncertainty and they refuse to believe results based on people's actual experience with purchasing products online.

      This is a signal to noise issue. People are ignoring other factors and trusting lots of reviews because they're searching for the signal within the influenced-by-seller noise.

      --
      The party of stupid and the party of evil get together and do something both stupid and evil, then call it bipartisan.
    3. Re:Obvious by OzPeter · · Score: 3, Insightful

      If one product has 12 reviews and one 45k reviews, the 12 review has 5* and the 45k review has 4* I'd be more likely to buy the 45k review one. It's simply significantly harder to astroturf and bot 45k reviews than 12.

      Personally I look for reviews in the middle of the pack to get a good sense of what the product is actually like. I see a lot of 5s that appear to be people gushing about a product and a lot of 1s where it seems to be all about trashing a product. I feel that the 2s, 3s and 4s give a more balanced perspective of a product.

      --
      I am Slashdot. Are you Slashdot as well?
    4. Re:Obvious by 93+Escort+Wagon · · Score: 3, Interesting

      I am not sure that paragraph actually indicates that the author understands astroturfing - he seems to still be talking about the reader's state of mind.

      Also, I'd argue the author's understanding of statistics is flawed, since he apparently thinks a bell curve only has one side.

      --
      #DeleteChrome
    5. Re:Obvious by Kjella · · Score: 2

      Any product with tons of verified reviews means at least that the product has survived and sold enough to gather those reviews. That's an endorsement it's very difficult to fake.

      Exactly. Crap gets bad reviews, few sales and the product is discontinued. If a poorly rated product continues to sell it's probably low quality for a low price and the complaints basically boil down to expecting more than you'll reasonably get at that price point or it's a niche product rated poorly by the mainstream because they don't understand who's the target market. Basically it might not be a terrible product for you, if your requirements are low or you happen to fit the niche. A new product that's rated as crap is probably just crap for everyone, they usually start with cheerleader reviews by fans and friends if not outright fakes or paid endorsements so if the crap reviews have already trashed the rating it's a very bad sign. The more reviews, the more likely it's to be near the true rating.

      P.S. These guys should really do a study on IMDB movie scores... they might learn a thing or two about the real world.

      --
      Live today, because you never know what tomorrow brings
    6. Re:Obvious by k6mfw · · Score: 1

      Regarding 5 star reviews, I read an article about hotel reviews and it said ignore those hotels that call themselves a 5-star hotel because there are less than 200 of them in existence. You say reviews are comedy gold, reminds me of Yelp reviews of Blue Pheasant in Cupertino, CA. Some say there's a lot of 40 and 50 somethings acting like 20 somethings (which is not a bad thing when cooped up in a cubicle and battling traffic jams all week). Or some write "there's a lot of working girls" which just because some of the women wear too much makeup which actually they're just wearing a lot of makeup and simply want to have fun (actually I love women do that so I take it as a positive review).

      --
      mfwright@batnet.com
    7. Re:Obvious by Rakarra · · Score: 1

      P.S. These guys should really do a study on IMDB movie scores... they might learn a thing or two about the real world.

      Speaking of which, I've found them to be -generally- ok for mainstream, but only for one+ year old stuff. IMDB scores are wildly skewed when movies first come out do to the self-selection and fanboy bias. If the movie is "political" or controversial in any way (like Ghostbusters 2016) expect the score to be way off as well.

  4. More reviews mean more data points by Vermonter · · Score: 5, Informative

    If something has 1000 reviews, I know that the bulk of those are likely to be legitimate. If someone has 3 reviews, I have no idea how accurate the reviews are. More reviews = more sample data of user experience, and more data means that "wrong" reviews (reviews that don't reflect the user experience) are obscured. If you were presented with 2 studies where one used a sample of 5 people and the other used a sample of 5000 people, which results would you trust more? Reviews are just a less controlled study.

    1. Re:More reviews mean more data points by Gr8Apes · · Score: 1

      Ah yes, but this says that 2 items have a 1 or 2 star review, one with 1000 reviews, the other with 3. Which one is more likely to suck in this case?

      --
      The cesspool just got a check and balance.
    2. Re:More reviews mean more data points by Anonymous Coward · · Score: 1

      Because no company is corrupt enough to pay for 1,000+ sock puppet accounts to post positive reviews for their crap products.

    3. Re:More reviews mean more data points by tomhath · · Score: 1
      FTFA:

      “Around 20 [and running up to 50] is the optimal number of reviews for a product to have to give consumers the confidence that this product has been tried enough by enough people,” he told Moneyish.

      If there are 1000 reviews and the product is rated low, people will tend to avoid it. But if there are a handful of reviews it's reasonable to assume two things: 1) several people have tried the product, and 2) some had issues and left low reviews. People tend to complain in reviews far more often than they compliment, so a few negative reviews don't scare me. Especially if the complaints are from people who bought a lower priced product and then whined because it wasn't as good as a higher priced alternative.

    4. Re:More reviews mean more data points by g01d4 · · Score: 1

      sock puppet accounts [posting] positive reviews

      This. Review quality should be added as a weight. One, albeit crude, way to measure the quality of a review is its length. With more effort the quality includes product specificity. And finally there's specificity applied to features. For example, aesthetic based reviews might weigh less than those on functionality. A thousand this-product-is-great single line reviews might mean as much as ten negative reviews that go into a lot more detail.

    5. Re:More reviews mean more data points by geekmux · · Score: 1

      Because no company is corrupt enough...

      Holy shit thanks for the laugh. I needed that today.

      Oh and welcome to planet Earth. Someone will be along shorty to introduce you to this concept we call "Politics."

    6. Re:More reviews mean more data points by zippthorne · · Score: 1

      The article specifies a choice between two low-scoring products. If they both had an average score of 2 out of 5 then you can be pretty sure that the one with 1000 reviews is crap, but with other one might still be good.

      or it might be such utter crap that it isn't even worth 0 stars. You just can't know with such a small sample.

      --
      Can you be Even More Awesome?!
    7. Re:More reviews mean more data points by n329619 · · Score: 1

      Both sucks unless the reviews show otherwise.

      In the 1000 reviews item, it is known to suck with the 1000 reviews. For the 3 reviews item, if the complains are well thought out (like 'this part and this part didn't work and x part breaks if you do this'), then that item sucks too.

      However if the 3 reviews are of poor judgement (like 'I hate this company', 'it didn't work.', 'shipping too slow' ), then there's a 'chance' the 3 reviews item isn't that bad. Only then would there be a 'chance' for the item to be purchased.

  5. my logic: by buddyglass · · Score: 1

    I view products with few reviews to be a complete unknown in terms of quality. So if there are similar products with many reviews (and a decent rating) I'm going to prefer those, because (in theory) they're more of a known quantity.

  6. Everybody needs to read that story by Anonymous Coward · · Score: 1

    It's insightful and accurately reports work conducted by impartial scientists with deep expertise in the field.

    Five stars

  7. Worst restaurant on yelp! by Anonymous Coward · · Score: 4, Funny

    Yelp tried to extort them a few times, so this restaurant gives 50% off on pizza if you give them a 1-star review:

    https://www.yelp.com/biz/botto...

    http://www.bottobistro.com/REW...

    http://insidescoopsf.sfgate.co...

    http://time.com/money/3398188/...

  8. Re:As a producer, I thank /. reviewers here... apk by arth1 · · Score: 2, Informative

    [usual spam]
    APK

    That's a very good and pertinent example of what TFA is about, and why people skip good reviews. Either they are sockpuppets, or empty praise telling us nothing of value.
    It's the bad reviews that put meat on the bone. A review saying "it has problems with X, but here's my workaround" is worth a thousand reviews saying "It's the best thing since sliced bread!". Counter-intuitive as it may seem, constructive bad reviews facilitate more sales, and empty praise doesn't.

  9. Lies, Damn Lies and Statistics by Spazmania · · Score: 4, Insightful

    The three main kinds of mistruth.

    With more reviews, the buyer has a better idea -exactly- what's bad about the product thus has a better chance of making an educated decision about buying it.

    The article and study are examples of misusing statistics. The correlation between number of reviews and purchases niether tests nor demonstrates a causal relationship from the former to the latter, and even if it did it does not demonstrate the -claimed- causal relatinoship.

    --
    Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
    1. Re:Lies, Damn Lies and Statistics by war4peace · · Score: 5, Insightful

      Exactly. Furthermore there is a problem with the methodology:

      This bias was so strong that they often favored the more-reviewed phone case even when both of the options had low ratings, effectively choosing the product that was, in statistical terms, more likely to be low quality.

      That is incorrect.
      Say you have product A and product B, each with a score of 3 stars out of 5.
      Product A has 6 reviews, 3 of which are 1-star and the other 3 are 5-star - the average is obviously 3.
      Product A has 600 reviews, 3 of which are 1-star, 594 reviews are 3-star and the other 3 are 5-star - the average is obviously 3, again.

      Based on that information alone, you can NOT determine which product is more likely to be bad. You could however determine which product is more popular - but that's it.

      Furthermore, if both products have a low score, it is actually better to go for the more popular one simply because more people bought it therefore more troubleshooting, more info about how to overcome its shortcomings and more workarounds would be available online for that product. Shortly put, it would be more likely to find someone else who had a similar problem with the product and posted a solution online.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    2. Re:Lies, Damn Lies and Statistics by clovis · · Score: 5, Funny

      And I suppose it's my turn to be the guy that posts the related xkcd :
      https://www.xkcd.com/937/

    3. Re:Lies, Damn Lies and Statistics by ShanghaiBill · · Score: 4, Insightful

      Also, the fewer reviews, the more likely those reviews are FAKE. Most of the statistical claims made in TFA are based on the implicit assumption that all the reviews are equally valid. So the real problem here is not dumb customers but dumb researchers.

    4. Re:Lies, Damn Lies and Statistics by Anonymous Coward · · Score: 2, Insightful

      It's more important to see latest reviews. Often scumbag manufacturers will replace a good product with a cheaper shittier version and ride the popularity due to the early reviews to the bank. That's why well established products should be really scrutinized.

    5. Re:Lies, Damn Lies and Statistics by Anonymous Coward · · Score: 2, Informative

      Not to mention all the reviews that are complete garbage. I remember a few years ago and I saw a bunch of 1 star reviews for a product, curious I checked and almost all of them were not only complaints against the shipper, but they were all along the lines of "product works perfectly fine but shipping took too long due to that hurricane. 1 out of 5 stars." That's right, they dinged the product (which actually had many sellers) because of shipping delays due to Superstorm Sandy.

    6. Re:Lies, Damn Lies and Statistics by Actually,+I+do+RTFA · · Score: 2

      You're supposed to post the multiple related xkcds. This one, especially the alt-text is also pertinent.

      --
      Your ad here. Ask me how!
    7. Re:Lies, Damn Lies and Statistics by David_Hart · · Score: 3, Insightful

      Also, the fewer reviews, the more likely those reviews are FAKE. Most of the statistical claims made in TFA are based on the implicit assumption that all the reviews are equally valid. So the real problem here is not dumb customers but dumb researchers.

      I'm willing to bet that it also doesn't factor in version/software changes, the fact that many reviews includes multiple models, and for every detailed excellent review, there are many stupid reviews (they ordered the wrong thing in the first place, do not know how to use it, had a problem with customer service, etc. stuff unrelated to how the product works).

    8. Re:Lies, Damn Lies and Statistics by Carewolf · · Score: 2

      Knowing almost all places have a few fake good reviews from friends and family, the place with more reviews is more likely to be genuine.

    9. Re:Lies, Damn Lies and Statistics by Anubis+IV · · Score: 2

      Say you have product A and product B, each with a score of 3 stars out of 5.
      Product A has 6 reviews, 3 of which are 1-star and the other 3 are 5-star - the average is obviously 3.
      Product B has 600 reviews, 3 of which are 1-star, 594 reviews are 3-star and the other 3 are 5-star - the average is obviously 3, again.

      Based on that information alone, you can NOT determine which product is more likely to be bad.

      Sure you can, since both you and the researchers have—I believe, wrongly—assumed that good products are just as likely as bad products, which is fine in theory, but doesn't hold up in the real world any better than a physicist's example that starts with "consider a perfect sphere in a frictionless vacuum". In the real world, bad products outnumber good products by a wide margin, and we're well-served in relying on past experience to shape our future decisions.

      With 600 reviews establishing a 3-star rating, we can be fairly certain that what we're getting with Product B is a 3-star product. With 6 wildly varying reviews for Product A, however, we can't pull any useful information from the reviews. That said, we know from past experience that any given product is more likely to be bad than good. As such, given the dearth of information to the contrary, we'd be well-served in assuming that Product A is likely to be a bad product, suggesting then that Product B is the better choice.

      Further, consider that good products tend to attract numerous reviews as they succeed and that, statistically speaking, it's unlikely you'll be among the first 6 (i.e. the first 1%) to review a product that will eventually go on to attract 600 reviews. In contrast, bad products tend to fade into obscurity before ever attracting many reviews. As such, for any given product with just 6 reviews, it's more likely that it's a bad product on its way to obscurity than a good product on its way to 600 reviews. Again, this would point towards B being the better choice.

    10. Re:Lies, Damn Lies and Statistics by war4peace · · Score: 1

      By being "fairly certain", you ASSUME rather than DETERMINE.
      I said "You can't DETERMINE" - which you can't. You can, however, ASSUME (and still be wrong about it) that product A is just as likely to be bad, albeit with a much lower degree of confidence.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    11. Re:Lies, Damn Lies and Statistics by Anubis+IV · · Score: 1

      Determinations aren't separate from assumptions: they're based on assumptions. Moreover, depending on your assumptions, your determinations may be uncertain or wrong.

      But let's take a step back for a sec, since I want to get on the same page about something else you said. I think that the distinction you just tried to make is between choosing with certainty ("DETERMINE") and choosing despite uncertainty ("ASSUME"). You're saying you were talking about determining a sure thing, whereas I was talking about making an educated guess. Am I understanding you correctly?

      If so, then I think I see how things may have become confused for us. Back in your first post, I interpreted "you can NOT determine which product is more likely to be bad" (emphasis mine) as you claiming that it's impossible to make a probabilistic analysis regarding which is more likely to be the worse product. As such, I pointed out a correction to your assumptions that would allow us to take advantage of additional data (i.e. past experiences) in order to make exactly that sort of probabilistic determination.

      Does it provide us with certainty? Absolutely not, and if certainty is what you were talking about, then we're on the same page: you can't determine this stuff with certainty. But if we're talking about which is more likely, then I believe that we already have more than enough data to make those sorts of determinations.

      As for that "fairly certain" phrasing, it was intended as an implicit acknowledgement that I was indeed talking about a probabilistic analysis with error bars on either side, but from which we could draw some fairly accurate results, thanks to the large sampling size of reviews we had for Product B that afford us a reasonable degree of certainty. Again, not absolute certainty, but enough that we could make a determination regarding which is more likely to be the worse product.

      I readily acknowledge that I'm talking about a means to make an educated guess, so if you intended to talk in terms of absolutes, then what I said in no way addresses your point, and I apologize for the miscommunication. But if you intended to talk about probabilities, I believe that my suggestions provide a means to determine which is more likely to be the worse product.

    12. Re:Lies, Damn Lies and Statistics by war4peace · · Score: 1

      Understood. English isn't my native language and at times there are some communication inconsistencies, which I struggle to minimize but they do happen nevertheless.

      "you can NOT determine which product is more likely to be bad" needs to be rephrased, of course.
      What I wanted to say is "you can NOT determine which product is worse, based on reviews".
      Meaning "if you assume any of the products being worse than the other one solely based on that data, it would be akin to guessing".

      I hope that clarifies things and I apologize for the vagueness of my earlier statement.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    13. Re:Lies, Damn Lies and Statistics by Anubis+IV · · Score: 1

      No worries, and yup, I think we're on the same page. I agree that the reviews in your example, when taken by themselves, are insufficient for making any sort of reasonable determination one way or the other, so any choice would amount to making an uneducated guess. Which isn't to say that we can't make educated guesses, but to do so we would need to incorporate additional information, which goes beyond the scope of what you were trying to address in your original post.

      Also, let me just say: your English is incredible. I wish I could work in other languages as well as you write English. Despite having studied three foreign languages (Spanish, Latin, and Japanese) over the course of my schooling, I sadly didn't make a point of keeping up with any of those skills. Now that it's been 10 years since I was last in a language course, I've essentially lost any ability to converse outside of English, which is a shame.

    14. Re:Lies, Damn Lies and Statistics by war4peace · · Score: 1

      Thank you :)
      I've been told that a lot in the past, and with foreign languages the secret is to remain immersed at all times. Watch movies in that language, talk to people in that language, etc. Best would be to live in a foreign country for a while, you'll learn that language in no time.

      As for me, working for an USA-based company (they have a large development center in my puny East-European country), it's easy. Most good movies, music and online communities being all in English helps tremendously as well.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    15. Re:Lies, Damn Lies and Statistics by Spazmania · · Score: 1

      The researchers claim that "the devil you know" is a logical fallacy. It isn't.

      --
      Moderating "-1, Disagree" is simple censorship. Have the guts to post your opinion.
  10. Actually read some of them by sir+8ed · · Score: 1

    I find that some of the bad reviews are actually people complaining of stupid stuff like "hard to set up/install/etc.". Worth reading the reviews.

    1. Re:Actually read some of them by TheRaven64 · · Score: 1

      Sometimes those are worth listening to. I read a few reviews of a wireless access point that said it was difficult to configure. I assumed that the reviewers were idiots. I have a PhD in computer science, so I was pretty sure I could figure it out. It turns out that the manufacturers had decided that technical terms were confusing and so they'd make up their own terms for every single thing in the configuration interface. It took hours of a combination of trial and error, poking the thing remotely with diagnostic tools, and reading forum posts by other people who had figured out what some of them meant, to work out how to translate from their nonsense wibble into standard networking terminology.

      --
      I am TheRaven on Soylent News
  11. I check reviews for... by Anonymous Coward · · Score: 2, Insightful

    ...suggestions for competitors products. I then make my own determination after checking them out.

    1. Re:I check reviews for... by TheRaven64 · · Score: 4, Insightful

      Mod this up. Most reviews are useless when comparison shopping because the people writing them have a sample size of one. I recently bought a new electric shaver. Most of the reviews are from people who have owned maybe one other shaver in their life. For a product with 600 reviews, 500 of them are left within a few hours of the new one arriving, so all that you really know from them is that it came in a box and didn't break in the first use. The only useful reviews were the ones where someone actually compared it to others that are still available.

      --
      I am TheRaven on Soylent News
    2. Re:I check reviews for... by Applehu+Akbar · · Score: 1

      Amazon wants you to review a product as soon as you open the box. There is. Ever any follow up to elicit a review after you have used the product for a while. The people who do review after experience are the ones who had trouble with the product.

  12. Nothing New by boudie2 · · Score: 5, Interesting

    At one point in the 1970s it was my misfortune to be employed as a Filter Queen vacuum cleaner salesman (regrets, I've had a few). Anyways at the time I was taught that some people "have to be told to buy" something, even if it's from a perfect stranger. They can't make the decision on their own as most people are told what to do their whole lives. That and "Advertising is the best way to sell something, especially if it's no fucking good".

    1. Re:Nothing New by micahraleigh · · Score: 1

      That is so disturbing and so believable. People despise their freedom so much.

  13. Not all bad reviews are "bad" by petes_PoV · · Score: 2
    Many times I have seen 1 or 2 star reviews that complain about other aspects of the order. Packages arriving late, damage, being cancelled.

    These might not be the proper place to complain about non-product issues, but they happen and they drag down the overall rating of the product, itself. Who knows, maybe some bad reviews are hoping for an offer from the maker to improve their ratings.

    However, I do pay more attention to the bad reviews and the reasons given. If there is a pattern of failures, then I'll avoid a product. And I pay them more attention than I do to the good reviews, which even now often appear to be fake, exaggerated, written by idiots ("I've just received such'n'such, it looks wonderful though I haven't tried to use it yet - here's 5 *'s") or clearly from professional reviewers.

    --
    politicians are like babies' nappies: they should both be changed regularly and for the same reasons
    1. Re:Not all bad reviews are "bad" by petes_PoV · · Score: 1

      Why would you rate a POS 5 stars?

      But so many people do.

      My neighbour bought a new car last year. It has been back to the garage 3 times now. Each time, he tells me how fantastic their service is - they give him a replacement vehicle (smaller) for the days or week that his car is in dock.

      I have pointed out the obvious, but he won't hear a bad word. I guess he just likes obsequious, fawning, servers more than he likes his new car.

      --
      politicians are like babies' nappies: they should both be changed regularly and for the same reasons
  14. Few reviews could be a fake by Ambassador+Kosh · · Score: 1

    Just based on experience products with very few reviews are sometimes fakes. The more reviews something has the less likely it is to be a fake product. At least with many reviews over time you see also see if the manufacturer has been fixing the problems and also what kinds of problems people have and can decide if those problems will matter to you.

    --
    Computer modeling for biotech drug manufacturing is HARD! :)
  15. Also could be worse by avandesande · · Score: 1

    There is a chance it could be worse too. I've bought things that were useless junk that a few people made relatively good reviews. When I buy stuff from harbor freight I know exactly what I am getting, a throwaway tool that I might use a couple times. People don't always want the best...

    --
    love is just extroverted narcissism
  16. 1* reviews serve several purposes by The+Davii · · Score: 2

    1) I read the bad reviews first to see how many of the bad reviews are idiots. For example, I purchased a product that adapted VGA to video. There was a switch on the side of the box for NTSC/PAL. A number of N. American consumers indicated the box didn't work and that the picture was monochrome (black & white). Well, those folks obviously didn't flip the switch from PAL (as shipped) to NTSC because monochrome is a symptom of video format mismatch (simplying a bit to illustrate the point). So, I discount the 1* reviews with that reasoning that tells me they used the product incorrectly. 2) I look for the proportion of 5* and 1* reviews. If they're about equal, that's a danger sign. If they trail off in a nice log power type curve, so much the better. Those who mention IMDB being seeded with a lot of 10% reviews, beware because the studios know how much word of mouth matters today so they plant reviews that make Baywatch sound like The Godfather. Any "reviewer" who only gives 1 or 10* reviews is suspect in my book. 3) I look for reviews that closely match my use case. 4) I look for reviews that are clearly fake. 5) Any review that is 1* due to price I completely ignore (prices fluctuate and my price point may be very different than yours. Review the actual product, not the price. *I* decide whether the price is worth it. Unfortunately, Google Play's app store doesn't allow one to look at the negative reviews only. Very annoying. Maybe Google should look at this research and understand that low * reviews serve a purpose.

    1. Re:1* reviews serve several purposes by murdocj · · Score: 1

      I do exactly the same (although not as systematically). For example, when I buy games from Steam, if the negative reviews are centered around "too much DLC" I pretty much discount that, because I play games pretty slowly, so I don't care that I'm not getting "the full game" in one shot. If on the other hand the negatives complain about stuff I care about, I know to pass, even if the positive reviews are gushing about how wonderful the game is.

  17. Faulty Analysis by Anonymous Coward · · Score: 1

    First of all if two items have the same overall score there's no obvious way to break the tie. To assert that "statistically" people ought to buy the one with fewer reviews, because it might be better than rated, ignores the fact that it might just as easily be WORSE than rated. If I had no choice and all other things were truly equal, I'd probably choose the item with more reviews. There's less chance it is an outstanding product, but also less chance that it'll end up being a total waste of money.

  18. Newsflash: People are idiots by easyTree · · Score: 1

    News at eleven

  19. Re:100's of /.ers find value in hosts files #2/2 by arth1 · · Score: 1, Informative

    P.S.=> EAT YER WORDS arth1

    Whoosh!

    The point was that pointless praise does not work - it's the bad reviews that work, and constructive bad reviews help sell a product. Mindless praise is worthless - people don't look at that. This is a prime example - you're making my (and TFA's) point by posting this!

    You apparently think that repeating praise from others is going to sway people. It isn't. They'll look at bad reviews and what those say, and whether the product is still good, knowing the worst.
    Anyone who attempts to drown bad reviews in praise and counter-attacks against individuals come across as feeling they have an inferior product, else they wouldn't feel a need to do that. You are a prime example here. The lady doth protest too much.

  20. this test seems somewhat odd by murdocj · · Score: 1

    Why are people buying a product with crummy reviews anyway? Sounds like they don't have any choice, so perhaps they are deciding they'd rather get something that works poorly, than something that might not work at all.

  21. Reviews are ads by RhettLivingston · · Score: 1

    It would be nice if an extension could be created to work on eliminating them to provide protection from the subconscious impact. But, they are very thoroughly embedded - especially all of the little star ratings scattered about.

  22. Having many reviews may mean an old product by clovis · · Score: 1

    I tend to not buy the item with the most reviews, but it's not directly due to the number of reviews, not in the sense of a causal relationship. It's because I check tend to be buying the newer product, and the product with the most reviews is usually the older product.

    But it depends on the product. If we are talking about restaurants, a place with many reviews can be because it's a successful restaurant.
    I mostly tend to go with professional reviewers that have a column in the newspaper.
    Yelp restaurant reviews seem to be either revenge because the waitress would not sit in someone's lap, or glowing praise from someone who had the waitress sit in their lap. Or reviews like "I don't like fish, but I ordered it anyway. It tasted like fish to me, so I give it one star."

    For hotel reviews only the negative 1-2 rating matter. They often will have some very significant information about the upkeep and condition of the carpet, cleaning, etc. The exception is when the recent good reviews mention a recent remodeling.

    The worst are reviews of doctors. They are almost all comically deranged. Maybe that's because they're written by sick people.

  23. Not just reviews by reboot246 · · Score: 2

    I use any resources I can find before I buy something that costs more than $50. Read reviews of the product on several different retailers' sites. See if any of them are written exactly the same. I've seen the exact same review on three different sites for the same product. I hope the guy got paid for writing them.

    If there's a link to a pdf of the manual, it's good to read the manual. A manual gives you some idea about how hard or easy the product is to install, put together, and use. It gives you a much more detailed description than you can find on a retailer's website. Check out the "troubleshooting" part to see what kind of problems you can expect and how easy they are to fix.

    If the retail site doesn't link to the manual, go to the manufacturer's site to find one. There's usually one there.

    If all I'm buying is lentils from Amazon, I just go by name brand and reputation. Reviews don't even come into play for a lot of items.

  24. Re: Duh by dougdonovan · · Score: 1

    when they start pointing and clicking, they "think" it makes them intelligent. i am so glad there is not a test you have to pass before you can purchase an electronic device ie: a computer to put in your home, let alone get on the Internet. we would all be out of a job and the ceo's of oem's would say wtf.

  25. I generally only post reviews if I'm unhappy by aklinux · · Score: 1

    Unless I really like the product. I don't generally take the time to do a good review. If I'm only satisfied with the product, I don't bother with a review. I have other things to do.

    Most of the time, if I take the time to post a review, it's because I'm not particularly happy with my purchase.

  26. I read it by n329619 · · Score: 1

    we should actually go for the product with few reviews, since there’s more of a chance it’s not really so bad...

    Instructions unclear. Made me buy low quality dildo instead. Would not read again.

    1 star

  27. The shorter the review... by ayesnymous · · Score: 1

    Most fake reviews seem to be just 1-2 liners.

  28. another point , support by aepervius · · Score: 1

    If i HAVE to buy a product and the choice is two 1 star product, i will buy the one which has the more buyer because there is a better chance the company does not go under leaving me with no support. If you cannot get quality, then go for the mass.

    --
    C. Sagan : A demon haunted world:
    http://www.amazon.com/gp/product/0345409469/
    visit randi.org
  29. Also, people are idiots. by sootman · · Score: 1

    I was looking at a book on Amazon. One reviewer gave it one star. Their review: "Cover was torn."

    --
    Dear Slashdot: next time you want to mess with the site, add a rich-text editor for comments.