Amazon Overhauling Customer Reviews
An anonymous reader writes: Amazon says it's making some big changes to its product review system, one of the most heavily used on the internet and a vital part of Amazon's business. A machine-learning platform will endeavor to select helpful reviews with an emphasis on more recent ones. The average score will change as well: new reviews will be weighted higher than old reviews. Reviews from verified purchasers will have more influence as well, and also reviews voted up by other customers. "For example, sometimes a company will make small tweaks to a product or address some customer complaints, though this product isn't officially updated or renamed. With the new system, [Amazon] said, these small modifications should become more noticeable when shoppers are buying products." Because the review system is so important to customers, Amazon will be rolling out changes slowly, and watching for anything that breaks or gets skewed in unexpected ways.
I could be missing something, but frankly everything I read in the summery seems like reasonable changes to me.
Someone who actually is known to have purchased the item, yea, their review should be worth more than random Internet person #4827341
A review from last month is probably worth more than one from two years ago. The product may have changed.
I'm happy to see improvements in the review system. I rarely buy anything from Amazon (shipping takes time, returns are a hassle), but I often use their pages to check reviews and compare items before I buy them.
Trust the Computer. The Computer is your friend.
The other problem is that they'll group different models on the same page. So the reviews you see are for all the models together. In many cases Version B is way better than Version A. But, you still see the bad reviews without realizing it's unrelated to what you're going to buy. They also need to address the paid bad reviewers. I looked up stuff just last week and the same one star review, word for word, was listed on three different items. And these were three totally unrelated items. One in electronics, one in cookware, and the third in camping equipment.
Care killed the cat, but satisfaction brought it back.
Good, useful reviews don't appear every day. If a review is 2 years old and hundreds of people have said that it's useful, that's probably because it IS useful.
This change seems designed to turn the review section into a discussion forum where you have to reload every few minutes to participate in the latest discussion. I suppose this is good for Amazon's advertising revenue, but it's bad for customers who want to know what to buy or not to buy.
I'd be interested to know if the data-crunchers at Amazon have looked at the Amazon Vine reviews, as a group, to see if they are slanted positive.
Amazon Vine is the program where a certain select demographic of Amazon customers receive free stuff (including items such as 60" TVs, laptops, etc.), with the understanding that they will objectively review the product and post the review on Amazon. My experience is that almost every Amazon Vine review is 4-5 stars. I'd also be curious to see if Amazon looks at the spread of reviews from Vine reviewers -- by that I mean, "Do reviewers in the Vine program rate free Vine products higher than other products they've bought?"
The implication being that Vine reviews (many of them) probably feel that a good review of a product that Amazon wants to sell is "quid pro quo". I strongly suspect that Amazon wants exactly the opposite of quid pro quo; they want early Vine reviews to weed out marginal or bad products.
Well, yes and no... http://www.amazon.com/gp/custo... ... This person's one star review was posted three years ago and has garnered 76 responses. The most current was 20 days ago. It's amazing seeing the "You're right" - "No, you're wrong" conversation. Even when the company, right from the beginning, stated, "This is how your testing methods are faulty...", people are still saying this one star review has convinced them not to buy the product. [BTW: 88% of 4,121 people gave this product a 4-5 star review. ] So, while this review has survived the test of time, the only usefulness it has achieved is to show how bad testing methods are readily accepted if it's buried in enough data.
Care killed the cat, but satisfaction brought it back.
Great! This sounds like it might have a chance of stopping people like @freebsdgirl and her gang of thugs from harassing authors on amazon by writing shit reviews with shit scores for disagreements she had with them on twitter and facebook, while writing in the reviews that they've never even fucking read the book they're leaving a shitty review on. (see: http://www.stopthegrbullies.com/2015/06/02/randi-harper-fights-amazons-removal-of-her-bully-review/ )
I could be missing something, but frankly everything I read in the summery seems like reasonable changes to me
Amazon's review section is notoriously filled with fake reviews - in fact, Shanghai-Bill himself has admitted that his 15-year old daughter is getting jobs from fivers writing fake reviews on Amazon and is making $20/hr
And I can bet you my bottom dollar that Shanghai Bill's 15-yr old daughter is definitely *NOT* the only one making $$ writing fake Amazon reviews
Now that Amazon wants to tilt the whole system into something even worse --- and their decision on putting more weight on 'newer reviews' only mean that there will be even more brand new fake reviews appearing, along with vote stuffings by ghost visitors for those fake reviews
The reviews are (mostly) fine the way they are.
What really needs an overhaul is Amazon lumping together the Theatrical release and Director's cut of Blu-Rays. The first edition picture quality (PQ) of Gladiator was total garbage. Enough people complained that they got the studio to re-release it with proper picture quality. Lumping together LotR (Lord of the Rings) Theatrical and Director's Cut makes it hard to tell what is where.
"Reviews from verified purchasers will have more influence " Amazon's not the only store on the internet. Sometimes I can find a product cheaper at a different store than Amazon, so I buy it from the other store. But I'll still post a review on Amazon since I want my review to reach the largest audience.
"I have to give this book one star because I ordered it and it never arrived on time even though Amazon said it left the facility six days before it was supposed to get here!"
"This book is typical LIBTARD crap and if you buy it you're a stupid egghead."
"I haven't read a book in five years so when this book came out I decided to buy it. This isn't the book I thought I was ordering, this is crap written by a different guy with a similar name! Buyer beware!"
Is it really that hard to get a computer to pick these out?
Are you aware that such an action violates their Terms of Service?
A valid citation of the above allegation would be very much appreciated!
Boss: What the hell? Slashdot's revenue dropped again? What happened?
Middle management #1: That is strange, our beta design was supposed to increase traffic.
Middle management #2: Yeah strange right? We spent weeks making sure the beta was difficult to use as hell, then we shove it down the user's throat, how could our traffic tank after that? HOW?
Middle management #3: It can't be our fault, my 3 years old son was playing with beta before the launch and he absolutely loved it, he just learnt how to use a mouse and he was clicking around rapidly, he was so excited by the design he even clicked on the ads, if everyone did that our views and revenue should have tripled by now.
Boss: Well we got to do something, any ideas?
Middle management #1: Hmmm... well I heard there is something call 'social media', I haven't looked at it yet but it looks like people love sharing things on it, maybe we can use that?
Middle management #2: Yeah I heard about that too, my daughter said she uses it to share elmo photos.
Middle management #3: Oh I got an idea! Let's put a bunch of social media share link on the site!
Middle management #1: Sounds good to me, but if everyone is already doing it we need to do something a little different.
Middle management #2: How about... Oh I know, let's remove the most useful and popular 'read more' link, and replace it with a bunch of share links. I swear the users are so fucking stupid they won't be able to tell the difference.
Middle management #3: Yeah! Those geeks, they don't know much about computers, they are just going to click on the same place over and over again, and come back for more!
Boss: Geek site for retards? That is fucking brilliant! Let's do it!
One for the actual object (DVD Blu-ray or Book) describing the quality of what you receive. Plus a separate review for the content. For example: how do you rate a poor transfer to Blu-ray of a terrific film you love. The disc, packaging, commentaries could be poor and deserve two stars for some reason. But what if the film itself deserves five stars?
On amazon, i'm searching specifically for the bad comments. In those bad comments, I'm searching for trends... If everyone says that an item breaks after 4-5 uses, maybe it does to 20% of the reviewers that voted the item as one star. Of course I filter out results where only one person complains about something and "stupid" reviews, etc. This allows me to compare similar products efficiently, find the best one ,and look for common defects, etc.
If amazon emphasizes it's higher ratings, it's only going to cause me to concentrate even more on the negative reviews. Sure the 4 and 5 star reviews have their place, and help me find what I want - but if there are two or three of basically the same thing, and all with overall good reviews - from different manufacturers - the negative reviews are more helpful as they help me filter the items and find faults, and find the best item.
With this new emphasis, I can't trust Amazon's overall rating anymore and will have to look even deeper than I do now. [sarcasm]Thanks a lot, Amazon![/sarcasm]
Yeah, right. Amazon is adjusting the average score from the average score to some propietary algorithm. Yeah, there are talks about tweaks and the marketing makes it sound totally reasonable.
Amazon sells products. Amazon likes to sell products. Products with higher rating sell better. Products with poor rating sell worse. Amazon would like to sell more products.
I can bet $1000 right now that the "average rating" is going to go up.
Pick almost any item, movie, game, consumer electronic device and look for the highest rated "reviews". They are invariable nothing more than paraphrased product release texts. The "reviewer" does not have the item, has not used the item and probably has never seen it in the flesh.
There is a large number of people that must create reviews for items all day every day. I find it remarkable Amazon allow these people to post these disguised adverts or non-reviews. Surely they know when someone is taking the piss by posting 50 reviews per day.
As Dice transforms /. into yet another random site (video section, meaningless pictures attached to articles, and now social media buttons), it become clear that I am no longer part of their target audience. I hate those crappy social media share buttons - they're nothing but trackers in another form.
Hello Soylent
Enjoy life! This is not a dress rehearsal.
I wish they would find a way to separate reviews of different formats. It gets annoying trying to determine which edition of a classic movie is being reviewed on Amazon. They lump VHS, DVD, & Bluray along with all editions together. It can be interesting reading someone's opinion on classic movies, but I'm more interested in format/edition information about Citizen Kane than what someone thinks about it. Some movies have had multiple Bluray releases, and some are considerably better than others. The newest is not always the best.
This can also be the case with older music. There was a studio back in the late 1960's/early 1970's that did not have the recording speed of their equipment calibrated properly. It actually recorded at a slower rate than it should have. Some remastered versions took this into account, but several newer ones did not. This is a case where edition specific reviews are very important to me.
Two, as you indicated, plus a third for the people who received something that was broken in transit or poorly packed but are too fucking lazy (or stupid) to rate the seller.
Is it just my observation, or are there way too many stupid people in the world?
The first thing they should do is forbid reviews for not-yet-released products.
Especially in the "entertainment" section you find five-star-reviews for non-released movies and videogames along the lines of "This will be so awesome!!!!"
I just wish that there was some indication of the number of people that bought it, so it could factor those as at least something like satisfied buyers. Everyone knows that the majority of people that take the time to review something are usually people with issues. So if you saw 10 bad reviews and 2 good reviews, it may not necessarily mean that the product is bad if 1000 people bought it and didn't have any complaints.
The reviews are (mostly) fine the way they are.
Could not disagree more. The signal to noise ratio on most reviews is seriously poor. I regularly see paid shills (some obvious others less so), idiots who order the wrong item but still feel the need to "review" what they got, people who conflate UPS delivery with Amazon's service, reviews for different products or obsolete models of earlier products unrelated to the one being sold, useless reviews with no details explaining why the product is good or bad, reviews that are years old and no longer relevant, etc. There is an awful lot of BS to filter through. Any online review needs to be read with a skeptical eye but Amazon definitely could do more to make the reviews more helpful and relevant.
Can you get useful information from Amazon reviews? Sure. They definitely can be useful. But to claim they don't need improvement is just absurdly and demonstrably false.
Too many times you buy something that has raving reviews and you get a product which is extremely bad.
This is especially true for cables, supplies and Chinese products.
If a product has many 5 star reviews but also many 1 star reviews it is mostly because there are at least two different products shipped, I want to order that 5 star product, but how do I find out who of the sellers on Amazon is shipping that one, ratings about the sellers themselves do not say anything about the product they are shipping.
It is not truly Bait and Switch as the original good supplier is probably still shipping the good product but others find out and sell a comparable, sometimes even with a higher price. Today I just order with multiple suppliers and return what is bad, although Amazon already send me a mail about my high rate of returns, I explained them and I did not hear anything back from them.
Many times I can't comment on a product, because the seller has blocked certain "keywords" from appearing in the comments.
They do this when their product gets poor reviews or maybe they're trying to hide something from the buyer (like the country's origin is China or something), so they try to block these words to avoid criticism of their product. These are legitimate words not against any rules, but Amazon will let the seller get away with it. It's pathetic.
Just ban the worthless reviewers. Start with a purge of their reviews and a 6 month ban. Put a "how to do reviews"/"what is a bad review" section and fast test they have to pass before doing a review again.
Have your engine search your reviews for all reviews that came out before the product could be purchased, then implement a strike/ban system.
You can love a movie you just saw in the theater, there are places online you can rave about how much you loved X-Men 12: X-men vs The Retcon!,a Blu Ray review on Amazon is not the place to do it. If certain people are in the habit of putting up fan pages instead of reviews, ban them.
Reporting for "put in review but has no experience with product" gets a fast list of reviewers to check and ban. Say if 6 are reported then they get reviewed and marked yes/no.
So far the only thing I have seen from this is putting a 5 star review with a more than 1 star review at the top of the 1 star page. These 2 reviews are called something like Most Helpful Review and Most Helpful Critical Review. Thanks A-holes, I know what I want when I got to 1 stars and that is not reviews with more than 1 star!
The fix is easy. The lack of a fix shows that Amazon values the problem.
I hope this doesn't result in the removal of parody reviews. Manually take them out of the weighting algorithm, sure, but please leave them, for the likes of Monster cables, Denon's ethernet cable, uranium oxide samples, reviews which pop up when a price gets bumped up by 33,300% due to occasional glitches in Amazon's dynamic pricing algorithm, and so forth.
Also, PLEASE kill the reviews which rate items a 1 because UPS destroyed the package. That isn't Amazon's fault; it's UPS's fault for shoving 65,000 packages per hour through a conveyor system designed to handle 27,000 packages per hour, resulting in UPS sorters/pickoffs "accidentally" pushing packages (usually the higher ticket items) off of 25' high conveyors onto the ground below out of anger and frustration. Yes, this does happen, and it's not Amazon's fault; it's UPSes for not running longer shifts, poor planning, and putting unrealistic demands on UPS hub workers. The reviews which are based on UPS's malfeasance should not apply to the rating of the product, because the reviews are supposed to be about the product, not the shipper. Same goes for when UPS sorters mis-pick an item sending it to the wrong part of the country, making the product late. That isn't Amazon's fault either.
The Christian Right is Neither (Christian nor right). See: Matthew 23, Matthew 25, Ezekiel 16:48-50
Different models are definitely a problem, what's worse though are completely different products. Like this UTech Mouse --- also lists 3 other mice, and two keyboards. The reviews and "product ratings" are *shared* by 5 different products.
reviews and upvotes paid for by the author removed.
They should also ban all the "top reviewers" that sell their votes.
How to fix the rating system? They have one UPC per posted item. One Review string per UPC. That would fix a lot of issues people have. Read the xbox 360 thread. Holy shit what a mess. I mean when there are 10 or more different xbox versions, and quarterly they come out with a new "bundle" which refreshes the hardware, that is a totally different item.
If the user hasn't purchased the item in question, how exactly are you assuming he/she knows the product sufficiently that they're in a suitable position to review it, judging it's strengths and weaknesses?
Someone can know a product even if it was purchased through a channel other than Amazon, or received as a gift, or borrowed from a friend, or (in the case of books) borrowed from a public library or on Kindle Unlimited.
You're telling me that, for example, a Playstation 4 owner is in a better position to review an Xbox one, and we should trust their judgment as being more objective and fair than someone who actually purchased an Xbox one?
A PlayStation 4 owner tries a Wii U at a store or friend's house, discovers that the graphics on its games are roughly as detailed as those of PlayStation 3 games, and thus is justified in composing a review on Amazon without buying a Wii U on Amazon.
Good thing ToS are not enforceable.
In what country? The United States, home of SlashdotMedia, has the Computer Fraud and Abuse Act. Internet activist Aaron Swartz ended up committing suicide over threats to prosecute him for CFAA violation for having spidered JSTOR.
How much of a "review" can you make with a seven-second video shot on a smartphone anyway?
Let's say a reviewer for whatever reason wants to compare the item they are reviewing with some other product. When a search is done for THAT OTHER PRODUCT, the first product comes up in the Amazon search results, because, well, I don't know why - they thought (think?) they are being helpful, BUT THEY AREN'T.
Who cares what someone writes in a product review when it comes to product search?
Example: Let's say I am searching for a very specific model or replacement part. I have the manufacturer part number and someone at some time has reviewed SOME OTHER THING and merely mentioned a comparison to the item I am looking for... Now that WRONG part is going to come up in my search result. Do you know how tedious it is to chase down false search results? I friggin' hate that.
With bad reviews, and then recreate them as clean products without any reviews. I've had this happen to a couple products I wrote bad reviews for. Polar in particular released the RC3 a couple years ago, and there were a ton of bad reviews about broken chest straps, broken buttons, GPS's that wouldn't lock up, etc.. Good luck finding any of those reviews, they changed the SKU (or something) a couple years back and all the old bad reviews (which were close to a 1 start rating) are no longer applied to the product. My review is still in my profile, but it links to a product which is "no longer available" even though you can find the RC3 still for sale on amazon.
Strangely enough 3 months ago I wrote to Jeff Bezos and said how the review process has several problems and a month later I hear from Slashdot that Amazon are suing some "false review for pay" sites.
Now this 2 months later on.
Not saying I am responsible, but it must have been getting obvious to Bezos and the whole Amazon management sycophancy that something needs to be done.
One thing not covered here is still the main reason I wrote to Mr Bezos, esquire.
The misleading way they amalgamate reviews on different versions of a product, so that umpteen 5 star reviews that mislead you into buying a 24 inch TV Monitor, for example, in a lightening sale, turn out to have been for a 32 inch TV by the same manufacturer.
Yes, same manufacturer or merchant selling the 32 inch TV (only), but not made on the same line or possibly even the same factory as the 24 inch tv monitor.
That has no reviews from owners of that 24 inch tv monitor, to say if it is a lemon or not.
That problem still needs to be addressed.
After all, if the "verified buyer" button can identify I bought a particular subset of a product, and have just reviewed it, why on earth do the Amazon programmers lump it in with reviews of other variations or even completely wrong products (as I have reported to them before).
Over to you Jeff, kick some programmer butt...