Slashdot Mirror


Gaming Netflix Ratings?

Nom du Keyboard writes "Not for the first time, I've noticed a new film that hasn't yet even reached the theaters, yet has hundreds of positive votes and/or reviews recorded on Netflix. This time the movie is Inkheart. For a movie that doesn't even hit the theaters until January 23, it already has 428 votes and a rating of 4.3 (out of 5) on Netflix. Seems more than a bit fraudulent to me. Also, it has a review that doesn't even review the movie, but instead says the books are great, therefore the movie should be too. Does the word 'shills' come to mind? With millions spent to promote a movie, are a few hundred of that going to phony voters? Or have that many people actually seen the film and just can't wait to rush home and log onto Netflix to vote? Just what is Netflix's responsibility here to provide honest ratings?"

37 of 235 comments (clear)

  1. Not to disagree with your conspiracy... by Anonymous Coward · · Score: 5, Interesting

    But it isn't rare for there to be advanced screenings of a movie a week or two in advance of the public release date.

    I wonder if we'll ever see movie cinemas with terminals or similar at them that let you rate a movie as you walk out after seeing it.

    1. Re:Not to disagree with your conspiracy... by Guido+del+Confuso · · Score: 4, Informative

      Not only this, but often times the makers of a film will show it to people before it is even finished. This could be anything from friends and business associates of the filmmakers (such screenings can number into the hundreds of people) to recruited audience test screenings (also often several hundred people). These people see the movie long before it comes out, and most likely not in its final form. Also, after a movie is completed it is sometimes sent around for audience reaction before it is picked up distribution. Of course, if the film plays at a film festival, that's hundreds or thousands of people watching it before it is released in theaters. So a few hundred people rating a movie before it's officially "out" isn't that strange.

      And remember, a significant portion of the people who do watch the movie before it comes out are friends and family of the crew, who aren't exactly impartial. That may explain why the ratings skew high.

    2. Re:Not to disagree with your conspiracy... by LatencyKills · · Score: 5, Interesting

      Back in college I somehow ended up screening a number of films before release (I think the process was something like a guy on campus asking if I'd like free tickets to a new movie). Before the movie there would be a quick spiel about the film not yet being released and that our feedback was very important, then they'd show the film, then they'd hand out a sheet of questions for us to answer. I recall that I saw Fletch 2 that way, and that the ending I saw in the screening was very different from the one I saw later in the theater. I also remember seeing a Judge Reinhold movie to wretched that everyone trashed it on the sheets, and I don't think it even came out in the theaters. It might have been released direct to video.

      --
      Jealously hoarding mod points since 2007.
    3. Re:Not to disagree with your conspiracy... by ClubStew · · Score: 4, Insightful

      Not only this, but consider the various fanboys. Some people may like Brendon Frasier enough that they think any movie with him is great, so they vote. People - like the OP mentioned - might like the book so much, they vote the movie positive without having seen it. It's idiotic, but so are people often times.

    4. Re:Not to disagree with your conspiracy... by joocemann · · Score: 3, Informative

      But it isn't rare for there to be advanced screenings of a movie a week or two in advance of the public release date.

      I wonder if we'll ever see movie cinemas with terminals or similar at them that let you rate a movie as you walk out after seeing it.

      I went to google.com

      Typed in "inkheart screener"

      The very first choice at the top is a bit-torrent search engine.

      The page lists a number of different torrents of this movie already being available from screeners and cam rips, etc.
      --------------

      I think it is safe to say that thousands of people have already seen it by now.

  2. Not released? by Seriph · · Score: 5, Informative

    Maybe not released yet in the US, but there is a world beyond the US borders and the film has been released places there. It's actually quite a good film based on an interesting idea.

    1. Re:Not released? by aitikin · · Score: 5, Informative

      Seriph brings up a perfect point. IMDB seems to back that information up fairly well.

      --
      "Don't meddle in the affairs of a patent dragon, for thou art tasty and good with ketchup." ~ohcrapitssteve
    2. Re:Not released? by retyurecvb · · Score: 5, Informative

      Doesn't Netflix only service the U.S. though?

    3. Re:Not released? by Monsieur_F · · Score: 5, Informative

      From imdb
      Release dates for Inkheart (2008)
      Country : Date
      Germany : 11 December 2008
      UK : 12 December 2008
      Brazil : 25 December 2008
      Iceland : 26 December 2008

      --
      McCartney fans pay bus tickets. [...] Lennon fans too, with discretion.
    4. Re:Not released? by diskis · · Score: 5, Insightful

      Piratebay services also the U.S.

      If the movie is out somewhere, there is a torrent of it.

    5. Re:Not released? by Bodrius · · Score: 4, Interesting

      Should that make a significant difference?

      Netflix does not own movie theaters either. Yet that doesn't stop people from watching movies there and reviewing DVD movies (often before the DVD release) based on the theater experience.

      Between advance screenings, festivals, and people who may have watched it in other countries at some point... a few hundred viewers doesn't sound that implausible.

      If anything, the over-eager fan phenomenon (the "books are great, movie is going to rock" review the poster mentions) is the most likely distortion. But that's hardly surprising or suspicious - popular book-sequels tend to demonstrate something like this in Amazon weeks/months before it was released (sometimes positive hype, sometimes negative).

      Why would it be different in Netflix? Most likely it is just less obvious in their user interface.

      --
      Freedom is the freedom to say 2+2=4, everything else follows...
    6. Re:Not released? by Atario · · Score: 4, Interesting

      Who are these foreigners who are so altruistic as to log in to Netflix -- thus far, a US-only service -- to rate a movie and write a review of it wholly for the benefit of people subscribed to a service the reviewers themselves cannot benefit from?

      Come to that, can you even enter a rating and/or review without being a subscriber?

      --
      "A great democracy must be progressive or it will soon cease to be a great democracy." --Theodore Roosevelt
    7. Re:Not released? by TheKidWho · · Score: 4, Informative

      Probablly those domestic people who might have taken a trip abroad or gone on an adventure to this place called the pirate bay.

      YARRR

    8. Re:Not released? by SpinningCone · · Score: 3, Informative

      In the case of inkheart yes this was already released and could potentially get legit reviews. however Terminator: Salvation has not been released and with a target date of May/June i would be surprised if there was even a screener available. yet despite this there are plenty of positive votes.

  3. I've seen it by Colin+Smith · · Score: 5, Funny

    Wait. I must be lying because it isn't released yet... Or... Perhaps the world extends beyond American borders. What, Americans make up only 5% of the world population? (10% by body mass)

     

    --
    Deleted
    1. Re:I've seen it by novakyu · · Score: 5, Funny

      Every country has McDonald's, a biological warfare arm of the U.S. military. No marines needed—we can get them with high cholesterol, wherever they are.

  4. already out by Anonymous Coward · · Score: 5, Informative

    kdawson is a drama queen.

    Release:
    Germany 11 December 2008
    UK 12 December 2008
    Brazil 25 December 2008
    Iceland 26 December 2008

    1. Re:already out by trawg · · Score: 4, Funny

      Give him a break - lots of the US hasn't figured out there's a rest of the world yet!

      (Thar be dragons)

  5. This sort of thing is everywhere by AndrewStephens · · Score: 5, Funny

    This happens everywhere. Why, even this very comment was modded to +2 before I even made it. You can't trust anyone these days.

    --
    sheep.horse - does not contain information on sheep or horses.
  6. Has it been released on TPB? by Kaukomieli · · Score: 3, Insightful

    ... or usenet or wherever todays kids get their moviez from...

  7. Astroturfing is rife, more common online auctions. by plasmacutter · · Score: 3, Insightful

    Ebay used to be a decent place to get deals, then a few years ago the scammers found out they can fake feedback, and you ended up with 2000+ "transaction" power-sellers who will take your money and run faster than the nigerian prince.

    Leave any negative feed back and it's "i've pleased all these guys, there's always one troll to screw it up"

    If you browse around a while on sites like ebay and amazon you'll notice the patterns these people have, the same people giving feedback to each other, it's disgusting really, but any peer contributed system is subject to gaming via astroturfing.

    Just see the net neutrality debate, or swiftboat.

    --
    VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
  8. Well... by boobox · · Score: 4, Insightful

    ... like just about everything in life, from Amazon.com to Slashdot, caveat emptor.

  9. None by 1u3hr · · Score: 4, Insightful
    "what is Netflix's responsibility here to provide honest ratings?"

    What is Slashdot's responsibility to provide honest moderation?

    Both are just aggregates of random people who bothered to comment, and don't pretend to be anything more. If you want a "professional" movie rating, look at the reviews at Rotten Tomatoes, where currently the Tomatometer for Inkheart is at 63%, based on 19 reviews.

    1. Re:None by Anonymous Coward · · Score: 3, Insightful

      You are taking that out of context. The submitter is specifically suggesting that the rating system which should be an average of 'random' people choosing to rate the movie, is instead subject to astroturfing.

      The submitter is probably on to something here. Yes, this film has been released abroad, but I find it unlikely that not only have 428 people in the United States seen it and bothered to rate it, but they rate it above 80% of possible points when places elsewhere (which _are_ open to people in places where the movie has been released) are rating it about 60-70%.

  10. Netflix Handles It by MWoody · · Score: 4, Insightful

    Remember, however, that Netflix doesn't show you the rating of a movie; it shows you its best estimate of how well you will like the movie. And does a pretty good job of it, too, once you've rated a few hundred films. So there are a few problems with your reasoning, in addition to the painfully obvious "it's already been released elsewhere" point covered in previous comments:

      - Is it even possible to make a shell account? Last I checked, you have to be logged in to rate anything on Netflix. And being logged in means you're a paying customer. I can't imagine paying $5 or whatever per single vote being cost effective, even at the cheapest service tier. Maybe there's a way if you abuse the free trial system, but that still strikes me as an awful lot of work.

      - Say, for the sake of argument, that these ARE shill accounts. They signed up somehow, rated that one movie, and never did anything again. If they haven't rated any other movies on your list, Netflix's algorithm will have nothing to link it to your preferences. I.e. it won't affect the rating you see in the slightest.

      - Let's even examine what happens if it's a multi-movie shill, perhaps kept up to vote highly for every movie released by a particular company. Again, the ranking system will almost certainly end up filtering out the result: unless you also happen to have given high scores to everything else that company has released, it's not likely to matter much in the final star value.

      - Assuming that you're looking at the unweighted score - an inadvisable decision, given that the remarkably astute ranking system is the best part of Netflix - you have to account for the long-term balancing effects of opinionated Internet voters. See, for example, IMDB, where new movies often peak onto the top 250 only to be struck down by Godfather/Shawshank/etc. fans. If someone only sort of likes a movie that's unrated, they might give it a 3, whereas showing up to see it rated 5 is going to result in a 1 and possible an irate comment. The flock will detect the wolf in their midst soon enough and crush it.

      - Who the fuck uses Netflix to get ratings for unreleased movies?

    On a tangentially related note, I first read that title and thought we were going to see a Netflix-like weighted rating system for games. I'd kill for a way to heavily weight lovers of Dwarf Fortress while throwing out comments from Halo junkies when deciding what to play next.

  11. Not shils, fanboys. by Aladrin · · Score: 4, Interesting

    You don't have to be a Shil to post reviews before the movie is out, you just have to be a fanboy. The 'I read the books' comment is definitely by a fanboy.

    I used to see a lot of this crap on EBGames.com before they got smart and disabled reviews before the games came out. Now it's called 'Preview Buzz'. You see the exact same comments, but they don't get to provide a rating.

    --
    "If you make people think they're thinking, they'll love you; But if you really make them think, they'll hate you." - DM
  12. Maybe YOU'RE the Shill by DavidD_CA · · Score: 5, Insightful

    Getting a link to a movie on Slashdot. How much did they pay you for that?

    Seriously, even if the movie hadn't been released anywhere, there are still plenty of opportunities to see it. Producers hold previews all the time, and it wouldn't surprise me if they modernized things by encouraging those previewers to post their comments right at the theatre lobby.

    This happens on Amazon.Com quite often, with products that are not yet released. Do I consider it fraud? Not necessarily. Once the masses weigh in, the law of averages will too.

    --
    -David
  13. US Only? by verloren · · Score: 3, Funny

    I had thought Netflix was a US only service. 400+ reviews for a film that's only been released overseas seems quite a lot - I guess Governor Palin has reignited the legendary American love of travel and curiosity about foreign countries.

    1. Re:US Only? by hab136 · · Score: 5, Funny

      I had thought Netflix was a US only service. 400+ reviews for a film that's only been released overseas seems quite a lot - I guess Governor Palin has reignited the legendary American love of travel and curiosity about foreign countries.

      Russia put up a big, big movie screen so Alaskans can watch from their house.

  14. Not only that, but... by hummassa · · Score: 5, Informative

    Inkheart is in the theatres here in Brasil for the last three weeks.
    Maybe it just didn't hit the theatres in the OP's city/state/country??

    --
    It's better to be the foot on the boot than the face on the pavement. ~~ tkx Kadin2048
    1. Re:Not only that, but... by Tirhakah · · Score: 3, Informative

      It's been out in the UK too, since I think mid-December. Not surprising that it should have at least some reviews already then...

  15. Re:behold by powerspike · · Score: 3, Insightful

    it's the date thing mate it said 4/12 on the American box, so they though April... that's all, they don't know we write our days and months backwards!

  16. It's just the kids... by krswan · · Score: 4, Insightful

    I teach 5th grade, and many of my students have read and enjoyed these books. I'll bet most of the reviews are kids who liked the books, and don't really think or care yet about whether the book does justice to the movie, if the movie is any good, if Slashdotters think that their rating is fair. They're ten... and they know how to use a mouse.

    And really, do you take any kind of online polling seriously?

  17. Hardly a new phenomenon by Drakkenmensch · · Score: 3, Insightful
    We've been seeing that for years with online reviews. Call it a logical consequence of the "First post" syndrome, with people being so eager to get on top of that page that they'll say anything at all even if it means nothing whatsoever.

    Then again, should we really be surprised to see this happen, with interviews for upcoming releases taking the form of "this will be the greatest thing EVER!" for absolutely any game or movie that comes out, especially those that turn out to be complete garbage? Don't believe the hype machine, folks, is what I'm saying.

  18. When are you going to understand... by John+Hasler · · Score: 3, Insightful

    ...that everything on a retailer's site is advertsing? Is it that hard to find sites that rate stuff but don't sell it?

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  19. Re:Astroturfing is rife, more common online auctio by drinkypoo · · Score: 3, Interesting

    It's easy to get a high positive ebay score if you have a legit business that doesn't depend on reputation, like selling LED replacement bulbs for cars or something like that. The penalty for failure is low so people will buy from you anyway, and items are cheap so you have high volume and get a high score. The eBay score doesn't really tell you much on their own if they have 1 negative and 2000 positives, and the negative is for a thousand dollar item, and everything else was a buck, either.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  20. Re:behold by corsec67 · · Score: 5, Informative

    dd/mm/yy

    That is the worst way to write dates. You can't tell 2010 and 1910 apart, and if you try to sort a bunch of files named by date, in your scheme the dates are all mixed up.

    You want big-endian, and 4 digit years:

    YYYY/MM/DD.

    The ISO agrees

    --
    If I have nothing to hide, don't search me