Slashdot Mirror


Gaming Netflix Ratings?

Nom du Keyboard writes "Not for the first time, I've noticed a new film that hasn't yet even reached the theaters, yet has hundreds of positive votes and/or reviews recorded on Netflix. This time the movie is Inkheart. For a movie that doesn't even hit the theaters until January 23, it already has 428 votes and a rating of 4.3 (out of 5) on Netflix. Seems more than a bit fraudulent to me. Also, it has a review that doesn't even review the movie, but instead says the books are great, therefore the movie should be too. Does the word 'shills' come to mind? With millions spent to promote a movie, are a few hundred of that going to phony voters? Or have that many people actually seen the film and just can't wait to rush home and log onto Netflix to vote? Just what is Netflix's responsibility here to provide honest ratings?"

47 of 235 comments (clear)

  1. Not to disagree with your conspiracy... by Anonymous Coward · · Score: 5, Interesting

    But it isn't rare for there to be advanced screenings of a movie a week or two in advance of the public release date.

    I wonder if we'll ever see movie cinemas with terminals or similar at them that let you rate a movie as you walk out after seeing it.

    1. Re:Not to disagree with your conspiracy... by Guido+del+Confuso · · Score: 4, Informative

      Not only this, but often times the makers of a film will show it to people before it is even finished. This could be anything from friends and business associates of the filmmakers (such screenings can number into the hundreds of people) to recruited audience test screenings (also often several hundred people). These people see the movie long before it comes out, and most likely not in its final form. Also, after a movie is completed it is sometimes sent around for audience reaction before it is picked up distribution. Of course, if the film plays at a film festival, that's hundreds or thousands of people watching it before it is released in theaters. So a few hundred people rating a movie before it's officially "out" isn't that strange.

      And remember, a significant portion of the people who do watch the movie before it comes out are friends and family of the crew, who aren't exactly impartial. That may explain why the ratings skew high.

    2. Re:Not to disagree with your conspiracy... by LatencyKills · · Score: 5, Interesting

      Back in college I somehow ended up screening a number of films before release (I think the process was something like a guy on campus asking if I'd like free tickets to a new movie). Before the movie there would be a quick spiel about the film not yet being released and that our feedback was very important, then they'd show the film, then they'd hand out a sheet of questions for us to answer. I recall that I saw Fletch 2 that way, and that the ending I saw in the screening was very different from the one I saw later in the theater. I also remember seeing a Judge Reinhold movie to wretched that everyone trashed it on the sheets, and I don't think it even came out in the theaters. It might have been released direct to video.

      --
      Jealously hoarding mod points since 2007.
    3. Re:Not to disagree with your conspiracy... by PainKilleR-CE · · Score: 2, Informative

      I got in on something similar to this a few years ago, and after the movie ended, we were given tickets to see another pre-screening the next week. As long as we kept going, we got to see free movies every week before they came out (usually only a week or so ahead of time, though). Unfortunately, we didn't really want to see most of the movies they were showing, so we'd end up giving the tickets away, and eventually someone didn't go (or didn't give us the tickets for the next week).

      On the other hand, it's not uncommon for people that work in the industry to have access to copies of the film, either, and it definitely gets out to their friends and family, even if they simply borrow it.

      --
      -PainKilleR-[CE]
    4. Re:Not to disagree with your conspiracy... by ClubStew · · Score: 4, Insightful

      Not only this, but consider the various fanboys. Some people may like Brendon Frasier enough that they think any movie with him is great, so they vote. People - like the OP mentioned - might like the book so much, they vote the movie positive without having seen it. It's idiotic, but so are people often times.

    5. Re:Not to disagree with your conspiracy... by joocemann · · Score: 3, Informative

      But it isn't rare for there to be advanced screenings of a movie a week or two in advance of the public release date.

      I wonder if we'll ever see movie cinemas with terminals or similar at them that let you rate a movie as you walk out after seeing it.

      I went to google.com

      Typed in "inkheart screener"

      The very first choice at the top is a bit-torrent search engine.

      The page lists a number of different torrents of this movie already being available from screeners and cam rips, etc.
      --------------

      I think it is safe to say that thousands of people have already seen it by now.

  2. Not released? by Seriph · · Score: 5, Informative

    Maybe not released yet in the US, but there is a world beyond the US borders and the film has been released places there. It's actually quite a good film based on an interesting idea.

    1. Re:Not released? by aitikin · · Score: 5, Informative

      Seriph brings up a perfect point. IMDB seems to back that information up fairly well.

      --
      "Don't meddle in the affairs of a patent dragon, for thou art tasty and good with ketchup." ~ohcrapitssteve
    2. Re:Not released? by retyurecvb · · Score: 5, Informative

      Doesn't Netflix only service the U.S. though?

    3. Re:Not released? by Monsieur_F · · Score: 5, Informative

      From imdb
      Release dates for Inkheart (2008)
      Country : Date
      Germany : 11 December 2008
      UK : 12 December 2008
      Brazil : 25 December 2008
      Iceland : 26 December 2008

      --
      McCartney fans pay bus tickets. [...] Lennon fans too, with discretion.
    4. Re:Not released? by diskis · · Score: 5, Insightful

      Piratebay services also the U.S.

      If the movie is out somewhere, there is a torrent of it.

    5. Re:Not released? by indigest · · Score: 2, Informative

      Netflix serves the US only. Our equivalent in the UK is lovefilm.com.

    6. Re:Not released? by Bodrius · · Score: 4, Interesting

      Should that make a significant difference?

      Netflix does not own movie theaters either. Yet that doesn't stop people from watching movies there and reviewing DVD movies (often before the DVD release) based on the theater experience.

      Between advance screenings, festivals, and people who may have watched it in other countries at some point... a few hundred viewers doesn't sound that implausible.

      If anything, the over-eager fan phenomenon (the "books are great, movie is going to rock" review the poster mentions) is the most likely distortion. But that's hardly surprising or suspicious - popular book-sequels tend to demonstrate something like this in Amazon weeks/months before it was released (sometimes positive hype, sometimes negative).

      Why would it be different in Netflix? Most likely it is just less obvious in their user interface.

      --
      Freedom is the freedom to say 2+2=4, everything else follows...
    7. Re:Not released? by Atario · · Score: 4, Interesting

      Who are these foreigners who are so altruistic as to log in to Netflix -- thus far, a US-only service -- to rate a movie and write a review of it wholly for the benefit of people subscribed to a service the reviewers themselves cannot benefit from?

      Come to that, can you even enter a rating and/or review without being a subscriber?

      --
      "A great democracy must be progressive or it will soon cease to be a great democracy." --Theodore Roosevelt
    8. Re:Not released? by TheKidWho · · Score: 4, Informative

      Probablly those domestic people who might have taken a trip abroad or gone on an adventure to this place called the pirate bay.

      YARRR

    9. Re:Not released? by SpinningCone · · Score: 3, Informative

      In the case of inkheart yes this was already released and could potentially get legit reviews. however Terminator: Salvation has not been released and with a target date of May/June i would be surprised if there was even a screener available. yet despite this there are plenty of positive votes.

    10. Re:Not released? by Sopor42 · · Score: 2, Informative

      Did you actually look?

      A curosry search brought no results for the movie Inkheart on TBP or Mininova...

      Not saying the torrent isn't out there somewhere, but it's not on the big ones yet.

  3. I've seen it by Colin+Smith · · Score: 5, Funny

    Wait. I must be lying because it isn't released yet... Or... Perhaps the world extends beyond American borders. What, Americans make up only 5% of the world population? (10% by body mass)

     

    --
    Deleted
    1. Re:I've seen it by novakyu · · Score: 5, Funny

      Every country has McDonald's, a biological warfare arm of the U.S. military. No marines needed—we can get them with high cholesterol, wherever they are.

  4. already out by Anonymous Coward · · Score: 5, Informative

    kdawson is a drama queen.

    Release:
    Germany 11 December 2008
    UK 12 December 2008
    Brazil 25 December 2008
    Iceland 26 December 2008

    1. Re:already out by trawg · · Score: 4, Funny

      Give him a break - lots of the US hasn't figured out there's a rest of the world yet!

      (Thar be dragons)

  5. This sort of thing is everywhere by AndrewStephens · · Score: 5, Funny

    This happens everywhere. Why, even this very comment was modded to +2 before I even made it. You can't trust anyone these days.

    --
    sheep.horse - does not contain information on sheep or horses.
  6. Has it been released on TPB? by Kaukomieli · · Score: 3, Insightful

    ... or usenet or wherever todays kids get their moviez from...

  7. Astroturfing is rife, more common online auctions. by plasmacutter · · Score: 3, Insightful

    Ebay used to be a decent place to get deals, then a few years ago the scammers found out they can fake feedback, and you ended up with 2000+ "transaction" power-sellers who will take your money and run faster than the nigerian prince.

    Leave any negative feed back and it's "i've pleased all these guys, there's always one troll to screw it up"

    If you browse around a while on sites like ebay and amazon you'll notice the patterns these people have, the same people giving feedback to each other, it's disgusting really, but any peer contributed system is subject to gaming via astroturfing.

    Just see the net neutrality debate, or swiftboat.

    --
    VLC FOR MAC IS DYING! IF YOU DEVELOP, PLEASE SAVE IT!!
  8. Well... by boobox · · Score: 4, Insightful

    ... like just about everything in life, from Amazon.com to Slashdot, caveat emptor.

  9. None by 1u3hr · · Score: 4, Insightful
    "what is Netflix's responsibility here to provide honest ratings?"

    What is Slashdot's responsibility to provide honest moderation?

    Both are just aggregates of random people who bothered to comment, and don't pretend to be anything more. If you want a "professional" movie rating, look at the reviews at Rotten Tomatoes, where currently the Tomatometer for Inkheart is at 63%, based on 19 reviews.

    1. Re:None by Anonymous Coward · · Score: 3, Insightful

      You are taking that out of context. The submitter is specifically suggesting that the rating system which should be an average of 'random' people choosing to rate the movie, is instead subject to astroturfing.

      The submitter is probably on to something here. Yes, this film has been released abroad, but I find it unlikely that not only have 428 people in the United States seen it and bothered to rate it, but they rate it above 80% of possible points when places elsewhere (which _are_ open to people in places where the movie has been released) are rating it about 60-70%.

  10. Netflix Handles It by MWoody · · Score: 4, Insightful

    Remember, however, that Netflix doesn't show you the rating of a movie; it shows you its best estimate of how well you will like the movie. And does a pretty good job of it, too, once you've rated a few hundred films. So there are a few problems with your reasoning, in addition to the painfully obvious "it's already been released elsewhere" point covered in previous comments:

      - Is it even possible to make a shell account? Last I checked, you have to be logged in to rate anything on Netflix. And being logged in means you're a paying customer. I can't imagine paying $5 or whatever per single vote being cost effective, even at the cheapest service tier. Maybe there's a way if you abuse the free trial system, but that still strikes me as an awful lot of work.

      - Say, for the sake of argument, that these ARE shill accounts. They signed up somehow, rated that one movie, and never did anything again. If they haven't rated any other movies on your list, Netflix's algorithm will have nothing to link it to your preferences. I.e. it won't affect the rating you see in the slightest.

      - Let's even examine what happens if it's a multi-movie shill, perhaps kept up to vote highly for every movie released by a particular company. Again, the ranking system will almost certainly end up filtering out the result: unless you also happen to have given high scores to everything else that company has released, it's not likely to matter much in the final star value.

      - Assuming that you're looking at the unweighted score - an inadvisable decision, given that the remarkably astute ranking system is the best part of Netflix - you have to account for the long-term balancing effects of opinionated Internet voters. See, for example, IMDB, where new movies often peak onto the top 250 only to be struck down by Godfather/Shawshank/etc. fans. If someone only sort of likes a movie that's unrated, they might give it a 3, whereas showing up to see it rated 5 is going to result in a 1 and possible an irate comment. The flock will detect the wolf in their midst soon enough and crush it.

      - Who the fuck uses Netflix to get ratings for unreleased movies?

    On a tangentially related note, I first read that title and thought we were going to see a Netflix-like weighted rating system for games. I'd kill for a way to heavily weight lovers of Dwarf Fortress while throwing out comments from Halo junkies when deciding what to play next.

  11. Not shils, fanboys. by Aladrin · · Score: 4, Interesting

    You don't have to be a Shil to post reviews before the movie is out, you just have to be a fanboy. The 'I read the books' comment is definitely by a fanboy.

    I used to see a lot of this crap on EBGames.com before they got smart and disabled reviews before the games came out. Now it's called 'Preview Buzz'. You see the exact same comments, but they don't get to provide a rating.

    --
    "If you make people think they're thinking, they'll love you; But if you really make them think, they'll hate you." - DM
  12. Maybe YOU'RE the Shill by DavidD_CA · · Score: 5, Insightful

    Getting a link to a movie on Slashdot. How much did they pay you for that?

    Seriously, even if the movie hadn't been released anywhere, there are still plenty of opportunities to see it. Producers hold previews all the time, and it wouldn't surprise me if they modernized things by encouraging those previewers to post their comments right at the theatre lobby.

    This happens on Amazon.Com quite often, with products that are not yet released. Do I consider it fraud? Not necessarily. Once the masses weigh in, the law of averages will too.

    --
    -David
  13. US Only? by verloren · · Score: 3, Funny

    I had thought Netflix was a US only service. 400+ reviews for a film that's only been released overseas seems quite a lot - I guess Governor Palin has reignited the legendary American love of travel and curiosity about foreign countries.

    1. Re:US Only? by hab136 · · Score: 5, Funny

      I had thought Netflix was a US only service. 400+ reviews for a film that's only been released overseas seems quite a lot - I guess Governor Palin has reignited the legendary American love of travel and curiosity about foreign countries.

      Russia put up a big, big movie screen so Alaskans can watch from their house.

  14. Not only that, but... by hummassa · · Score: 5, Informative

    Inkheart is in the theatres here in Brasil for the last three weeks.
    Maybe it just didn't hit the theatres in the OP's city/state/country??

    --
    It's better to be the foot on the boot than the face on the pavement. ~~ tkx Kadin2048
    1. Re:Not only that, but... by commodore64_love · · Score: 2, Interesting

      Yes bribing. If it can happen over at amazon, it can certainly happen on other customer review sites.

      This is why I typically subtract a star from my reviews. It I think a book or movie is worth 8 stars, I'll rate it 7, so as to counteract the Paid Corporate Employees false positives. (Aside: Why is it that I can't leave 0 stars on amazon or imdb? Some things actually deserve a 0.)

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    2. Re:Not only that, but... by Tirhakah · · Score: 3, Informative

      It's been out in the UK too, since I think mid-December. Not surprising that it should have at least some reviews already then...

  15. Re:behold by powerspike · · Score: 3, Insightful

    it's the date thing mate it said 4/12 on the American box, so they though April... that's all, they don't know we write our days and months backwards!

  16. whats going on with the visible trolls? by thermian · · Score: 2

    My preferences are set to filter anyone below 1, but I still see all the garbage that the trolls are working so hard to post.

    I don't see why this should be happening now, I used to be able to not see any of it, but with this new interface it seems its impossible to escape reading the first line of the troll posts.

    It needs fixing.

    --
    A learning experience is one of those things that say, 'You know that thing you just did? Don't do that.' - D. Adams
  17. It's just the kids... by krswan · · Score: 4, Insightful

    I teach 5th grade, and many of my students have read and enjoyed these books. I'll bet most of the reviews are kids who liked the books, and don't really think or care yet about whether the book does justice to the movie, if the movie is any good, if Slashdotters think that their rating is fair. They're ten... and they know how to use a mouse.

    And really, do you take any kind of online polling seriously?

  18. Hardly a new phenomenon by Drakkenmensch · · Score: 3, Insightful
    We've been seeing that for years with online reviews. Call it a logical consequence of the "First post" syndrome, with people being so eager to get on top of that page that they'll say anything at all even if it means nothing whatsoever.

    Then again, should we really be surprised to see this happen, with interviews for upcoming releases taking the form of "this will be the greatest thing EVER!" for absolutely any game or movie that comes out, especially those that turn out to be complete garbage? Don't believe the hype machine, folks, is what I'm saying.

  19. When are you going to understand... by John+Hasler · · Score: 3, Insightful

    ...that everything on a retailer's site is advertsing? Is it that hard to find sites that rate stuff but don't sell it?

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  20. Possibly not fraud by mlwmohawk · · Score: 2, Interesting

    While fraud may be a problem, I don't think it is. Pre-screeners get a copy of the films just for these sorts of things.

    I know for a fact that if you look for it, you can get "Taken," "Defiance," and other movies on the internet in DVD quality over the internet "for free." I am further certain that members film community and/or MPIAA uploaded the movies to drive up viewership at the box office.

    For instance, "The Day The Earth Stood Still" sucked, so the "screening" video is not out there. "Gran Torino" was an excellent movie and did well at the box office, and the screening video *is* out there.

    My new criteria for seeing a movie in a theater is looking for the screening video on-line. If it is out there, its probably a good movie because someone put it out there.

  21. Not surprizing by Rooked_One · · Score: 2, Interesting

    I remember when "Dark Knight" was at the number 1 spot up against godfather and shawshank

    Thankfully someone has fixed that, but it just shows how inaccurate internet polls are.

  22. Re:Astroturfing is rife, more common online auctio by drinkypoo · · Score: 3, Interesting

    It's easy to get a high positive ebay score if you have a legit business that doesn't depend on reputation, like selling LED replacement bulbs for cars or something like that. The penalty for failure is low so people will buy from you anyway, and items are cheap so you have high volume and get a high score. The eBay score doesn't really tell you much on their own if they have 1 negative and 2000 positives, and the negative is for a thousand dollar item, and everything else was a buck, either.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  23. Never attribute to malice what can be explained... by PyroMosh · · Score: 2, Interesting

    ...by stupidity.

    I think Hanlon's Razor applies here. Many people here on Slashdot like to put on a tinfoil hat and shout "AstroTurfing" for almost anything. I'm harder to convince of that.

    I'll put aside what many have pointed out here, that the film in question has already been released in places.

    NPR had an interview a month or so ago with David Edelstein, a film critic who happened to be the first to go public with a negative review for Dark Knight. In other words, he was the one responsible for first knocking it down from a 100% rating on metacritic and similar meta-rating sites.

    In the interview he said he regretted having been first because of the backlash he received, but that he stood by his rating.

    He also went on to point out the deluge of emails he received from angry fans. Many of whom would go on to criticize him at length while prefacing the email with "I haven't actually seen the film yet, but..."

    Fanboys are rabid. They defend movies, hardware, software, etc, often sight unseen, because they want their horse to win. Even if they don't actually know what it looks like.

    In this case, the movie is based on a book. I don't doubt that many of the votes on NetFlix are folks who have rated the film sight unseen, because they WANT to like it. They're jazzed about it, and they want it to be rated highly.

  24. Re:behold by corsec67 · · Score: 5, Informative

    dd/mm/yy

    That is the worst way to write dates. You can't tell 2010 and 1910 apart, and if you try to sort a bunch of files named by date, in your scheme the dates are all mixed up.

    You want big-endian, and 4 digit years:

    YYYY/MM/DD.

    The ISO agrees

    --
    If I have nothing to hide, don't search me
  25. Re:Not idiotic by Anonymous Coward · · Score: 2, Insightful

    The GP didn't say liking things is idiotic, he said that voting on a movie before actually seeing it is idiotic, regardless of whether you're familiar with the underlying story.

    And yes, voting based on invalid data is stupid. Well, stupid or deceitful, but people are generally more in the former category.

    Case in point: Catwoman. Anyone who would "pre-rate" this movie 5 stars because they're fans of the Batman universe and love Halle Berry is categorically stupid.

  26. Re:Not idiotic by Belial6 · · Score: 2, Informative

    Really? You are honestly trying to claim that it isn't stupid to rate a movie as being good even when you have not seen it? Really?