Slashdot Mirror


Rotten Tomatoes Scores Don't Correlate To Box Office Success or Woes, Research Shows (polygon.com)

Depending on who you ask, Rotten Tomatoes is the reason some movies don't perform at the box office. From a report: Countless movie executives, including producers, have told Deadline and the New York Times that the number atop a movie's page on Rotten Tomatoes signifying whether the majority of critics enjoyed or disliked a movie rules the box office. Director Brett Ratner was quoted as saying "I think it's the destruction of our business" while others have called for its demise. According to research conducted by Yves Bergquist, director of the Data & Analytics Project at USC's Entertainment Technology Center, that's not correct. Bergquist collected data from 150 movies this year that made more than $1 million at the box office. Using those Box Office Mojo numbers and comparing them to the critic and audience score on Rotten Tomatoes, Bergquist then "looked at [the] correlation between scores and financial performance" to determine if there was a linear line that could be drawn between low scores and bad box office performance. Or, more simply, did a lower "rotten" rating on Rotten Tomatoes equate to box office woes? The short answer is no, it didn't. Bergquist's findings confirmed that of the 150 movies surveyed, there was only a 12 percent correlation between a movie receiving a bad score and not performing well at the box office. Summer films saw even less of a correlation, with seven percent of lower-scored movies not performing at the box office.

106 comments

  1. Of course it doesn't. by king+neckbeard · · Score: 5, Insightful

    Critical success doesn't equal commercial success, but if your movie fails commercially, blaming rotten tomatoes makes for a convenient scapegoat.

    --
    This is my signature. There are many like it, but this one is mine.
    1. Re:Of course it doesn't. by AmiMoJo · · Score: 4, Insightful

      Also, user scores don't correlate to success either. At best only people who could be bothered will actually give an opinion, and then their motivation for rating the movie is often unrelated to its quality (e.g. they dislike the cast or the director).

      The standard advice applies. Find a critic who seems to like the same stuff as you, and follow them.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    2. Re:Of course it doesn't. by MrTester · · Score: 1

      In all the time I've been reading SlashDot, this is the first time I have ever seen the first post get a 5: Insightful.
      Congratulations!

    3. Re:Of course it doesn't. by Anonymous Coward · · Score: 0

      So, the "Not My Fault" claim isn't exclusive to politics alone. I'm shocked!

    4. Re:Of course it doesn't. by fustakrakich · · Score: 2

      if your movie fails commercially, blaming rotten tomatoes makes for a convenient scapegoat.

      Well, that and piracy.

      The same thing is happening in politics also. A book just came out on the subject. Passing blame is ubiquitous.

      --
      “He’s not deformed, he’s just drunk!”
    5. Re:Of course it doesn't. by angel'o'sphere · · Score: 1

      I go with the http://www.spiegel.de/ critics.
      It is super simple:
      bad critcs: go watch the movie, it is likely ok
      good critics: avoid it as hell, it is probaly the worst waste of money ever
      suoer good critics: try it, might be a matter of taste, can be good or not so good, but is usually not really bad

      On the other hand the kast decade I nadically avoided every movie except Lord of the Rings, and watched The expendabkes in youtube. How old is the first Pirates of the Carebean movie?

      I probbaly watch that blond fighter chick movie, thought ... ah, and I liked that 'monkey king' movie with Jackie Chan and Jet Li, but it was obvious that the movie would be good, regardless of online reviews (are the reviews paid for to be super good or super bad?)

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    6. Re:Of course it doesn't. by Anonymous Coward · · Score: 0

      I go with the http://www.spiegel.de/ critics. It is super simple: bad critcs: go watch the movie, it is likely ok good critics: avoid it as hell, it is probaly the worst waste of money ever suoer good critics: try it, might be a matter of taste, can be good or not so good, but is usually not really bad

      On the other hand the kast decade I nadically avoided every movie except Lord of the Rings, and watched The expendabkes in youtube. How old is the first Pirates of the Carebean movie?

      I probbaly watch that blond fighter chick movie, thought ... ah, and I liked that 'monkey king' movie with Jackie Chan and Jet Li, but it was obvious that the movie would be good, regardless of online reviews (are the reviews paid for to be super good or super bad?)

      I've got a great deal on replacement keyboards, if you're interested....

    7. Re:Of course it doesn't. by hey! · · Score: 1

      While I agree, we have to be careful about the limits of statistical inference. Just because Rotten Tomatoes scores in aggregate don't affect industry-wide box office receipts very much doesn't mean that Rotten Tomatoes never makes or breaks a movie.

      This is generally the case: averages and correlations over large, inhomogeneous event sets may not tell the story accurately for every event in the set. E.g., the US as a whole has long since recovered from the Great Recession, but certain areas (specifically certain types of areas) have yet to recover to their pre-recession levels of employment.

      This could be an interesting machine learning project; use regression techniques to classify movies as to whether they might be affected economically by critical response.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
    8. Re:Of course it doesn't. by Anonymous Coward · · Score: 0

      if a movie doesn't "make money" it's the studio's accountants to blame. most films actually make back their actual costs and would turn at least some sort of profit. but in hollywood, even harry potter movies lose money. studio executives "blaming" a web site for a bad return are just 'playing along'.. they know what's up and more importantly, where the money is really at.

    9. Re:Of course it doesn't. by Anonymous Coward · · Score: 1

      "Never accept blame. Make someone else pay for your mistakes." That's the motto of sociopaths.

      As for the book What Happened? by Hillary Clinton.... I heard it elsewhere but it can't be said enough, the book's title and author should be: What Happened? Hillary Clinton by Everyone.

    10. Re:Of course it doesn't. by Jason+Levine · · Score: 1

      One of the first sites I ran was an infomercial product review website. One of the lessons I got out of that site was that people tended to review products if they really hated them or if they really liked them - with the former outweighing the latter. People don't tend to post reviews for "it was a decent product that fit my need, but there was nothing exceptional about it." So you will often get a bunch of 1 star reviews on what might be a decent product or 5 star reviews on what might be a so-so product. (Then again, I got some truly dreadful product reviews - including photos of bodily damage caused by one particular product that, when I last checked, was still on the market.)

      Going back to movies, if 1,000 people watch a movie, you might get a dozen "man, that was awful" reviews even if 900 people sort of liked it, but not enough to make the effort to post a review.

      --
      My sci-fi novel, Ghost Thief, is now available from Amazon.com.
    11. Re:Of course it doesn't. by mnemotronic · · Score: 1

      I go with ...snipsnip ...

      I've got a great deal on replacement keyboards, if you're interested....

      Not the problem in this instance. And before you suggest it, there is no replacement for German beer.

      --
      The Russians have won. They have made the world a cesspool of distrust, greed, fear and hate.
    12. Re:Of course it doesn't. by UnknownSoldier · · Score: 2

      Indeed. Hollywood loves to play the blame game. Why is it always ...

      * Piracy
      * Social Media and Internet review sites ... that are blamed for commercial "failures".

      Here's a fucking radical idea:

      * Stop remaking the same fucking movies (List of Film Remakes)
      * Stop blowing your shitty movie budget on VFX (Gods of Egypt (2016)
      * Stop insulting your audience's intelligence by doing dumb shit (Everything Wrong With Prometheus In 4 Minutes Or Less)
      * Stop the mindless violence (Everything Wrong With John Wick Chapter 2) and grow the fuck up already.

      Great movies I've seen this year, sorted alphabetically: (Yeah they are from last year, whatever)

      * Branded
      * Carrie Pilby
      * Concussion
      * Deadpool
      * Dunkirk
      * Manchester by the Sea (boring as fuck for the first hour, but gets good)
      * Silence

      Over-rated movies in 2016 but still enjoyable

      * Arrival
      * Doctor Strange
      * Secret Life of Pets
      * Zootopia

    13. Re: Of course it doesn't. by JackieBrown · · Score: 1

      But they are all BOLD and GROUNDBREAKING!

    14. Re:Of course it doesn't. by MightyYar · · Score: 1

      That's good advice. I've always enjoyed comedies, and - perhaps because humor is so subjective - I've noticed that comedies rarely have a good score upon release. I remember when Airplane! would come on TV in the early 80s and the guide had it as 3 stars. Now that it's a cult-classic, it fetches a 7.8 on IMDB and a 97% on Rotten Tomatoes.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    15. Re:Of course it doesn't. by MightyYar · · Score: 1

      by one particular product that, when I last checked, was still on the market.

      The Cornballer?

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    16. Re: Of course it doesn't. by Anonymous Coward · · Score: 0

      Remake Pixels with a black trans Muslim lead: 9/10 "A powerful story of a stunning and brave womyn who stands alone against alien invaders!"

    17. Re: Of course it doesn't. by Anonymous Coward · · Score: 0

      My go-to method is to find someone who has opposite tastes to mine, and strong opinions. If they pan a movie, I will very likely like it. And if they love a movie, it's one I need to avoid like the plague. Works great.

    18. Re:Of course it doesn't. by Anonymous Coward · · Score: 0

      There are reasons why people don't (like to) watch another Uwe Bowl (Bohl? whatever!), Jim Carrey, Nicholas Cage, Mark Wahlberg, Colin Farrel, James Franco movies, you know.

    19. Re:Of course it doesn't. by Jason+Levine · · Score: 1

      No, it was Epil-Stop. The product claimed to remove hair painlessly. Some users reported chemical burns. The stories all seemed similar. "I put it on, felt a burning sensation that got painful, tried to wash it off and it got worse." One person sent me photos of their burns. I looked up information on the products' ingredients on various sites that track chemical properties. Some of the chemicals in Epil-Stop said they reacted with water. So, of course, trying to wash the product off your skin would cause a chemical reaction which would lead to worse burns.

      (Disclaimer: This was over a decade ago. For all I know, Epil-Stop reformulated their product to avoid these issues. I'd still be leery of a product that claims you just apply it and wipe hair away painlessly.)

      --
      My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  2. Are they measauring the same way? by TimothyHollins · · Score: 4, Insightful

    Perhaps the difference is found in what Ratner considers a success and what Bergquist considers a success?
    If you need a $2 billion revenue to consider a movie successful, then it probably correlates quite well to the Rotten Tomatoes score.

    1. Re:Are they measauring the same way? by ram.loss · · Score: 2

      Actually, it doesn't. Even if you define success as 'Has 2 billion revenue' you'll find that the three films that met the criterion have 84%, 88% and 92% score. A high one to be sure, but then again you have Dunkirk with a 93% and $500 million, Arrival (94%, $200 million) and Moonlight (98%, 65 million) just to mention recent examples. There's simply no way to correlate movie revenue with RT score.

    2. Re:Are they measauring the same way? by WrongMonkey · · Score: 2

      Normalize for budget. If you follow the links, the study shows a strong correlation (0.8) between production budget and box office gross. Your three examples are consistent with that trend; Moonlight having the lowest production budget and Dunkirk having the highest.

    3. Re:Are they measauring the same way? by Anonymous Coward · · Score: 0

      The Force Awakens was an atrocious movie that should have failed at the box office. JJ Abrams is a mediocre director whose movies somehow make money.

      A movie like Fury Road should have made over a billion, yet it didn't. It actually had some amazing action sequences and was fun. Audiences make no sense.

    4. Re:Are they measauring the same way? by ram.loss · · Score: 1

      Did not follow the links (this is still ./ right ;-)) And I don't disagree at all with your interpretation, but notice how "RT Score" is completely absent from it.
      My contention is that no matter how you define "Box Office Success", you won't find a correlation between it and the score of RT; which does not mean that there is no correlation with other variables.

    5. Re:Are they measauring the same way? by WrongMonkey · · Score: 1
      Its not your fault because the summary is wrong, too, but there is a strong correlation (p=0.27-0.4, depending on year) between box office gross and RT scores. But there are other factors that are more strongly correlated, such as production budget and audience score.

      https://medium.com/@ybergquist...

    6. Re:Are they measauring the same way? by ewibble · · Score: 1

      Perhaps it has to do with marketing budget more than quality of the film, if few people know about few people see it.

  3. Hunh? by Anonymous Coward · · Score: 0

    Someone is lying with statistics here. Bad movies get bad ratings from critics and public alike and fewer people go. Not 100% correlation, but only 7% for summer movies?

    1. Re:Hunh? by Lab+Rat+Jason · · Score: 4, Interesting

      Alternative interpretation: People will eat shit when shit is the only thing available to eat. People will still spend money on a mediocre film if there is nothing else to watch. This is why all the foreign films and artsy stuff steers clear of summer releases... otherwise they'd get trounced by DC, Marvel, et al. I'm pretty confident that if you control for the season of the release date, and the other films you compete with on release, you'd find the correlation you are looking for.

      --
      Which has more power: the hammer, or the anvil?
    2. Re:Hunh? by Ungrounded+Lightning · · Score: 1

      Bad movies get bad ratings from critics and public alike and fewer people go. Not 100% correlation, but only 7% for summer movies?

      Only a 7% correlation says to me that the reviewers aren't plugging or panning movies (in a way that triggers a tomatoes up/down tick)on anything that matters to moviegoers decisions to buy a ticket.

      So the research doesn't just discredit the "Rotten Tomatoes killed our film" theory. It also discredits the reviews themselves.

      --
      Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
    3. Re:Hunh? by Anonymous Coward · · Score: 0

      They didn't take into account the fact that different kinds of movies make different amounts of money. A big budget action movie released on a prime holiday weekend on thousands of screens is going to make more money than a small indie drama released on a handful of screens irrespective of how the two movies are reviewed. Realistically to make a determination on this you've got to compare similar movies accounting for things like marketing, opening date, stars and other factors. In fact it's actually quite amazing that there is any positive correlation in this analysis at all.

    4. Re:Hunh? by TechyImmigrant · · Score: 1

      Alternative interpretation: People will eat shit when shit is the only thing available to eat. People will still spend money on a mediocre film if there is nothing else to watch. This is why all the foreign films and artsy stuff steers clear of summer releases... otherwise they'd get trounced by DC, Marvel, et al. I'm pretty confident that if you control for the season of the release date, and the other films you compete with on release, you'd find the correlation you are looking for.

      I'll watch foreign films and artsy stuff over DC or Marvel films any day.

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    5. Re: Hunh? by Anonymous Coward · · Score: 0

      The reviews are useful, just not for the sheep. Advertising budget drives the profitability, and it's killing the film industry. More and more people have gotten advertised into seeing so many shitty movies that they've just given up and rent or pirate them rather than being the chump again.

      If the advertising were less effective on the remaining film goers, then the dollars would follow the quality of film instead of quality of budget. But then, you wouldn't have cult classics, as they'd just be good movies.

    6. Re:Hunh? by Anonymous Coward · · Score: 0

      This. I'm in the care field, and have numerous clients that simply go to movies. They don't review them before hand, can change movies once at the theater and have little to say about them afterward. RT is meaningless to them.

      Myself, I am at the other extreme -- read numerous reviews for a possible movie, don't spontaneous change what I end up watching, never go to theaters -- and I would never trust RT for anything. Paid, professional reviewers? Who in their right mind would trust that?

      IMDB at least has *some* actual people giving honest reviews. Read the last 10 reviews, sift and you probably have a good idea if that movie will be to your taste. But trusting professionals' movie recommendations? Hilarious!

    7. Re:Hunh? by Rakarra · · Score: 1

      People will still spend money on a mediocre film if there is nothing else to watch

      But there is a LOT of good stuff to watch. Maybe more now than at any point in our history. So people don't need to go out to the movie theaters, not when the best writers have switched to writing for TV series.

    8. Re:Hunh? by Anonymous Coward · · Score: 0

      Because you're a fag.

  4. box office vs review scores by Anonymous Coward · · Score: 0

    Low-quality scripts full of action and comedy pack theaters in the summer.
    High-quality scripts with top-notch acting and directing get the good reviews but don't get any attention at the box office until 2nd run in the dollar theater after the Oscars.

    I thought everybody knew that already.

  5. Unscientific by freeze128 · · Score: 2

    I don't think you can count Rotten Tomotoes ratings as scientific. There is no validation that the reviewer actually SAW the movie. Also, people who SAW the movie, and liked it, aren't forced to review it. Finally, not every moviegoer uses Rotten Tomotoes ratings to determine if they want to see a movie or not.

    So, for Hollywood to base its entire success on RT ratings, is stupid.

    1. Re:Unscientific by swb · · Score: 1

      Who makes up the critics counted for RT scores?

      I'd like to see more analytics done to determine if there are "key critics" who are capable of swinging all the reviews generally positive or generally negative.

      I kind of have the idea that movie reviews are kind of an echo chamber where after a few key critics establish a positive or negative trend, most of the other critics line up behind them.

      I'd wager that a lot of movie criticism is just content generation on a content provider's industrial schedule -- quick movie summary, quick rehash of other critic opinons and a dash of their own opinion, and then on to the next release for the next column refresh.

      I'd also guess that a lot of it is also completely fraudulent -- unoriginal, lacking in any criticism and not much more than a summary of the plot, more publicity than criticism.

    2. Re:Unscientific by Anonymous Coward · · Score: 0

      I don't think you can count Rotten Tomotoes ratings as scientific. There is no validation that the reviewer actually SAW the movie.

      I don't think RT ever claimed to be scientific .. they have people read reviews, try to determine what the reviewer is actually saying (with some degree of subjectivity), and assign a score to it.

      Most of these reviews will be coming from sources who are doing regular reviews, and I can see from looking at something like "The Emoji Movie" they actually cite the reviews they're using, have assigned scores to reviewers (likely because they are actual film reviewers with some reputation).

      And when you see reviews like:

      There's a justifiable self-loathing running through The Emoji Movie, a fragile attempt to (sigh) deconstruct the meaning of Emojis while also (sigh) demonstrating the profound possibility that Emojis are the language of the future.

      July 28, 2017 | Rating: F | Full Reviewâ¦

      Darren Franich
      Entertainment Weekly
        Top Critic

      then you can pretty much say "wow, this person really hated this movie, is a film critic for a reputable source, and we can probably assume he actually watched the film".

      It's not like you're not free to click the links to the actual review. In fact, they make it really easy to do.

      What Rotten Tomatoes does very well is collect a bunch of relevant reviews into one place so you can make your own decision.

      But I'd say if Hollywood has a film which is universally panned, it's not the fault of Rotten Tomatoes, it's the fault of the film makers.

    3. Re:Unscientific by Anonymous Coward · · Score: 0

      Also, there is no validation the the reviewer actually SAW SAW.

    4. Re:Unscientific by Anonymous Coward · · Score: 0

      I'd like to see more analytics done

      only idiots want to analyze noise

    5. Re:Unscientific by Anonymous Coward · · Score: 0

      Maybe not, but it is their job. They actually get paid to see movies. Most of them became reviewers because they like to go to movies. Often then get to go to special showings before the movies come out so they can write reviews to coincide with the movie opening. Why would they bother to write a fake review?

  6. Correlation does not equal causation. by Kenja · · Score: 3, Insightful

    Perhaps the Rotten Tomatoes score is low, because the movie is bad, and that's why your box office sales are poor.

    --

    "Have you ever thought about just turning off the TV, sitting down with your kids, and hitting them?"
    1. Re:Correlation does not equal causation. by Anonymous Coward · · Score: 0

      you didn't even read the summary did you? they just said that bad scores don't predict poor sales.

    2. Re:Correlation does not equal causation. by thegarbz · · Score: 1

      Perhaps the Rotten Tomatoes score is low, because the movie is bad, and that's why your box office sales are poor.

      That would imply correlation but not causation. In this case there isn't even correlation, implying that people happily spend money to see bad movies, and don't spend money to see good ones.

    3. Re:Correlation does not equal causation. by Anonymous Coward · · Score: 0

      I'm thinking it's far more that people watch movies at specific times and pick from what's available. They do not alter frequency with the quality of films, but rather, disposable income and time.

    4. Re:Correlation does not equal causation. by Anonymous Coward · · Score: 0

      You didn't even read the comment did you?

      He said a bad movie could have both a bad RT score and poor box office sales. Not trying to put words in Kenja's mouth, but I think he was getting at the fact that a crappy movie (by some definition) may be the causation not ratings or sales actually influencing each other.

  7. I suppose it doesn't matter by Anonymous Coward · · Score: 0

    I sometimes go to RTs to see what's out and see how badly some of it scores. Then I laugh myself silly as I realize I wasn't going to go see any of it anyway. I haven't seen a new film in 2 years now. I don't pirate them either. I simply don't care to download bottomfeeder trash.

  8. Read the first sentence 3 times by Anonymous Coward · · Score: 0

    before realizing the post is total crap. If you can't be bothered to proofread your own bullshit, don't post.

    1. Re:Read the first sentence 3 times by Quirkz · · Score: 1

      Yep, really tries hard to look like it's missing a verb.
      Also: "a linear line" is pretty impressive.

    2. Re:Read the first sentence 3 times by Anonymous Coward · · Score: 0

      they really seem to be trying to avoid saying they used linear regression to analyze the data.

  9. Doesn't correlate with my enjoyment either by Crashmarik · · Score: 2

    So not really surprised on this one.

    1. Re:Doesn't correlate with my enjoyment either by Anonymous Coward · · Score: 0

      Ghostbusters 2016 is certified fresh on Rotten Tomatoes, so you didn't enjoy that one? Why do you hate women?

    2. Re:Doesn't correlate with my enjoyment either by Rakarra · · Score: 1

      Ghostbusters 2016 is certified fresh on Rotten Tomatoes, so you didn't enjoy that one? Why do you hate women?

      Rotten Tomatoes does have one major flaw in their methodology, which is one reason why Metacritic has been getting more popular too: If you take 10 critics, they all give one movie a "Eh, this is decent, I guess. Wasn't horrible" review, and they all give another movie a "OMG, this is the best movie of the year!" review, those will end up with the same Tomatometer Score: 100% positive reviews. So some movies that are rated higher have very soft support. Now, I suppose the idea is that with a large number of critics, it would average out enough to reflect more the consensus of how good it really is, but I don't think that's true, even if they had a much larger pool of critics.

  10. The public's ratings are cool by ToasterTester · · Score: 3, Insightful

    The professional reviews are usually way off base loving or hating a film. I go by the public's reviews for a better idea if movie is worth my money. Even then you have to factor in the fanboy effect that will sway the numbers for the first day or even first weekend. Fanboy's are worse than the critics they like anything by . For fanboys its a competition more than if it's good or not like whole Marvel vs DC crowd the Star War fans versus the masses.

    I say ignore the professional critics check the reviews of the masses, but factor in if they have a fanboy following.

    1. Re:The public's ratings are cool by Solandri · · Score: 1

      The professional critics' reviews tell me if the movie is well made, has an intriguing plot, good story development, etc.

      The public's reviews tell me if the movie is enjoyable to watch.

      Best case, both sets of reviews will be high. But when they diverge, the above is usually what I find.

      The bigger problem is ratings inflation. I tend to rate things pretty neutrally. i.e. On a 1-10 scale, the average movie score I give will be a 5.5 (actually it'll be closer to 7 because I use review sites to avoid the really bad movies). But there are lots of people whose average score is a 9 and the lowest score they've ever given a movie is a 7. (There are also people whose average score is a 3, but there tend to be fewer of them.) Review sites try to compensate for this by normalizing scores (basically grade the movie on a curve). But for anonymous reviews this means that my "Ok" rating of 7 gets turned into a "poor" rating. To really normalize properly, you have to give up anonymity and normalize each reviewer's ratings before compiling the scores for all reviews. (Amazon has the same problem. The average review score for all products is about 4.5. So having 4-star reviews doesn't necessarily mean the product is good.)

    2. Re:The public's ratings are cool by Rakarra · · Score: 1

      Review sites try to compensate for this by normalizing scores (basically grade the movie on a curve). But for anonymous reviews this means that my "Ok" rating of 7 gets turned into a "poor" rating.

      It seems like they should be normalizing based on a curve that is specific for each user, not on aggregate. With anonymity turned on, I DEFINITELY wouldn't trust review votes (way too gameable), but even with it off, user reviews are self-selecting. You're more likely to rate a movie higher if you've seen it because you were already pre-disposed to liking it because you had an interest in seeing it. So the people who might think the new Iron Man movie is shit might not rate the movie at all because they hadn't seen it because they had no interest in it. And then you'll get a bunch of people who say 'I hated that trailer, I'm not wasting my time with that movie, so I'll give it a low rating.' User ratings are absolute chaos.

  11. Mirrors by Anonymous Coward · · Score: 1

    In tomorrow's news, Quasimodo blames mirrors for ugly reflections.

  12. Now compare it with Marketing by houghi · · Score: 1

    Now look at marketing expenses and see if there that ads up.

    --
    Don't fight for your country, if your country does not fight for you.
  13. I don't believe their ratings by rickb928 · · Score: 1

    Rotten Tomatoes caters to trolls that love to have certain actors, directors, or genres. They also cater to the effete that are above the fray of mere entertainment.

    Rotten Tomatoes gets no views form me, and when I see the rating, a low score ensures I will be entertained and go through an extra half bucket of popcorn. the lower the better. I just want to be fascinated, or at least overwhelmed by the spectacle.

    Sometimes I agree, such as with La La Land, but sometimes we disagree; Keeping Up With the Joneses was funny enough, and I was entertained.

    But, but, the movie industry may not know what is appealing beyond comic-book universes and sex. I know too many who do not care to go to a movie. Reserved seating and recliners are both reducing room size and revenue. Concessions will price people out soon. 4K HD may be good enough for direct-to-home releases. Oh, wait, that's called Netflix. Woops.

    --
    deleting the extra space after periods so i can stay relevant, yeah.
    1. Re:I don't believe their ratings by Megane · · Score: 1

      (Perhaps you meant "love to hate"?)

      Here is a perfect example of how out of touch their """critics""" are. The critics score is at 17% now, but I saw it as low as 11% yesterday. (The episode aired a day and a half ago.)

      --
      #naabhaprzrag, #sverubfr-000, #agi-fcbafberq, negvpyr[pynff*=' negvpyr-ary-'] { qvfcynl: abar !vzcbegnag; }
    2. Re: I don't believe their ratings by rickb928 · · Score: 1

      Spell check

      --
      deleting the extra space after periods so i can stay relevant, yeah.
  14. Correlation Lack Does Not Equate to Causation Lack by Anonymous Coward · · Score: 0

    Word!

      Yours,

      Fuckface Pruitt

      The E.P.A.

  15. Especially in recent year by Lucas123 · · Score: 2

    Rotten Tomatoes seems to get it wrong -- at least from the professional reviewer's standpoint. The audience rating is something entirely different, though. That said, I've also had to question that as well over the past year or so.

    1. Re:Especially in recent year by thegarbz · · Score: 1

      Rotten Tomatoes seems to get it wrong

      Rotten Tomatoes doesn't do anything. They are an aggregation service. It's the reviewers whose opinion you don't agree with. Mind you I tend to find my enjoyment of a movie compared to its critical review is highly dependent on the genre and how mainstream the movie is.

      A mainstream action movie that has a junk rating typically I find is junk. A fan service movie on the other hand can go any way. Bonus points for getting all political with complaints of casting choices, and for missing the entire point and focusing only on the quality of a story.

    2. Re:Especially in recent year by Anonymous Coward · · Score: 0

      I can explain that in one word: bots.

      For an enlightening case study, see here.

  16. Proper statistical treatment by I've+Got+Three+Cats · · Score: 1

    Without seeing a scatter plot of the data, or other diagnostics such as, outliers, leverage, or residual plots, there's no way to assess the validity or make inferences about the result.

    The low correlation may be because the relationship is not linear, there are outliers, the data is bi-modal, etc.

    There's a lot more to this stuff than running CORREL() in Excel or Libre (but not if you simply need something to blog about of course).

  17. Box offices aren't attended by movie critics by guruevi · · Score: 1

    People that are critical about their entertainment or have a broader taste simply don't go to the cinema. I personally would never go, family and friends that kind of want to relive their childhood with all of the last few years' remakes, still go.

    Especially on MetaCritic you can find the difference between general population and review critics. What critics find good, the general population doesn't and vice versa.

    Personally, I don't find most critics very useful because they often do not understand the subtleties behind things like Kingsman or they are pushing the stuff from major studios (most of the recent Bay movies or comic book adaptations get amazing reviews from critics).

    --
    Custom electronics and digital signage for your business: www.evcircuits.com
  18. Where did the reviewers watch the film? by magusxxx · · Score: 1

    Theater? DVD? Download?

    Think of theater viewers as the beta testers. After it's released on DVD/download, those are the real world users who are more likely to make negative opinions heard.

    --
    Care killed the cat, but satisfaction brought it back.
  19. The article doesn't even make sense by Anonymous Coward · · Score: 0

    What exactly was the research trying to prove? The article doesn't make it clear at all. What are they classifying as "good" or "bad" performance at the box office? Take a movie like Batman v Superman, for example. That movie made $873 million world wide. Is Bergquist counting that as a good or bad preformance? BvS probably made all of it's marketing and production budget back, but that movie was expected to break $1 billion. If Rotten Tomatoes didn't exist, and audiences had gone into the movie blind, instead of hearing about BvS's 27% RT score ahead of time, would it have still made only $873 million? That's the real discussion that Hollywood is having over Rotten Tomatoes, and there's nothing in the article that makes it clear if Bergquist's research is covering that.

  20. My Metric by Anonymous Coward · · Score: 0

    M = CASE WHEN LGBTQ_theme='t' THEN
          2*Users + 0.5* Critics
    ELSE
          2*Users + Critics
    END

    Then I go see/stream the movie with the highest M.

  21. No, Hollywood, It's Still Your Fault by Anonymous Coward · · Score: 0

    I understand the need to blame someone for your financial "woes" this summer but you won't succeed. The slump is still your fault for making films for small kids instead of adults. The largest segment of the population is still the aging baby boomers. To maximize your income you must make intelligent and thoughtful films in all categories that appeal to a mature audience.

    Instead, what have you done? You filled up the screens with cartoons and comic book movies, most of which were pretty bad. We want originality, imagination, and intelligence.

    Just in the science fiction category, I got excited about Life until I realized it was a lame remake of Alien. You wasted the talent of some really good actors on that one. I also got excited about Valerian until I realized it was just another comic book movie with the visual gags turned up to maximum. I've already seen The Fifth Element. Fail.

    You want me to go to the theater? Make movies that I want to see.

    1. Re:No, Hollywood, It's Still Your Fault by Opportunist · · Score: 1

      Intelligent and thoughtful films? For boomers?

      If you're right and boomers make up the majority of people watching movies, my money would be on Michael Bay.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:No, Hollywood, It's Still Your Fault by Anonymous Coward · · Score: 0

      For me a thoughtful character piece is just the kind of movie I'd never go to a cinema to see. The only reason to pay >$10 to see a movie is because it in some way needs the huge screen and sophisticated sound system to make the movie worthwhile. That almost always means a big budget sci-fi or comic book movie. If all the movie is about some people talking to each other I can see that in the privacy of my own home on my 50 in TV.
      Valerian had absolutely nothing to do with the comic of the same name. It was junk.

  22. Rotten tomatoes _are_ the reason by Anonymous Coward · · Score: 0

    Of course rotten tomatoes are the reason for bad office performance. But that's not the fault of the review site with the same name.

    I mean, what do they expect when doing a poop emoji movie? Seriously?

  23. Hollywood creativity is at an all time low by Anonymous Coward · · Score: 0

    tl;dr;

    Maybe the movies just suck. Work harder Hollywood .

    I think Hollywood creativity is at an all time low. Instead of remakes sequels maybe work a little and create something people actually want to see. Also, I was only a casual of Rotten Tomatoes, but now that Hollywood wants to shut down anything that may help me I'll be sure to check the site before each purchase.

  24. 150 movies? Are you kidding me? by Maxo-Texas · · Score: 1

    Not that I disagree with the findings (don't care either way)...

    But, that's a ridiculously tiny sample size.

    Let's test it over 15,000 movies.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  25. Hack critics are the problem by Anonymous Coward · · Score: 0

    The problem is that too many movie consumers listen to farce reviews from hack critics who are nothing more than failed filmmakers, and whose only purpose in life it seems, is to seek retribution by tearing apart the work of successful filmmakers.

  26. Hollywood needs to stop pointing the finger. by Anonymous Coward · · Score: 0

    Hollywood is currently in scapegoat mode. They feel the ground slipping beneath their feet and they are constantly trying to find the reason. Every single time one of these articles comes out it's trying to blame something outside of Hollywood itself. Not once has someone in Hollywood looked inward, realized there's a complete lack of creative diversity, creative coherence, or god forbid creatively new ideas within their product, and understood that (some) people are utterly fed up with the dreck they continue to produce at a prodigious rate.

    Slow down film releases, make a truly quality product that draws whatever crowd it is you think you're targetting, maybe open up your distribution model a bit (get with the times and allow same weekend streaming for ticket price?) and you'd see your profits begin to rise again.

    But no, we've got a few more years of death throws and finger pointing to go before any of that happens, if it ever does.

    On the bright side, I'm looking forward to the creative surge that takes place once the movie-making world gets as weirdly independent and fractured as the music production world has become over the last ten to twenty years. That could bring some real entertainment to the table.

  27. Rotten Tomatoes doesn't affect me by JohnFen · · Score: 1

    Because I've more-or-less given up on the ability of the mainstream movie industry to make movies that are actually great anyway.

  28. explain please by Anonymous Coward · · Score: 0

    WTF is a "7% correlation" or a "12% correlation"? I think I missed this in stat class with all that talk about Pearson r and such.

  29. Makes sense by pdfsmail · · Score: 1

    Amazing trailers and ads = High expectations
    High expectations = lots of sales
    When your movie ends up sucking = lots of people with bad reviews

    Similar thoughts when you reverse it.

    Seems legit.

  30. wrong context by Anonymous Coward · · Score: 0

    I think he was noting that the article that claimed about a week ago that RT was the cause of bad summer movie sales was wrong.

    https://nyti.ms/2xcAtwv

  31. This is why I ignore what critics say by Targon · · Score: 1

    For decades, I have seen how the movies that have critics excited either bore me to tears, or disgust me. I can see when something is well done from a production standpoint, but the stories in movies that critics love are the movies that I HATE. I remember when "Driving Mrs. Daisy" had critics saying how wonderful a movie it was....and yet, everyone I have ever talked to hated that movie. From decade to decade, you get years where this movie or that movie has the critics going wild and praising them, and every time, I find I hate those movies.

    Just because something is good from an artistic perspective does not mean the subject matter will appeal to audiences. There are times when movies make a statement about social injustice for this or that group, but it doesn't mean that the movie does more than just speak out about the issues. If it is about gay rights, women, African-American issues, or whatever the statement is, no matter that I may agree with the message of rights for EVERYONE, it doesn't mean I, or many people, will really feel it is a movie to be watched multiple times. Until critics can think like normal people who are more interested in "is the story INTERESTING", outside of some message that the writer/producers/directors want to tell to the world, we will find the opinions of critics are worthless.

  32. Several things by DarthVain · · Score: 1

    First off how "good" (putting aside "ratings" for a second) a movie is has only a limited baring on how "successful" (i.e. box office earnings) a movie is.

    A more likely correlation would be how much money was spent on promotion, how wide the actual release was, how many theaters it is showing in, how broad the audience is (not only in ratings such as "R", but also in content).

    Ratings, word of mouth, negative press may either impact A) someones decision to not see something they had intended to see, or B) someones decision to see something they had not intended to see.

    Indeed ratings can get difficult to compare apples to apples when either the numbers of contributors are really high, or really low. Generally speaking there are likely a lot of small independent films that critics might love (yet have few reviews both in critics and viewers), yet it isn't going to do the same as a big blockbuster that happened to be terrible.

    There a a lot of movies, particularly aimed at younger audiences when they are going to go see no matter what the reviews were like.

    Anyway I am sure it has some impact, but bottom line the box office earnings are a bit more complicated than how it was reviewed.

    My most recent example, is I wanted to go see The Dark Tower as I saw the promotions, and I've read some of the books, however I saw how poorly it did on RT, but also saw how well Logan Lucky did, and without knowing much about it decided to go to that instead (and it was good).

    I'd also be very careful/critical about how accurate those box office numbers actually are, as Hollywood doesn't exactly have a pristine record when it comes to fiscal honesty, considering they have their own word attributed to their "accounting" practices.

  33. Because critics don't matter anymore by Opportunist · · Score: 1

    Everyone is his own critic now. With previews, "leaked" trailers and whatnot, and on top of that a load of YouTubers who make movie critics in between their other stuff, who gives a shit about "professional" critics anymore? If anything, they're seen as paid shills that will like whatever movie has the biggest marketing budget to pay them off.

    Also "good" movies are not necessarily what will be a box office hit. What is a good movie? Well, take, say, 6th sense. Was a great movie. Great actors. Great acting. And a really awesome surprise at the end. But are you going to buy a second ticket to see it again? Hell no. You already know the plot twist and seeing it again... well, no.

    Now compare to Transformers... hell, any of them. All of them combined don't make enough of a script to last one single cartoon TV show of the series, the acting is rotten, the dialogue is ... umm... there is dialogue? Oh, you mean the quiet part between the explosions with the noise that sounds like humans. Yeah, maybe. But the FX! Wow! Blows your mind! Let's go see it right again, and you gotta see it on the big screen, it just ain't the same at home on TV.

    And this is why critics' opinion is worth jack shit when it comes to box office revenue. There are awesome movies out there, but many of them are just as awesome at home on TV.

    --
    We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    1. Re:Because critics don't matter anymore by JohnFen · · Score: 1

      are you going to buy a second ticket to see it again? Hell no. You already know the plot twist and seeing it again... well, no.

      A truly great movie does not rely on a twist ending for its entertainment value, and can be enjoyed just as much (but for different qualities) on repeated viewings, despite knowing the "twist".

    2. Re:Because critics don't matter anymore by UnknownSoldier · · Score: 1

      Exactly.

      The "amateurs" are doing a MUCH better job then the paid shills. Who can forget:

      * Mr Plinkett's Star Wars Phantom Menice review, and
      * Cinema Sins

      When the commentary is better then that crap that passes for movies you know there is a serious problem!

      > There are awesome movies out there, but many of them are just as awesome at home on TV.

      Just having control over the volume, drinks & snacks, and CC alone makes it worthwhile to stay home.

      --
      "Fuck Movie Theaters - they suck." -- Unknown Soldier 2017

    3. Re:Because critics don't matter anymore by Opportunist · · Score: 1

      True. With people being polarizing like crazy by more and more movies, watching people lose their shit when talking about those "controversial" movies has been way more entertaining than any of the movies themselves.

      And I didn't have to sit in a movie theater for any of that entertainment!

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
  34. Taste... by VeryFluffyBunny · · Score: 1

    As the old saying goes, "There's no accounting for taste." Crap movies often do really well at the box office, but then that's just my opinion.

    --
    Debate is a form of harassment. Do not question my truth.
  35. Simple by Anonymous Coward · · Score: 0

    As we have long known, reviewers are a bunch of snobs who who will rate a movie poorly because it offends their sensibilities or has silly humor that they don't get.
    They will rate a movie highly when it has a boring plot about some slave that did absolutely nothing of consequence (hint we don't all live in the US and suffer from white guilt).

  36. 7-12% correlation? by PopeRatzo · · Score: 1

    Bergquist's findings confirmed that of the 150 movies surveyed, there was only a 12 percent correlation between a movie receiving a bad score and not performing well at the box office. Summer films saw even less of a correlation, with seven percent of lower-scored movies not performing at the box office.

    Maybe I'm not looking at this the right way, but isn't the fact that a website is having anywhere from a 7% to 12% correlation with box office numbers kind of significant?

    --
    You are welcome on my lawn.
  37. But...isn't this a bad thing? by hackel · · Score: 1

    The fact that box office returns don't correlate with the actual quality of films (assuming there is a correlation between that and critic reviews in the first place, which I believe there is), is a BAD thing. It just means that the army of marketing assholes from the motion picture industry is succeeding in their mission to trick us and push their shoddy products down our throat. Great news for the studios, of course. Bad news for the rest of us, indicating that we're just going to continue seeing mostly garbage coming out of Hollywood.

  38. Shit movie by Anonymous Coward · · Score: 0

    Of course, nobody knows it was a shit movie when purchased a ticket. If they knew, they wouldn't have bought a ticket. Boxoffice numbers don't matter. DVD sales are more telling.

  39. Of course not by Anonymous Coward · · Score: 0

    Sadly these days a movies success is far more related to the skills/budget of the marketing department rather than how good it is. Some absolutely awful movies blow the box office up while ones with an actual story flop. I think you're just as likely to find a good movie produced by one of the streaming services (Netflix, Hulu, Amazon) as you are to find one at the box office anymore.

  40. You have to watch it to review it by cordovaCon83 · · Score: 1

    Assuming that most of the Rotten Tomato users aren't reviewing a pirated copy of a movie, one review, good or bad, equals one ticket sold. Unless the movie was so bad that you demanded your money back from the theatre, but it seems a little disingenuous to review a movie that you didn't even watch all of ;)

  41. Summary is WRONG by WrongMonkey · · Score: 1
    If you follow the links back to the original source, Rotten Tomato score DOES correlate strongly with box office gross(p=0.4-0.6). But production budget and audience scoring have stronger correlations with box office gross (p=0.7-0.8). And that critic scores have not historically (pre-2010) correlated with production budget (no surprise), but more recent critic scores (2016, 2017) do correlate (p=0.79, p=.77).

    So the conclusion is that box office gross is not caused by RT scores despite the correlation.

  42. Proving that by easyTree · · Score: 1

    In this climate, even bad movies generate doh.

  43. Because movie sales are based on hype by OrangeTide · · Score: 1

    The opening week determines the excitement that moviegoers have about the film BEFORE they see it. Not what artistic or even entertainment value the film may have after further reflection. The whole thing where the media announces some record sales is carefully controlled PR as well, and really only has a very short term impact on public perception of a film.

    That said, reviews by non-professional critics tend to follow immediate trends and it becomes a popularity contest. A lot of people like what other people seem to like, if only briefly. These sorts of reviews are basically garbage and obtaining a high signal-to-noise ratio is a requirement for review aggregation like Rotten Tomatoes to provide any value to visitors. Executed poorly, reviews become a popularity contest equivalent to the worst high school mock election and reveal more information about the reviewers than about the material they review.

    --
    “Common sense is not so common.” — Voltaire
  44. How about correlation with marketing budget? by bluepuma · · Score: 1

    So there may not be a correlation between "Box Office Mojo numbers" and "critic and audience score", but how does the spent marketing budget play into this? I assume if you plaster a city with movie ads, more people will go and watch. So if you want high box office numbers, you can buy them with advertising.

  45. Sure they don't, fine by AbRASiON · · Score: 1

    But I still prefer them over IMDB scores, which have been flooded with the lowest common denominator children / tweens and adhd style people who just think anything that's "ok" must be "uhhh I dunno? 9 or 10 I guess? it was ok!?"

    Nope.

    RT seems to more match my style, if a film is a 7.5 on IMDB and at least a 6.5 on RT, you can /probably/ rest assured, if it's a genre you enjoy, it's going to be an ok watch.

  46. I never check rotten tomatoes tbh by Anonymous Coward · · Score: 0

    I mean, I know about it, but can't be assed to ever check it.

    If I ever do it's about movies I was never going to see anyway, or movies I've already seen.

  47. duh. by Anonymous Coward · · Score: 0

    lots of people such as myself love shitty movies.

  48. Short explanation by Anonymous Coward · · Score: 0

    ... a movie receiving a bad score and not performing well at the box office.

    Viewers work on attending a good movie. They don't work on avoiding a bad movie. There are probably marketing and social engineering factors for this skewed behaviour