Study Links Game Piracy To Critics' Review Scores
An anonymous reader writes "A new study (abstract) published at the annual ACM Foundations of Digital Games conference by researchers from Copenhagen Business School and the University of Waterloo explores the magnitude of game piracy on public BitTorrent trackers. The researchers tracked 173 new game releases over a three-month period and found that these were downloaded by 12.7 million unique peers. They further show that the number of downloads on BitTorrent can be predicted by the scores of game reviewers. Overall the current paper gives a seemingly robust overview of the state of game piracy on BitTorrent. Although the results may not be all that surprising, it's certainly refreshing to see a decent report on BitTorrent statistics every now and then."
As can be seen from the table below, the most downloaded games are all major commercial titles.
If the piracy is directly linked to review scores, it means that people just want the games for free and aren't that much interested in trying them out before actually buying them. Such argument would hold more water if it was said that game piracy is linked to overall sales, but here it's saying that the better reviews and comments from people games get, the more they are pirated too. The most sad thing is when people pirate indie games
Google+ vs. Facebook, and why Google+ will fail
How is a tautology even vaguely newsworthy?
This is really nothing new, a good example is Deus Ex: Human revolution, the 10-hour leaked demo (everyone has their suspicions the devs leaked it on purpose) has done amazing things for the game. Deus Ex: 2 was a horrible failure of a game, but after the 10hour leak they've seen an increase in pre-orders and the developers have pushed up the release date. This isn't the first game we've seen this happen with over the years, there have also been studies showing people who pirate music are more likely to buy it after.
The more higher rated a game is, the more people download it on BT?
Is that it? What an unexpected result.
Higher rated -> More people want to play it -> More people buy it OR More people download it
Simple.
Great news...
This way, we can ensure good confidence in the torrent stats !! Who's with me !!
TOGA !! TOGA !!
When I first read the title I assumed that they found out that games with lower scores get pirated more. This would have made perfect sense to me, since I understand the idea of "try before you buy", especially for games which are reported to be flawed in some ways. Then I saw that they didn't weigh the amount of pirated copies by the sales of the specific game, which then only shows that good games are popular.
Better game scores. Combating global warming. We should all be pirates
A lot of movies can be found on torrent sites. Would you like to download every single movie you've never heard of? you look up imdb.com and if it has a score of 6.5 or over in your relevant age and gender group you might give it a go.
Look at any torrent site and you might find a few obscure games you've never heard of. Quick stop in your trusted game review site might tell you if it's a waste of time.
Ultimately I think this goes to show that crap movies, software, games etc will not be had for free! let alone for a price. Sometimes you'd see an amazing review and find out you completely disagree. In a clothing store, you can buy a shirt, try it on and return it for a refund if you don't like it. Why can I not get a refund if I did not like a movie? I cannot be forced to pay for something I'm not sure I'll ultimately like. Judge a movie by it's cover?
Instead many people employ a different system. FIRST get it for free and SECOND if you think it's worth money, you pay. I'm not arguing morality, legality etc. Logically, this system is very handy.
What's this stealing thing you're talking about.
80 CC D8 AF AE D3 AB 54 B7 2E CE 67 C7
The best way to fight piracy is to make shitty games
...and in other news water is wet.
I guess companies should continue to buy or otherwise influence reviews.
I just skimmed the actual study and it doesn't really provide much more info. It does make the claim that their methods are closer to the true number of pirated copies and refreshingly that these are not necessarily correlated with lost sales. However it's conclusions aren't all that interesting. My guess? This was more about their measurement techniques and the outcome was tacked on so it could get published (or have a chance of getting published)
There are allot of pirated titles with massive popularity but its only for a short limited time. When people see its garbage they stop sharing and the torrent plumets fast while forums and IM chats fill up with bad reviews/experiences.
The music and movie industries have already tried that tack, and it doesn't seem to be working.
Is it just my observation, or are there way too many stupid people in the world?
Looking at the table presented in the article, their conclusion seems a bit odd...
Fallout: New Vegas - Downloads: 962,793 Avg. rating: 83.7
TRON Evolution - Downloads: 496,349 Avg. rating: 59.5
Starcraft 2 - Downloads: 420,138 Avg. rating: 89.5
"Metacritic Scores explain 10% of the variance in the unique peers per game on BitTorrent,”. I guess the remaining 90% is just noise then...?
Modern big budget games also have budget for grooming the major game reviewers (PCGamer UK I am looking at you) to give nice scores.
However, most gamers realize this and when they see a ludicrously high score they will be put off because they assume the reviewer must have been bribed in some way; hence they will download the game instead, expecting it, most of the time it is accurate, to be crap.
Given that more hyped games generally get higher review scores *regardless*, and more hyped games are more likely to be pirated just because there are more people who want to play them, I'd hardly say that a correlation like this can be used to say anything conclusive.
Who would pirate a bad game?
Better game gets downloaded more, well duh.
09F91102 no, 455FE104 nope, F190A1E8 uh-uh, 7A5F8A09 that's not it, C87294CE no. Ah! 452F6E403CDF10714E41DFAA257D313F.
It's like the story of Robin Hood where you take ("steal") from the rich and give to the poor (the "thieves"). More common day it's called "They owes me!", and, "They make a lot of money so won't notice.", and, "FU Man! I take what I can!", and this classic, "My boss stole my GPL!", only that's sort or pe/reverse.
researchers from Copenhagen Business School and the University of Waterloo
Did they use any the data from GGOTD?
See here's the thing, researchers are all full of shit. Who's payin them?
And why are they consistantly and frequently (like on a schedule) spewing out propaganda seed stories to later be leveraged into more and more web crackdowns isp rule changes, and fucking snoop laws, bandwidth caps and royalty arguments.
Meanwhile one thing that is consistant is the bigger your company or corporation the less likely it is to follow any fucking law or pay any taxes, instead of snooping and searching and destroying the open web, cops ought to be shortening the freedom of those running these TBTF banks and corporations and companies who don't pay any fucking tax or follow any laws anyway.
Or are we headed to a completely lawless society at odds with government?
These researchers don't even have their eyes open, but I will bet they get their money to talk smack from somewhere corrupt if you only follow the trail. Note how colleges don't like to talk about the Comprehensive Annual Financial Report, neither do teachers, or your local tv station. Seems to me there could be a profitable career in leveraging 5th grade math and semi-automatic weapons to audit the biggest criminals and officials at the top of the fucking ongoing ponzi. but everytime some propaganda seed story like this comes out, it's another hit to public freedom.
I thought it was obvious that the better games got downloaded more.
If someone linked the number of downloads with number of purchases I wouldn't be surprised if they were following the same curve.
..how they got the information in the first place. It is obviously impossible that they are analyzing IPs in their research. And of course, this study certainly didn't involve the sharing of such information by ISPs, various websites, and trackers. Hmm. "these IP's visited wikipedia to examine reviews of certain products, then were later observed downloading them on bittorrent." By the way, this could a be great way to find worthy cinema as well; just look at Rotten Tomatoes and MetaCritic reviews on wikipedia, then torrent the films of your choice. - Decreases the chances of wasting your time to download bad films.
Laws are like sausages. It's better not to see them being made. - Otto von Bismarck
tell news.
Most people are weak-minded!
How do you count downloads on bittorrent? At best, you can get a sketchy number of peers and seeds but how does that translate to actual downloads?
Also, how do those download numbers stack up against actual sales? Is there a method to determine what portion of these downloads represent actual loss for the companies (copies that were only pirated) versus what is essentially pre-sale test drives?
sig not found
They further show that the number of downloads on BitTorrent can be predicted by the scores of game reviewers.
Since the link is blocked at work, it would be nice if the summary actually included what the link was. I assume higher reviews correlate to higher piracy. Which is another way of saying popular games are pirated more than unpopular games, which is another way of saying popular games are popular, which ultimately says fuck all.
I've found that reviews these days can't be trusted, they gloss over serious flaws in games, hype up things as if they were paid adverts (most are), and ultimately don't tell you much are.
If a game gets a terrible score I don't forsee people pirating it, because it's probably actually terrible.
If a game gets a really high score people are going to be suspicious of the reviews, and rightly so in many cases, and the game will turn out to be NOT worth buying (that applies to so many AAA titles today it's not even funny)
If a game gets an average score, with a balanced review, it's generally trusted. No need to pirate, flaws are usually pointed out, you know what you're getting, a decision to buy it or not can be made.
The last game big commercial release I played which I would consider to be more than average, deserved of the high review scores and worth buying was San Andreas, and that was on the previous generation!
Good games get pirated more than crap games. WHAT A SHOCK. I'd of never of guessed.
The researchers appear to use appropriate language, but the article introduces the idea that downloads can be predicted from metacritic scores. Sorry, but accounting for 10% of the variance does not get you to anything like a prediction. As beef3k pointed out above, SC2 got less than half the dl's of the lower rated Fallout.
So we can say that game rating is an important factor in download volume, but without identifying a few more factors, it's useless for predicting downloads. Rating might be the most important factor, BTW, but from this article we have no idea whether or not other factors were identified or if any other single factor accounts for similar (or greater) variance.
actually what it says to me is that people look at what others say then dl if its seen to be interesting , then if its cool some might buy.
YOUR analogy is like , OH ya fred said its cool , ( off goes to download then never buys or donates ) WHICH is false. AND you've nickle and dimed kids soooooooo much the past ten years for gf cards and hard ware and internet and with caps and such and gay laws that even indie games will now be subject to this affect. I won't waste ANY money on crap. AND trust me ive dled and deleted probably 3 times as much as i have kept. I'm cheap and picky and im not rich enough to store all things.
This would be more interesting if it was also correlated with sales... Some things that aren't answered by the numbers in the article could indicate that a well reviewed game has higher sales, too. For instance, what if pirated downloads of those were a smaller percentage of sales than with less well reviewed games?
Just showing the review scores and the number of downloads is too far from a complete picture...
Actually, not even that. Here's what it should be:
"NEWS: Good games are both highly reviewed and heavily downloaded."
I see nothing in the article that would hint to causality. Especially with only 10% of the variance in downloads linked to scores - wouldn't you expect at least that much association just from both variables being linked to game quality?
It could have been interesting to show that reviews lead to a temporal spike in downloads. Of course, that would require reviews to be published after games ship, which often isn't the case.
Seriously, didn't they take some time to look at total sales for each of the games on there top ten.
Fall Out New Vegas: as of November 8, 2010 the game has shipped 5 million copies worldwide.
Darksiders: reached the 500,000 sales mark in its first two weeks
Need for Speed Hot Pursuit: On February 1 2011, on EA's financial result report of Q3 2010 was it mentioned that the game has sold more than 5 million units.
NBA 2k11: Since its release, the game has sold more than 5 million units worldwide.
TRON Evolution: NO DATA FOUND though it probably sold for crap, however buzz from the franchise tie in probably accounts more for download rate.
Call of Duty Black Ops: 13.7 million copies of Call of Duty: Black Ops had been sold in the United States alone.
Starcraft 2: As of December 2010, the game has sold nearly 4.5 million units
Star Wars Force Unleashed 2: No Data Found, though probably on this list because its star wars.
Two Worlds II: Most Likely caused by staggered release dates.
The Sims3: Late Night: Its the sims no duh it's popular.
So basically this study say, popularity = downloads not lost sales. Even at only 4.5 million units sold that is still $225 Million Gross from Sales I don't think that piracy has drastically cut into the bottom line of most of these games. Next thing you know someone in the industry is going to say total units sold correlates to higher piracy rates, and try to ban games selling to much.
The higher rated a game is, the more I at least want to try it to see if it's any good.
I often pirate games because very few companies these days seem to provide an adequate demo.
If the game can hold my attention for more than an hour and I enjoy it? I go buy it, these people deserve my money. (Fallout 3 was the last example of such)
If I find it just repulsing, mis-advertised, or just can't hold my attention for an hour? I delete it, and I've saved myself some money. (The Last Remnant, just, ugh.)
You think that's bad? In German, it's called a "Raubkopie" (robbed copy). Know what a Raubkopie really is? If I go into a store and hold a clerk at gunpoint to create a copy of a CD, then take the copied CD without paying.
In other words, there's no problem with "Raubkopien". I've never heard of anything like this happening, ever.
We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
Rather than developing expensive DRM solutions, publishers can cut piracy rates tremendously by ensuring their games get low review scores. Everyone knows that game sales are based mostly on hype, and ever pirated copy is a Lost Sale, so it follows that a game with a high hype to review score ratio will actually outsell a hyped game that also has high review scores.
Publishers pay for good reviews, only to have them pirated more as a consequence.
Lesson: don't artificially inflate your game's review score as it arouses suspicion and encourages people to 'try before they buy'.
In other news, shitwater brand bottled water will be changing their names...The CEO attributed the decision to a recent study showing that people care about the quality of products.
Those who review games without permission will be hauled into court (all records sealed, of course).
If correlation were causation, then that would mean that good reviews cause piracy. Which also would mean they found the root of their piracy problems. The easiest fix would be to get bad reviews. To do this just make really bad games. And BAM people will stop pirating them.
How is this study even useful? Am I missing something? I mean of course, I can't imagine pirating a game that has a 4 out of 10 stars in reviews any faster than I'd purchase it!
It's not a tautology. It's just incredibly obvious that better-reviewed games would be downloaded more on BitTorrent.
[To be clear a tautology is something that is by definition true, like ... "if a and b are rational numbers, then ab is rational".
That's not a tautology. That's a mathematical consequence. Tautology is a repetition of meaning. "a and b are rational" has a different meaning than "ab is rational", even though one can be shown to always imply the second. Otherwise you could say that the entirety of provable mathematics is tautologous.
No. GP has it right, and you do not. Tautology is not about meaning, it is about truth. Bertrand Russell's quote from the Wiktionary entry is particularly apt, here. The proposition "if a and b are rational numbers, then ab is rational" *is* tautological, because in the deductive modality, the conclusion is always implicit in the premise; there is no way to "deduce" a new truth via the deductive modality. One can only restate a truth that was already present in the premise, and that is what makes the deductive modality tautological. Think GIGO, replacing "garbage" with "truth". So, as you implied, the entirety of provable mathematics is definitely not tautologous. There indeed exists another modality that is not tautological. The other modality is inductive logic, which *can* produce new truths, rendering it non-tautological.
I wish I could get paid to just point out the obvious.
It's not a tautology. It's just incredibly obvious that better-reviewed games would be downloaded more on BitTorrent.
[To be clear a tautology is something that is by definition true, like ... "if a and b are rational numbers, then ab is rational".
That's not a tautology. That's a mathematical consequence. Tautology is a repetition of meaning. "a and b are rational" has a different meaning than "ab is rational", even though one can be shown to always imply the second. Otherwise you could say that the entirety of provable mathematics is tautologous.
No. GP has it right, and you do not. Tautology is not about meaning, it is about truth. Bertrand Russell's quote from the Wiktionary entry is particularly apt, here. The proposition "if a and b are rational numbers, then ab is rational" *is* tautological, because in the deductive modality, the conclusion is always implicit in the premise; there is no way to "deduce" a new truth via the deductive modality. One can only restate a truth that was already present in the premise, and that is what makes the deductive modality tautological. Think GIGO, replacing "garbage" with "truth". So, as you implied, the entirety of provable mathematics is definitely not tautologous. There indeed exists another modality that is not tautological. The other modality is inductive logic, which *can* produce new truths, rendering it non-tautological.
If a and b are rational numbers, then is ab rational? That depends on the closure of rational numbers, which I would argue is not part of the premise at all. You are extrapolating from assumed properties of the word "rational" which are not given in the statement.
Consider this: "if a and b are imaginary numbers, then ab is imaginary". The same syntax, but not even true. What if we define "rational numbers" to be imaginary? Then the original example isn't true either.
A variation of the original example that is tautological would be "if a and b being rational numbers is sufficient for ab to be rational, and a and b are rational numbers, then ab is rational".
Making bad games reduces piracy? We'll get to work right away!
How the hell did you make this leap?
If the piracy is directly linked to review scores, it means that people just want the games for free and aren't that much interested in trying them out before actually buying them.
How many of us has bought a popularly reviewed game, then found out it sucked? Maybe (as is common today) reviewers are basically being paid to give glowing reviews of crap. Maybe in spite of a game having mass popular appeal, it's just not my type of game?
Maybe you're just making a wild assumption with nothing to back it up, and assuming that everyone will accept it as a valid premise?
Game companies must love this as it shows them a solution to the piracy problem: they need to start* producing such crappy games that their ridiculously low review ratings will kill off piracy.
* Possibly they had reached this conclusion already and have been testing this (producing crappy games) for years.
It's unfortunate that we can't get a measure of the reason each person downloaded a game. That would be much more useful data than just seeing if games with higher demand are downloaded more often lol.
Of course, there is no way to get an accurate measure of the reason, because even with self reporting, I don't think the individual downloaders are always honest to themselves.
But it would cover a wide range: try before buy then bought, try before buy then didn't buy but only played an hour, try before buy then didn't buy but played the whole thing....
downloaded for the drm free version after buying
Seriously though, no one who downloaded Tron evolution would have bought it otherwise. Those are not in any way shape or form lost sales.
In any case, 12.7m downloaders seems exceptionally low to me. Has piracy dropped off? I mean, this is total over many games, but it seems really small. Maybe steam sales are finally winning out over download hassles?
That would be interesting. Does review score affects sold copies more than torrents, or not?
All the developers need to do is to make sure that their newest blockbuster games get extremely low scores on rating sites and nobody will pirate them - problem solved!