Slashdot Mirror
Lies, Damned Lies, And Gaming Statistics
Thanks to the IGDA for pointing to a recent Chris Crawford-authored piece discussing the unreliability of statistics that reveal an ever-more diverse gaming public. The piece cites a recent Entertainment Software Association study and suggests that, because they don't reveal their methods or sources, "...the ESA results are unscientific. We can't place any confidence in them because we have no idea what they really mean. It doesn't matter how representative the sample is or how large it is or even if the researchers wore white lab coats." The ever-controversial Crawford goes on to argue that "Games people are smarting about the tawdry, unhealthy image that their industry suffers", and then offers a way out: "What's especially sad about this is that the solution to these problems is obvious: start making respectable games."
Numbers are critical to a game's success and in the past the industry has got the shaft in tracking sales for the most part. The industry-dominating NPD TRSTS don't even include Wal-Mart. Who's fault is that? No idea, but we really need to start modeling Japan's method. Each week they have it down pat.
BS. I don't give a shit if games are respectable or not - I want fun games, that's all.
Do not be alarmed. This is only a test.
If you look at the most popular games of all time, (I have in mind Tetris, Final Fantasy, Unreal Tournament, GTA, Pac-Man, The Sims, WarCraft, Mario, well, you get the idea . . .) they are all fun. That's the point. But they are all respectable in their own right.
The reason violent and brutal games are fun is because games involve conflict, and the most basic type of conflict is physical violence/confrontation. It is also the easiest type of conflict to understand, and resolve. (Guy is in my way, kill him)
It is much easier to make a game where you have to kill all your enemies, as opposed to make them loyal and win their friendship and love. And besides, most of us do the more complex task in our daily lives anyway.
As far as comparing books and film to video games, the problem is interactivity. A person doesn't make choices in the two proven genres, but games are participatory. The future of game development is going to be intresting, because current game sales have been based on improved technology; not improved gameplay. (ex: UT v UT2003) The proven game genres are going to have to take a back-seat, and be modified to make some fresh ideas. Who would have thought games such as The Sims would have been so successful? What the game business needs is innovation, not this repetitive stagnation.
How that is going to come about has yet to be seen -- I don't have any ideas just yet.
Sig* sig = theOneSig();
To sum up the essay by Crawford, he complains that the published results are not scientific. Unfortunately, an original document doesn't seem to be available from the ESA site, so all we have are a number of websites quoting/summarizing the results. This, of course, is not scientific, since important background information, e. g. definition of terms, is lacking (as Crawford notes correctly).
:)
To be reliable, any measurement or experiment must be repeatable
So far, so good - but this, however, does not mean that they have to published. It would be nice, though. But the repeatability could also be made sure by peer reviewing the experiment. Of course I doubt that the research article was peer reviewed
My cats ate my karma. They also wrote this comment.
... Delivery Dates and Benchmarks.
Musicians don't die. They just decompose.
This is why you can't take surveys of your friends. If I did the same thing, I'ld get the reverse results, because almost everyone I know plays games more than they read books or go to the movies. Granted, maybe the people I know are wierd since most of them never see movies, but no wierder than his friends, many of which said 'never' to the video game question.
He does make a good pointabout how the ESA survey is flawed, but then he tries to make his survey sound better, and then he falsely accuses the game industry of being 'tawdry'.
For every Betty Bigtits there's a Mickey Mouse [movie]
There are plenty of Mickey Mouse games, way too many I'ld say. Go to Gamestop, look at the PS2 shelf, and count how many Disney games there are. Then count how many "Betty Bigtits" there are. There's one that comes close, BMX XXX, and it's probably not on the shelf anymore because it sucks. It was the game equivalant of "Gigli" for its popularity. There's no other games (Right now, the Lesuire Suit Larry series and the Atati porn games count as much as a 20 year old porno) that come close in terms of 'tawdryness'. Ok, there's Dead or Alive beach volleyball, but there's no nudity, and, unlike any porn movie, it provides fun besides just looking at the girls (girl who played it for months talking her!).
Finally he talks about how the game industry doesn't have enough independent games. While this is a problem, it can't be solved just by telling the game companies to support independent people. Where a book, or even a movie can be made by someone on their own, a game, a full-fledged mainstream competitive game, cannot be. Anyone can write a book, and, to a lesser extent, make a movie that could be competitive (watch "Clerks" sometime, you can tell that the guy had no money when he made it, but it's still a movie you'ld rent from Blockbuster like any other, unlike an independent game you'ld pick up because it's cheap). Untill any random person can make a game, there will be no good independant games.
"What is Internet Explorer 7? Are you saying we can't access the normal internet?" - I love tech support. Really.
(girl who played it for months talking her!).
'her'='here'
"What is Internet Explorer 7? Are you saying we can't access the normal internet?" - I love tech support. Really.
Very interesting article :)
"""The games biz has nothing like this; we have hobbyists who slap together amateur efforts, and we have big-time people who develop the mainstream products. There's nothing in between, which is one reason why the games industry is so creatively stagnant."""
I do not think that is so true. There are a few independant groups which make wildly popular games. eg Doom, snood, various other 'indies'. Over the last few years the indie game scene has really taken off. I think these people make games for a lot of people not into the mainstream games. For example many of them make games which will run on many computers, not just the latest ones.
A game like snood, for example has gotten very wide public attention(In the multi millions). I've meet a number of non gamer types who have played it. The same with the doom/quake series of games. People who didn't normally play games at that time gave it a go because it was so interesting.
Indie game developers can also afford to make games which do not sell lots of copies, because they are running more efficient businesses. For example instead of making 3-5% of each copy sold they can make 70-90% of each copy sold, and generally make games with much smaller budgets. They rarely do not sell as many copies as the publisher distributed.
Take a look at the igf.com, dexterity.com/forums/. From there you will find lots of indie games, and evidence of such a scene. Check out gametunnel.com, indiegammer.com for reviews of indie games. There are really good original games in there, but also a number of crap games(like other indie, and publisher funded entertainment areas). Also check out ludumdare.com where there are occasionally 48 hour game making comps. Some very interesting ideas have come from there.
Something like the Harvey Keitel effect*1 in pulp fiction is happening in other indie games. One occurance is where one/some of the makers of ufo XCOM are selling a game: Laser Squad Nemesis, http://www.lasersquadnemesis.com/.
*1 Harvey Keitel effect - Having a big name giving more reputation, expertise and funds to an almost unknown group, drawing more attention to it. Like what happened in pulp fiction with Harvey Keitel. Because people knew he was on board, other people agreed to work with them.
Have fun!
holepit.com
This person seems to be witnessing a completely different reality than myself and all those around me. We've either discovered travel between parallel dimensions or one of us is nuts.
There's another consideration here: why are such polls so common in the games biz? It's not just a marketing slant; everybody in the games industry passionately believes this nonsense. Question this dogma and you'll be regaled with anecdotes of unlikely friends and relatives who are avid game players:
Who passionately believes this? Not only are these statistics the biggest joke on every video game message board, chat room, or website I've ever visited, but if I remember correctly, even gaming magazines like EGM or TV shows like X Play have laughed them off. They're nothing but marketing propaganda and I have yet to see anyone take them to heart outside of a couple of ignorant, overzealous bloggers.
What's especially sad about this is that the solution to these problems is obvious: start making respectable games. There is absolutely no technical or design reason why games have to be so tawdry. Sure, the primary market of adolescent males much prefers the violent rebellious stuff, and the industry can continue to make billions supplying this market. But the games industry needs to learn a lesson that the movie industry and the book industry learned long ago: you gotta push the noble fringe. Every year there are dozens of high-minded movies that get funding. Most lose money, but a few break even. Hollywood is willing to fund these efforts for three reasons:
1. They support the image of cinema as an art form worthy of respect. Sure, Hollywood makes tawdry movies; moviemakers are certainly not above showing some skin to boost sales. But while there are plenty of individually sleazy movies, Hollywood's output taken as a whole is a healthily heterogeneous collection. For every Betty Bigtits there's a Mickey Mouse; Koyaanisqatsi played just down the road from Debbie Does Dallas.
See, this is where we really get into that "parallel dimension" stuff. This man appears to be from a world where games like Grand Theft Auto make up the majority of the titles available. A world where there is no Ico, Mario Sunshine, Wind Waker, Jak & Daxter, Sly Cooper, Ratchet & Clank, Sonic Adventure (and soon Sonic Heroes), Smash Bros., Crash Band--- y'know, I'm gonna stop here, because with every platformer review I've read lately complaining about the "glut of platformers" in the vein of Ratchet & Clank and Wind Waker pushing out all of the other cutesy platformers that are worthy of being played, I could go on for several paragraphs.
This author is apparently also from a world where the top ten list for American game sales isn't frequented by sports titles and platformers, but rather all of these "tawdry" games. In short, a world where BMX XXX sold more than two copies and returned copies of Enter the Matrix aren't cozying up next to E.T.: The Extraterrestrial for the Atari 2600 in a New Mexico landfill. A world where the game that GTA3 dethroned as the king of the North American sales charts for months on end was another tawdry, bloody game, rather than Gran Turismo 3 A-Spec. And, finally, a world where no one has tried out unusual, nonviolent games like Disaster Report (Zettai Zetsumei Toshi) and watched them fail miserably along with Ico, Rez, and Ikaruga, or occasionally watched them soar, like Gran Turismo 3 A-Spec, Dance Dance Revolution, or this little unknown game that's only released a couple of expansions... what was it called again? Oh yeah, "The Sims". I heard that game sold a couple of copies.
I live in a world where there are not only plenty of respectable games, but at least as many of them as the bloody games. The only place where that differs is in the media, where nightly readers/viewers were once regaled with equally innacurate depictions of the comic book and movie industries, and where the only thing that will change that is the passage of time.
"Tawdry" doesn't mean it has to have full out nudity. He's talking about how alot of games have rather juvenile sexualization of women.
Example: Was it really necessary to add big metallic nipples to the main female character in "Freaky Flyers"? How many girl gamers would be automatically turned off by such imagery on the cover of a game?
How about "Big Motha Truckers"? First it's got a stupid title that only a 16 year old male would get a kick out of, and then smack dab in the middle of the cover art is a chick with big tits. Again, instant turn off to most females.
"Outlaw Volleyball": Check out the game trailers and that's all I need to say.
If guys really need wanking material, why not just rent a porno instead of making such stupid games?
He's just pining for more of a "cultural" form of game. Like a Shakespeare vs Stephen King. There are too many Stephen Kings in the game industry. Also too many Mickey Mouses.
Eastern Front for the Atari 800, Balance of Power for the early Macintosh, and others.
He's also written extensively on game design.
Er... Shakespeare himself was, in his day and age, a 'Stephen King' in terms of your analogy...