Slashdot Mirror
Evergreens: What The RIAA's Doing Wrong
Chris Johnson writes: "Recently I've been doing some heavy analysis of actual RIAA sales data, from the entire history of Platinum-certified albums. I've worked out a methodology that compensates for the explosion in CD sales and highlights ability to drive sustained sales over years. There's a top 10 list of albums and a top 10 list of the most commercially important artists in history with definite surprises- and the full lists as well, downloadable as text files, with Perl-friendly index numbering, so the analysis can continue with the annoying work already done! Perl folk, go nuts! The actual analysis takes this data and attempts to extrapolate from it and explain the competitive situation the music industry is in relative to Internet music in general, and what they are missing in their assumptions and plans. Should be interesting to see what people make of the Evergreens project! -Chris Johnson" Nice analysis of the history and future of music promotion.
I'll add that I have been kicking myself since halfway through for only noting down the product of those two fields and not keeping the fields themselves. The 'alphabetical' list is literally what I was typing in, record by record- at first because I wanted to get a quick look at the multiplatinum level, and then I was stuck either going back and starting again, or going on... Please do show up my inadequacy as a data analyst by going to http://www.riaa.com/Gold-Intro-2.cfm and making nice downloadable text files suitable for data munging that contain ALL the information you can get from that source, i.e. artist, album, release date, cert date of each certification. I would love it if you did that! Would have saved me days of exhausting and nonprofessional work. I'll further warn you that loads of the information is either missing or flat wrong, and must be corrected through cross-referencing with other sources- _this_ I did, well I thought.
There is no original files- what you see is literally all I have. http://www.riaa.com/Gold-Intro-2.cfm is the source for mining. If you mean it and have the facilities to do a better job at this, may I please, earnestly and in _total_ _sincerity_, beg you to do it? I'm not a data analyst: I'm a sound engineer dabbling in many other fields. If I'm not mistaken my own limited analysis is _the_ _only_ compiled data source of this information out there and publically available. Now that I've taken a shot at it, maybe someone or some open-sourcey group can get some people together and do it right? Nobody would be more pleased than I. Eighteen-hour days of data entry sucked...
I don't quite understand why this is a relevant measurement of album performance. It weights albums dramatically towards those that have been out longer - witness the absolute domination of the Beatles atop the list of performers, simply because their albums were released first. I like the Beatles, but this method of accounting doesn't make all that much sense to me.
Of course this study is going to indicate lackadaisical performance by the Britney Spears and N'Syncs of today's music world: their albums haven't had nearly enough time to build up the massive multiplier factors awarded to those albums from older, more established bands. If an album were to be released today that became an instant craze, selling 60 million copies in one year, it would take yet another year to eclipse a merely double-platinum album that had been released in 1970.
Clearly, the project is trying to weight away from such insane explosions of buying frenzy, and towards artists who have established careers practicing their craft. This is a noble goal, but explicitly multiplying by number of years since release causes older acts to automatically become more significant simply by virtue of being older; a one-hit wonder from the early eighties will outrank any number of career artists who started in the mid-nineties and show no sign of stopping anytime soon.
Perhaps a better weighting factor for the purposes of the study would be one that awarded different point values to different platinum events. An album's first platinum would be awarded a flat rate; subsequent platinum certifications could be multiplied by the number of years since the album's release. This could be somehow extended to artists, as well - artists who consistently earn platinum status could be rewarded, even if no individual album does extraordinarily well. If you haven't gone platinum in a while, you don't get awarded more points for rocking in your chair and reminiscing about when you were a star.
Now, Chris doesn't make any real bucks on this. But someone you might have heard a bit more about does... Heather Alexander, a Celtic fiddler/singer/songwriter, actually makes a living at this, both for herself and her hubby/agent. No, they're not rolling in it. But they're doing what they want to be doing, and making a living at it. I would call that success.
The point is, the music industry outside of RIAA is not dead. There are a lot of small labels working outside the box, and bands who get airplay on alternative stations and rackspace in mom and pop music stores... and a growing audience that does NOT listen to Top 40 anymore. When enough people figure out that there's more to life than "Oops, I did it again," RIAA will lose its stranglehold on the business, and the world will change. A very quiet revolution, but I think it's already happening, given the amount of noise going on in the courts....
No, I didn't get a dime for those shameless plugs, I'm just a fan. Deadhead-style band promoting is alive and well.
The time to look to the music industry for a career is over. There is absolutely no future in it. What this means is, other opportunities will be opening up.
... THEY'RE NOT LISTENING. Facts are Napster has boosted sales in music in some polls, and other polls state it has harmed it. Well only one can be right, and that one will forever be an opinion of someone's.
Opportunities have always been openining up, but this does not mean the music industry is going to die. This was an argument some time back only it was with the film industry when many invested in dot com companies who were going create movies for the Internet and about 99.999% of them all are on FuckedCompany.com.
It's a nice analysis done there but it means little to associations like the RIAA since
Try thinking about a wedding reception, do you see them playing mp3's at the ball? I highly doubt it. Do you think radio stations across the world would adapt to mp3's? Searching for a hit song on Napster or something similar? Nope won't happen, as long as record execs keep people happy with graphical cd jewel cases, promoting overblown parties, etc. Don't wanna make this long, but any argument any way you cut it would never be an unbiased one.
Want Root?
I threw together two scripts to compile the entire database into a CSV file (which may be imported into MS Excel or anything else that likes CSV.)
The first script, riaa_pull.pl uses LWP to pull all the data in it's original HTML format into a file called riaa.htm on your harddrive. Beware, this is 30991603 bytes worth of data.
The second script, riaa_parse.pl parses riaa.htm data for relavant info and creates the CSV file riaa.csv.
The riaa.csv file it created for me was 1596076 bytes and appears to contain the entire 16474 entries.
Scripts are here: http://g27.sourceforge.net/files
numb
In order for Johnson's "For everybody else" advice to succeed, we are missing a crucial element: a place for people to be exposed to music.
Sure, there's MP3.com, which I think is quite successful at introducing people to some new songs, but what is really needed are powerful independent webcasters, and the technology to give them an audience. However big net radio is today, it won't come into its own until the wireless networks allow you to listen to it in your car, or while jogging.
If wireless moves quickly enough, it's possible that non-industry people could even end up dominating this new "digital radio" market before their competitors (old school radio) ever wake up and do something about it. After all, a 128kbps stream is of far higher quality than conventional radio, and though webcasters pay for bandwidth, they don't have the enormous initial costs of a radio station, transmitter, and licenses.
What would this kind of movement do for music? Most probably, it would mean that in any city in the world, you could choose from several thousand radio stations, rather than a dozen. There would be stations that would cater to subgenres, playing music never before heard on commercial radio. And it would be a panacea for artists outside the system, who attract the attention of a DJ with a few thousand listeners, whose attention spreads the music from there.
Even more beneficial, the digital nature makes it easy to push the names of songs and artists to the listener, and facilitates purchasing: a song stream could easily embed an URL.
In short, grassroots digital radio is a promotional path for artists who are outside the RIAA system, and have no wish to become a part of it. It's also a godsend to the thousands of RIAA groups who are too small to be worth pushing on radio, whose talents languish because people are never exposed to them. Contrary to Clear Channel's opinion, some people really do like to listen to different music: even the good stuff gets boring after a while.
The major bar to this wonderful idea is that the RIAA has such a stranglehold on the market that it will be exceedingly difficult for independent operators to build up the critical mass of music that will keep the public listening. It wouldn't be such a big deal if the RIAA would allow webcasters reasonable access to music, but we all know that short of congressional action this is not going to happen. Perhaps the creation of a independently controlled rights management website would help: artists would indicate in some form the rights they give to webcasters, and perhaps the royalties they desire. If such a thing got big enough, even RIAA artists might demand the right to webcast their music in their contracts.
Competing with the RIAA/ClearChannel will be exceedingly hard. But hopefully that critical mass of webcasters, artists, and (!) lawyers is out there. I hope so.
My job is doing analysis using variations on Kohonen Self-organizing-maps and other unsupervised classifications techniques. We do classification and data-mining all many different types of data. I read this article and immediately thought I might be able to use the data to try and find some of the correlations mentioned in the article. Unfortunately, the data doesn't contain enough information. The only files that I saw had some magical number which is the the sum of each product platinum times the number of years since the album came out. The unsupervised learning algorithms should determine the calculated numbers, not a person. Where are the original numbers?
If the evergreen project wants any serious analysis to be done with this data, then they need to include the raw, initial data. This would be the year of each platinum album, the year of the record release, and any other relevant or irrelevant data. Please re-release these files with the original data so that a thourough analysis can be done.
I'd be happy to test out a few algorithms on the data.
Keeping
- Of the bands/albums listed there as "important", none are all that important any more. The success of Beatles "1" aside, hardly any of those artists have released what I would call a "hit" album in the past 10 years.
- No band will ever "come out of the blue" any more and hit it huge. There is no such thing as a non-manufactured band anymore. U2 is currently in the midst of a sold-out tour, but if they were starting today, it's likely they wouldn't exist. They owe their early success to a core groups of fans and a bunch of radio stations that were willing to play their music. Those stations are now essentially run by the RIAA. See these articles:1,2. Bands today such as The Dave Mathews Band are the rare exceptions.
- The RIAA's business model is focused around promoting a small group of artists through the radio and other media which they mostly control. Having "free" music available over the internet breaks this model. The RIAA companies will no longer be able to promote the artists they want to promote (ie, the ones that they feel give them the greatest chance of profit).
- The RIAA's biggest fear is that artists will be able to promote themselves and leave the RIAA out of the loop entirely. It's only a matter of time before this really starts to happen. Good riddance.
-S
--- What parts of "shall make no law", "shall not be infringed", and "shall not be violated" don't you understand?
The ranking index the author uses to measure long-term selling ability (millions sold x years aon the market) would weight an album that sold 1 million copies 5 years ago (and none in subsequent years) the same in long-term selling power as one that sold 2.5 million copies last year, 2.5 million copies this year, and will go on selling 2.5 million copies every year from now. Whether you agree with the conclusion or not, this is shoddy analysis.