Slashdot Mirror


Genetic Data Analysis Tools Reveal How US Pop Music Evolved

KentuckyFC writes: The history of pop music is rich in anecdotes, folklore and controversy. But despite the keen interest, there is little in the form of hard evidence to back up most claims about the evolution of music. Now a group of researchers have used data analysis tools developed for genomic number crunching to study the evolution of U.S. pop music. The team studied 30-second segments of more than 17,000 songs that appeared on the U.S. Billboard Hot 100 between 1960 and 2010. Their tools categorized the songs according to harmonic features such as chord changes as well as the quality of timbre such as whether guitar-based, piano-based orchestra-based and so on. They then used a standard algorithm for discovering clusters within networks of data to group the songs into 13 different types, which turned out to correspond with well known genres such as rap, rock, country and so on. Finally, they plotted the change in popularity of these musical types over time.

The results show a clear decline in the popularity of jazz and blues since 1960. During the same period, rock-related music has ebbed and flowed in popularity. By contrast, rap was rare before 1980 before becoming the dominant musical style for 30 years until declining in the late 2000s. The work answers several important question about the evolution of pop music, such as whether music industry practices have led to a decline in the cultural variety of new music, and whether British bands such as The Beatles and The Rolling Stones triggered the 1964 American music revolution [spoiler: no in both cases].

57 comments

  1. They worked out an algorithm to define genre by Anonymous Coward · · Score: 3, Interesting

    Quite a neat little trick. But making grandiose claims about defining the "evolution of music" is ridiculous.

    If tracking genre popularity had been their goal, they could have just picked up the sales figures for each year between 1960-2010 and pasted them into an Excel sheet. The people selling records already know what genre each record belongs to.

    1. Re:They worked out an algorithm to define genre by Anonymous Coward · · Score: 1

      But this was not their goal, they were categorizing based on what was in the music, it just happened to correspond to traditional categories as well.

      And with all of these Medium.com articles with nothing added, if this was the goal, Dice could just tell them that they should put a discussion board on their site and be done with it.

    2. Re:They worked out an algorithm to define genre by quintessencesluglord · · Score: 3, Interesting

      But it's not just popularity; it's relationships, and still the data used is flawed.

              Last FM genre tags aren't the most comprehensive (hence music nerds can get into endless debates about whether a band represents this genre or that genre), and it also assumes influence comes within the realm of popular music, and not less popular forms that get co-opted into pop music, and how those less popular lineages developed (as the trope goes, someone like the Sex Pistols never sold many albums, but what albums they did sell ended up in the hands of people who started more popular bands).

              More importantly, this study shows the flaws with quantitative vs. qualitative analysis; using the less descriptive measure as definitive just because it is supposedly "objective", and basically ignoring all other data that doesn't fit the model. They've proved they can measure what they set out to measure, nothing more. This has been most egregious in the soft sciences, like psychology, that tries so very hard to quantify data in an attempt at being definitive, and end up making absurd associations as that isn't the most useful analysis of the data on hand. Some music historians would have been able to point out the obvious flaws (like the progression of the Beatles throughout their history. Twist and Shout is miles away from Revolution #9).

    3. Re:They worked out an algorithm to define genre by invictusvoyd · · Score: 1

      Isn't there an android app for doing that?

    4. Re:They worked out an algorithm to define genre by Anonymous Coward · · Score: 0

      This. And also none of the ‘results’ are news and furthermore the trends by themselves don't tell us anything about the quality of the music or the preferences of the listeners. And even if it did, it would be immaterial anyway because there's no accounting for taste, people wouldn't change their preferences and they would continue to listen to whatever they're listening to. At best, it would turn fans of the ‘best’ genre into insufferable little twits who would quickly lose all their friends.

    5. Re:They worked out an algorithm to define genre by twitnutttt · · Score: 2

      Since when was rap the dominant genre for 30 years since the 80's?!
      Run DMC had one hit. Then there was Vanilla Ice ice baby. ;-)
      It wasn't until the mid to late 90's that rap became more mainstream with top selling albums like Dr. Dre and Snoop. You going to try to tell me that NWA was a hit outside of a niche?
      And I would say it hasn't really declined since the 2000's; rap has just sort of merged into other popular genres and become incorporated. I mean, who hasn't Pitbull collaborated with by now?!

    6. Re:They worked out an algorithm to define genre by Anonymous Coward · · Score: 1

      Detect and track autotune.

    7. Re: They worked out an algorithm to define genre by Anonymous Coward · · Score: 0

      But they didn't use the user created tags to define the music. Their algorithms detected that 'style 1' was different than 'style 2' they simply used the tags to give the computer generated categories names. They could have simply listened to some songs and seen hey every Metallica song is being assigned to category 3 that must be the Rock and Roll category. But that wouldn't be objective; thus database.

    8. Re:They worked out an algorithm to define genre by Anonymous Coward · · Score: 0

      Even more to the point than the Pisols were the Velvet Underground. Immensely important and influential band who apparently did not get out of the red with their record company and start receiving royalties until 1983.

    9. Re: They worked out an algorithm to define genre by Anonymous Coward · · Score: 0

      Metallica sound nothing like Bill Haley and the Comets.

    10. Re:They worked out an algorithm to define genre by Anonymous Coward · · Score: 0

      Funny contradiction if this comes from the same group: http://phys.org/news/2015-02-music-programmes-easily.html

    11. Re: They worked out an algorithm to define genre by ZipK · · Score: 1

      Metallica sound nothing like Bill Haley and the Comets.

      Perhaps that's true of Bill Haley & His Comets' classic sides from the mid-50s, though one could argue that Metallica's late-70s rockabilly singles drew upon Haley's rock 'n' roll country roots. More to the point, you seem to have never heard Haley's 1981 reunion album with the original Comets lineup. Many say that it sparked the entire death metal genre of the mid-80s.

  2. Geneological phraseology by Anonymous Coward · · Score: 1

    Conservation of genomic data is a large part of how evolution decides what is a trait worth keeping in the environment. What would be the next step would be to collate the phrasings dominant throughout each culture and see how they have been crossed with dominant sections to produce new offspring. It's probably the reason why eurovision contests have so much cheese, and american idol contests are dominated by singers that wow based on soul singing.

    Please cite or at least buy beer if used in any other sources.

  3. Genetic? Evolved? by Anonymous Coward · · Score: 0

    All I see is how they clustered songs based on their waveforms, correlated these clusters with genre tags and tracked market share over time. Nothing about how styles evolved from each other or, say, the history of specific musical "genes". Are they misrepresenting their research?

  4. Taking it further by lalleglad · · Score: 2

    As they are now using techniques from DNA analysis, it could be interesting if they took it a bit further and looked for 'chromosomes'.

    What if they expanded the actual tune analysis to the whole tune, and not just 30sec, and searched for parts of tunes that had been used in later tunes, or close enough to be thought of as heavy inspiration?

    A segment could then evolve, and perhaps even leap from one style to another, and after a few generations sound totally different from the original, but by this it could be traced back to where it came from.

    I think it is common knowledge that blues evolved to jazz and then to rock, but it could be interesting to know in more detail where styles came from, and perhaps where some popular tunes had their actual roots.

    1. Re:Taking it further by sumdumass · · Score: 1

      With almost perpetual copyright, that type of analysis will likely happen before long. But i think the results will only become public when someone thinks they can get a royalty fee from the old ending up in the new.

    2. Re:Taking it further by Ol+Biscuitbarrel · · Score: 1

      Someone once pointed out that a whole mess of hard rock tunes ultimately seemed to derive from La Bamba. You Really Got Me, Louie Louie, Blitzkrieg Bop, forget what else. Smells Like Teen Spirit of course was a takeoff on More Than A Feeling. You don't need an algorithm for this stuff. John Fogerty was famously sued by Credence's record label for ripping himself off - the ultimate in legal intervention in this instance - the case was dismissed. Haven't really heard of musical litigation since that happened in the late 80s.

      I don't know what "artists" are ripping off any more; I can't remember a single chart topping melody from the last 15 years, it doesn't seem to be necessary anymore. I think the music serves other functions well now, i.e., inducing tweens to scream in delight, giving young men soundtracks for their strutting/posing, etc. Why burden it with actual tunes?

  5. science, art, businesses by globaljustin · · Score: 2

    I like these kinds of questions, but one thing researchers have difficulty accounting for is the difference between the music people listen to and what the Billboard Top 100 chart says.

    Defining "pop music" as whatever is on the Billboard Top 100, especially now, is reductive. I understand it's quantifiable and that's the best idea they had for a quantitative definition of pop. However, Billboard's charts are virtually irrelevant when trying to ascertain what people **actually listen to by choice**

    Obviously, record companies try to game the system but in the last 30 years they using NASA level science (or attempting to) to control every aspect of the music in ways no one thought of before.

    Also: digital music production and software has made "pop" music so mass produced and generic you get things like the Nickleback debacle

    I'm not trying to be over-critical of the researcher's methods. I'm sure they did the best they could, but these points are important to understand when investigating this kind of thing.

    --
    Thank you Dave Raggett
    1. Re:science, art, businesses by Alain+Williams · · Score: 2

      Defining "pop music" as whatever is on the Billboard Top 100, especially now, is reductive. I understand it's quantifiable and that's the best idea they had for a quantitative definition of pop. However, Billboard's charts are virtually irrelevant when trying to ascertain what people **actually listen to by choice**

      Correct: it is talking about the sales of new records/CDs. This tends to disfavour long lasting styles such as classical music and boosts the here-today, gone-tomorrow junk that fills the 'pop parade'. This is exactly what the music industry wants, they need churn in taste and bands/performers/... to keep people buying their output.

    2. Re:science, art, businesses by swb · · Score: 1

      There seems to be a widely accepted school of thought within music journalism/critcism that gives significant weight/credit to obscure artists having a disproportionate influence to trends in music. Groups like the Velvet Underground, Big Star, the Replacements never had major popularity in terms of record sales and radio airplay but are often cited by music critics and other musicians as having been influential on bands and genres that were popular later on, in some cases 20 years later on.

      Tapping the Billboard 100 doesn't seem to take into account these "opinion leaders" influence, whether it was the music itself that was the inspiration or whether it was just the influence of music critics.

      It's pretty debatable whether a specific artist, especially one who had little popularity in their years of recording and performing, actually has this kind of influence or whether it just becomes kind of an orthodoxy of opinion that they had that influence.

      But often times it does seem that there can be breakthrough artists who manage to have outsize influence on artists who later go on to popularize a genre.

    3. Re:science, art, businesses by globaljustin · · Score: 1

      good points

      it comes down to 'case study' data vs interval numberic data

      sales is easy to quantify

      quality of art however....also, there is a novelty aspect as well, music listeners seeking out novel and "unknown" artists because they like to find new things

      "critics picks" can be all over the place

      --
      Thank you Dave Raggett
  6. Just Too Many Variables by mbstone · · Score: 1

    While the researchers in TFA took account of "harmonic" and "timbral" chnges, whatever that means, the study is still meaningless because it doesn't take into account:

    1. Changes in population demographics;
    2. Changes in recording technology, e.g. multitrack recording, use of digital effects such as delay, flanging and reverb;
    3. Evolution of synthesizer technology including sequencers, MIDI, etc.;
    4. Changes in distribution channels, i.e. obsolescence of physical media;
    5. Increases in the amount of music composed and produced primarily as motion-picture promotional tie-ins;
    6. Changes in radio audience measurement (ratings and their effect on playlists);
    7. DJ motivation for airplay, including payola.
    8. Changes in the way consumers access music, for example transistor radios, boom boxen, Walkmen,. iPods, smartphones, Sirius XM.

    I'm sure I could think of a dozen or so other factors. Nice try.

    1. Re:Just Too Many Variables by Paradise+Pete · · Score: 2
      All of those would matter if you were trying to figure out *why* it evolved the way it did. That's not what they're doing, so none of that matters. It's the difference between the fact of evolution and the theory that explains it.

      ----
      If I don't respond to replies it's not that I'm ignoring them, it's because for some reason Slashdot doesn't permit it. I also can't change my sig, thus this tacked-on text.

    2. Re:Just Too Many Variables by mestar · · Score: 1

      "5. Increases in the amount of music composed and produced primarily as motion-picture promotional tie-ins;"

      Oh, my good, now that you mentioned it, I notice how this analysis is completely worthless.

    3. Re:Just Too Many Variables by Anonymous Coward · · Score: 0

      I've worked with people like you. Any time someone has an idea you can't wait to shoot a thick wad of counterarguments, but somehow you never get around to creating your own shit. You monkeys aren't clever just because you think you can poke holes in studies. Anyone with half a fucking brain can show kneejerk skepticism. That's why your country is fucked; everyone's a genius at naysaying. Nobody knows how to agree and get things done.

      And by monkeys I mean code monkeys, not black people.

      (smafti)

    4. Re:Just Too Many Variables by Anonymous Coward · · Score: 0

      Any time someone has an idea you can't wait to shoot a thick wad of counterarguments, but somehow you never get around to creating your own shit. You monkeys aren't clever just because you think you can poke holes in studies.

      Isn't poking holes in studies the essence of science?

  7. justin is so freaking cool guy by Anonymous Coward · · Score: 0, Flamebait

    he has birthday today. I give you 1 million reasons why he is soooo coool:
    1. he has a monkey.
    2. he has a nice hair style.
    3. every single of his 0 contributions to slashdot is longer than bennett haselton's longest contribution -- which means is he the next bennett?
    4. he is sooo cool.
    5. bieber makes music. ... (stripped to satisfy lameness filter)
    1 000 000. he is a nice guy
    you can actually show your support for bieber by opening your asshole wide and make a picture of it, and then tweet it with the #happybirthdayjustinbieber hashtag on twitter.

  8. Interesting analysis by Anonymous Coward · · Score: 0

    But how do we reverse the 1991 change and get rid of all the crap that got popular after that?

    1. Re:Interesting analysis by camg188 · · Score: 1

      Why do you care what is popular?

      If 6 was 9...

    2. Re:Interesting analysis by PopeRatzo · · Score: 1

      If 6 was 9...

      Now you're talking about good music: http://youtu.be/Ui4ckbUNe3k

      --
      You are welcome on my lawn.
    3. Re:Interesting analysis by Anonymous Coward · · Score: 0

      Because there are many places where popular music is played. Life is nicer if that music is not to hard on the ears.

  9. 30 seconds per song? by QuietLagoon · · Score: 1
    I would offer that there is a significant portion of the songs they samples for which the 30 seconds of sampling would yield an incorrect perception of the song.

    .
    What they did was cool, but they tremendously overstate the ramifications of their efforts.

    How US pop music evolved, indeed.

  10. Should have been broader by Anonymous Coward · · Score: 0

    It would have been more interesting if the study had extended back through the 50's, the decade when rock almost completely destroyed what was then called "popular music".

  11. We Who Lived It Know! by JimSadler · · Score: 2

    The American Pie album said it all. The core of rock music transferred from the east coast to the west coast and not for the better. The type of music played by the Beach boys was an assault on Rock&Roll. You know us good old boys were drinking whiskey and rye the day the music died. Further, the three men I love the most the Father, Son and Holy Ghost packed their bags and headed for the coast, the day the music died. For decades Memphis was the music center of the US. There is a clear path towards Memphis from New Orleans and from Chicago. If one drew a radius with a 100 mile length from Memphis almost all noteworthy music in America would have been covered whether it was country and western, rythem and blues, rockabilly or rock and roll Memphis is the center of it all. From the Grand ole Opera to Elvis Presley to Dollie Memphis is the center.

  12. Re:PURE RUBISH. by BarbaraHudson · · Score: 3, Insightful

    Well, their methodology was crap to begin with. There's no weighing of each song based on sales, airplay, etc. And with the volume of crap hip-hip and rap out there from every self-proclaimed "gangsta", it was inevitable that the study would be biased towards the most produced, not the most popular.

    For those who don't quite follow, say you have 10 rock songs you really like, and 20 rap songs that you listened once and were tempted to delete. According to their methodology, you prefer rap because you've got twice as much of it.

    Same garbage wrt their comments about the British Invasion's effect on music.

    --
    "Transparent" is a shit show that trades on every stereotype going. A man in drag is NOT a transsexual.
  13. ... late 2000 ?! Time travellers by fygment · · Score: 1

    Oh, and the climate scientists would like a word to see how accurate their models turned out.

    --
    "Consensus" in science is _always_ a political construct.
  14. It's science! by Livius · · Score: 1

    There are obviously many limitations to the study and therefore to the conclusions that can be drawn, but it's very interesting to study music mathematically and discover (or confirm) patterns and experience new perspectives. This is how science makes progress.

  15. If you were about to be beheaded ... by Anonymous Coward · · Score: 0

    You wouldn't be wasting your time thinking about utterly useless and pointless
    crap like this.

  16. Interesting by Anonymous Coward · · Score: 0

    It's an interesting phenomenon how a piece of pure junk like rap can, in the first place, be called music, and, in the second place, dominate anything.

  17. Popularity is Guided/Controlled by s.petry · · Score: 2

    I have heard and seen numerous bands that don't get contracts or played on the radio because they don't fit the image and message that record companies "want", or don't play the games to get the contracts. That radio play time is what causes popularity, people know what they hear and can't know anything they don't hear. Take their title example "pop". The top female pop stars would not have become popular without a massive budget to advertise them and get their names out (telling everyone how it's a big star in the intro message). Until the VMA/MTV/(other award show) put up Miley Cyris and told everyone what a great artist she was who heard of her in the Music industry? Ariana Grande? Most of these people are only performers (actresses/actors) and purchase songs written for them that the producers tell them to play.

    Read up on what most bands have had to do to gain popularity and the advertising required to make it big. Most bands, regardless of genre, have to give up control of just about everything. Producers change lyrics, change music, change production and the artists have no say. Smart musicians may build some elements of control into their contracts, but if they do the wrong things they receive no air time or advertising.

    The study is wrong, because it negates the biggest reason for popularity. Advertising. The game is rigged, and most musicians know and admit as much.

    --

    -The wise argue that there are few absolutes, the fool argues that there are no probabilities.

  18. My Observations by kenj123 · · Score: 1

    I've looked over and listened to the top us sales hits since the 50s. In the late 50s us rock really picked up steam until 59 when Booper, Valens and Holly died. I really understand what the mclean lyric 'day the music died' means now. Until 64 Music really reverted back to the light weight pop tunes popular in the early 50s. Then throughout the 60s the british really dominated the top charts. America had a lot of really good rock bands but the break out was slow until the late 60s when mostly California and Southern bands started doing well. Then wham, in 70-71, Hendrix, Morrison, Joplan, Allman died. Light weight pop took over again in the early 70s, then disco and dance music in late 70s. 80s were a resurgance of rock but it seemed more corporate and marketing oriented, big hair bands. Early 90s the grunge rock, bass guitar was interesting but short lived, there is only so much you can get from a bass guitar. Since the mid 90 good guitar rock has been dead. thats my analysis.

  19. sorry by dwpbike · · Score: 1

    but it's always been about record industry manipulation. where do you think the "billboard" numbers originate?

    1. Re:sorry by kenj123 · · Score: 1

      so whats your point, record industry purposely keeps the music from the American people that they really want and instead sells them something else, presumably something else that makes them bigger profits? Or are you saying the billboard numbers are completely fabricated and people are really listening to something else that I've been missing out on all my life?

    2. Re:sorry by Whiteox · · Score: 1

      where do you think the "billboard" numbers originate?

      Try Tin Pan Alley which was the origin of the billboard numbers. Wikipedia has a good take on it. I'll quote below, that a lot of Rock and Pop actually came from Negro Ragtime, Cakewalk and Blues tunes, although Ragtime and Cakewalk were arguably White genre 'Black' music.
      "Initially Tin Pan Alley specialized in melodramatic ballads and comic novelty songs, but it embraced the newly popular styles of the cakewalk and ragtime music. Later on jazz and blues were incorporated, although less completely, as Tin Pan Alley was oriented towards producing songs that amateur singers or small town bands could perform from printed music. In the 1910s and 1920s Tin Pan Alley published pop-songs and dance numbers created in newly popular jazz and blues styles"
      https://en.wikipedia.org/wiki/...

      Honky Tonk (Tin Pan Alley piano)
      http://www.last.fm/music/Winif...

      --
      Don't be apathetic. Procrastinate!
    3. Re:sorry by Whiteox · · Score: 1

      Here's another:
      https://www.youtube.com/watch?...
      5 fingered Boogie - 1957.
      If you listen to the left hand bass line then you get the typical rock-blues fundamental with the right-hand lead on top.
      The transition from early blues to rock and pop to the crap today is pretty obvious. You don't need bad research to see that.

      --
      Don't be apathetic. Procrastinate!
  20. Rap, 'music'??? by Anonymous Coward · · Score: 1

    “ If rap is music, then falling off the roof is transportation. ”

  21. Jazz isn't dead by PPH · · Score: 2

    It just smells funny.

    - F. Zappa

    --
    Have gnu, will travel.
  22. Evolved? Thought it was just 4 chord songs :-) by UnknownSoldier · · Score: 1
  23. 1964 must have been a short year... by mjm1231 · · Score: 1

    “The British did not start the American revolution of 1964,” they say.
    The team say the data clearly shows the revolution underway before The Beatles arrived in the States in 1964...

    The American music revolution of 1964 must have happened awfully quickly. The Beatles played the Ed Sullivan show on Feb 9th, three weeks after their first single hit the US charts.

    --
    Ideology: A tool used primarily to avoid the bother of thinking.
    1. Re:1964 must have been a short year... by kenj123 · · Score: 2

      American rock was doing pretty good until 1959 when Booper, Holly and Valens died in the place crash, 'the day the music died'. For the next couple years the top music reverted back to lightweight pop crap. I'm not sure why and I am researching it some. I suspect rock music had a 'rocky' start in the US partly because of racism and religion. Once the British invasion started it wasn't black music any more, (at least you could pretend that).

    2. Re:1964 must have been a short year... by Anonymous Coward · · Score: 0

      Well, Chuck Berry and Little Richard didn't die in the plane crash. The remarkable thing is that there so few black rock'n'roll artists for so long after them. Maybe Jim Crow had a lot to do with it, but perhaps the tastes of black audiences and artists changed too.

  24. Shall I become a young Earth creationist? by Anonymous Coward · · Score: 0

    > Genetic Data Analysis Tools Reveal How US Pop Music Evolved

    That sentence makes me want to deny evolution. Evolution, from Buddy Holly, Elvis and Hendrix to Bieberach, Brittany and Gagaloid? No, thank you!

  25. Re:PURE RUBISH. by Anonymous Coward · · Score: 0

    Sorry Muslims, but I am behind the 1983 and the 1991 revolutions! Marked years in my doings, as I ve commented several people as of lately... Very impressive they came up with the two dates, but really... something similar should show up for these last years too.