Slashdot Mirror


Is There a Formula For a Hit Song?

moveoverrover writes "What happens when two Rutgers grad students analyze 50 years of Billboard Top 10 hits with MIT offshoot Echo Nest's API and turn the data into visualizations for an assignment? Great looking visualizations for one, and a fascinating look at 50 years of Pop music at the data level. Posing the question, 'Is there a formula for a hit song?' the students write, 'What if we knew, for example, that 80% of the Billboard Hot 100 number one singles from 1960-2010 are sung in a major key with an average of 135 beats per minute, that they all follow a I-III-IV chord progression in 4/4 time signature, and that they all follow a "verse-verse-chorus-verse-chorus-bridge-chorus" sequence structure?' Using data extracted by Echo Nest on tempo, duration, time signature, musical key, as well as subjective criteria like "energy" and "danceability," the pair generated a number of visualizations with Google Motion Charts (warning: slow) and '(some) Tableau Results' for everyone to see and investigate. Curious about tempo and song duration trends in Pop music over 50 years? Correlation between record label and song tempo? Download the core data, the Tableau reader and look at it any way you want."

34 of 243 comments (clear)

  1. Is it the 1970s again? by s-whs · · Score: 2

    I remember reading about similar analysis long ago. Done in the 1970s IIRC. The programme that analysed also made a song from what I can remember and it was a hit of some sort (not sure which song that was, instrumental probably), but the article I read (1980s) noted that a second attempt didn't produce a hit song. So some variation is always needed beyond mere making a similar song. Does anyone remember/know which was that computer generated hit song?

    1. Re:Is it the 1970s again? by Canazza · · Score: 2

      Most of Rush's back catalogue.
      Everyone knows Geddy Lee is a robot

      --
      It pays to be obvious, especially if you have a reputation for being subtle.
    2. Re:Is it the 1970s again? by Nerdfest · · Score: 2

      Don't pick on Rush today dude, it's Canada Day (a national holiday). The world is in a sad enough state without starting a war with Canada.

    3. Re:Is it the 1970s again? by Anonymous Coward · · Score: 4, Insightful

      I heard a similar account from a buddy of mine who was in the recording industry back in the mid 70's. Someone did a bunch of metrics to determine the characteristics of a hit song and came up with some average: x% singing, y% cellos, z% electric guitars, a tempo between t1 and t2, etc. And then they made a song that had exactly all of that stuff.... and it sucked.

      A brief skim of TFA leads me to conclude that it's rife with half-thought-out research. The question they pose, "What if we knew, for example, that 80% of the Billboard Hot 100 number one singles from 1960-2010 are sung in a major key..." is completely meaningless if 80% of the entire population of songs, hits and non-hits alike, are in a major key... with a 4/4 time signature, etc. It's like determining that 100% of all coffee drinkers have faces. 100% of people have faces, so you haven't discovered anything different about the coffee-drinking subset.

      What you're looking for is what sets the "hit" population apart from the "non-hit" population. And, from what little I looked at, they don't address that at all.

      They also try to slap a linear regression onto everything. They assert that song duration is increasing. Umm, no... it was increasing during the 70's, and then it stabilized. And that probably had a bit to do with the formats that the music was available in (ie, 78-rpm records vs. 33.3-rpm...). But, again, we would only know that if these jokers looked at the average duration of *non*-hit songs.

    4. Re:Is it the 1970s again? by bennomatic · · Score: 2

      I found the video I was talking about in the above post.

      --
      The CB App. What's your 20?
  2. R&B Hit Generator by Anonymous Coward · · Score: 5, Funny

    R&B has a clearly worked out hit formula:
    http://img8.imageshack.us/img8/4185/rnbcreator2tf9.jpg

    Might be applicable to other styles such as pop, trance, rock...

    1. Re:R&B Hit Generator by Anonymous Coward · · Score: 5, Funny

      Some time back I wrote a lyrics generator inspired by Destiny's Child. It didn't have nearly enough strings to draw from, and I never got around to setting up proper weighting for the various phrases, but it was definitely producing authentic Destiny's child gibberish. Here's an example:

      I gon' trippin'!
      I gon' frontin'?
      you's actin' and you's actin'!
      Nine out of ten cat owners are trippin' as You been doing playin'!
      Why I see you movin'.

      you's trippin' 'n' I gon' actin'?
      Girls be like knowin'?
      I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
      Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?

      I gon' playin'.
      I gon' frontin' but Keynesian Theory makin' me think Why you thinkin' 'bout playin'.
      I trippin'.
      U frontin'?
      I trippin'.

      you's trippin' 'n' I gon' actin'?
      Girls be like knowin'?
      I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
      Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?

      better da street if he be actin'?
      Thems knowin'!
      I gon' actin'!
      I actin'.
      I be knowin' U be braggin'!

      you's trippin' 'n' I gon' actin'?
      Girls be like knowin'?
      I lookin' that to' be braggin' but Keynesian Theory makin' me think You been doing knowin'.
      Shell restated their 2005 financial results cuz they be keepin' it real as We actin'?

  3. Hot Song Science is old news by tepples · · Score: 3, Informative

    Hit Song Science has been around since 2003. See previous Slashdot story.

  4. So is that what we want, or the other way around? by Madman · · Score: 2

    There are 2 ways to look at these results. One is that out of all the music produced this formula is what the majority of people want to listen to, or it could be that this is what the record companies flog us because it's what they think we want to hear. Either way this is all that bands will be producing from now on, meaning less variety in music. It's a case of data driven choices gone mad.

    My next album title's going to be I-III-IV, should make me a million.

  5. Axis of Awesome by jonas_haase · · Score: 5, Funny

    Here is the entertaining version of this important discovery:
    http://www.youtube.com/watch?v=5pidokakU4I

    --
    bad spellers of the world UNTIE
    1. Re:Axis of Awesome by Creepy · · Score: 4, Funny

      As a cellist, I have to point out that this is all a refinement of the Original 1 hit wonder.

      Some of the same songs even ;)

      Technically this is 5 chords, but the 6th is often "skipped" by using a turn.

    2. Re:Axis of Awesome by coolmadsi · · Score: 2

      Slashdot has completely fucked up its interface to the point where links don't even open when you click on them. Right-clicking a link doesn't open up a menu, either. I had to look at the link through FireBug to grab the URL and paste it into a new window.

      If using Firefox, you can drag a link to the tab bar and it opens a new tab using the URL of the dragged link.

  6. Correlation and causation by Errol+backfiring · · Score: 4, Insightful

    Did they only look at the hits or also at the misses? There are bound to be enough songs that abide the "formula" but lack enough musicality to become a hit.

    --
    Nae king! Nae laird! Nae yurrupiean pressedent! We willna be fooled again!
    1. Re:Correlation and causation by mwvdlee · · Score: 3, Insightful

      Indeed, the trends they spotted over the years may also apply to all the songs that never quite made it to the top, or even into the charts.

      --
      Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
    2. Re:Correlation and causation by timeOday · · Score: 3, Informative

      That isn't a correlation v. causation problem. More likely it means the regularities found are necessary but not sufficient conditions. In other words they have identified *some* of the causes, but not enough to completely define it, as in write a hit automatically. But on that basis I agree it does not constitute a "formula" for making a hit.

    3. Re:Correlation and causation by Anonymous Coward · · Score: 5, Informative

      Hey there, I'm one of the authors of this study... the media picked this up and is sensationalizing the study. You are absolutely correct that we need to look at the misses too (in the form of a control group) to make any statistical correlations, which is what we are currently working on. What we did was simply make some observations of descriptive metadata using visualization tools. They have blown this way out of proportion by mistaking our hypothetical opening paragraph as the results of the study.

    4. Re:Correlation and causation by DjTjengel · · Score: 2

      If you read the intro on the project page a bit further: "To be clear, neither of the authors truly believe there can be an unchanging "formula" for a hit song, as much of what appeals to us in music is a combination of familiarity and surprise (Sacks, 2006). Currently, intangible notions such as emotional qualities also have a great affect on our experiences with music. However, while there are many outstanding questions, our inquiry may shine some light on a few characteristics that could increase the chances of a good song becoming a hit at a certain point in time."

    5. Re:Correlation and causation by Dan+Dankleton · · Score: 3, Interesting

      How about the songs that were hits but *don't* match the formula? Are you looking into those at all to see what's special about those?

    6. Re:Correlation and causation by sdellis · · Score: 2

      Yes, the outliers would be particularly interesting! But to clarify, we didn't come up with a "formula", just visualizations based on descriptive metadata. There are so many variables outside of descriptive data (peer influence, lyrical zeitgeist, etc.) that would require years of research if at all possible. This is simply one semester's final project. Our data set (a mashup of Billboard's open data and EchoNest's open data) is published on the study website: https://sites.google.com/site/visualizingahit/home We'd love to see what others do with it!

  7. Yes there is... by DamageLabs · · Score: 3, Informative

    ... and it was written ages ago

    http://en.wikipedia.org/wiki/The_Manual

    1. Re:Yes there is... by omarius · · Score: 2

      They're Justified, and they're Ancient, and they drive an ice cream van....

  8. Re:So is that what we want, or the other way aroun by hedwards · · Score: 3, Informative

    Pretty much any genre of creation based upon personal taste is going to have some sort of a formula that's pure lowest common denominator. The more likely explanation is that it's what record execs think will sell and consequently it's what they push. Way too often the songs that get popular get popular because they're frequently played, not because they're good.

    It used to be extremely unusual for songs on the radio to break out of a standard format and going beyond 2 minutes wasn't typically done.

  9. let me guess, use the same four chords? by Shivetya · · Score: 2

    Axis of Awesome, NSFW if on speakers

    http://youtu.be/5pidokakU4I
     

    --
    * Winners compare their achievements to their goals, losers compare theirs to that of others.
  10. Why not more lawsuits by tepples · · Score: 2

    All music currently in the hit parades are (at least partially) copied from songs popular years ago.

    If so many songs are being copied, why aren't there more plagiarism* lawsuits like the one over "My Sweet Lord"?

    * Plagiarism here means infringement with unattribution.

    1. Re:Why not more lawsuits by Maximum+Prophet · · Score: 3, Informative

      The copied songs might be owned by the same uber holding company that owns the original.

      Or the new artists got permission, but the original artist didn't want to be associated with that crap, but needed to get paid.

      Or the "original" and the copy both are using a well known ancient riff. (See Red Hot Chili Peppers' "Dani California" and Tom Petty's "Mary Jane's Last Dance"

      Robert Heinlein said, "Steal from the best, and file off the serial numbers".

      --
      All ideas^H^H^H^H^Hprocesses in this post are Patent Pending. (as well as the process of patenting all postings)
  11. Pop Is Getting Louder by damn_registrars · · Score: 2

    We've known this for some time, but it is nice to see it confirmed mathematically. Pop "music" is indeed getting louder over time. I suspect based on the loudness graph that the song they used for 2010 was that "you're beautiful" song that is practically whispered in comparison to other recent pieces.

    Now get off my lawn.

    --
    Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
  12. Re:Scum by LizardKing · · Score: 2

    You've been able to generate music based on algorithms with affordable software since the 1980's. A company called Dr T's produced sequencer software for the Atari ST that included sophisticated algorithmic generators - great fun to mess around with. Before that, analogue sequencers could be used to make music based on tweaking knobs or sliders, and the legendary Roland TB-303 bass sequencer also had a pattern based interface. Analogue sequencers are enjoying something of a resurgence in interest at the moment, with the web making it easy to market what are very niche machines. I'm saving up for one at the moment, having always wanted one since I first heard them used by a band called DAF.

  13. From the Authors by sdellis · · Score: 4, Informative

    Hey everyone, just want to clear up a few things. First, we never claimed to have discovered a "hit formula". The media glommed onto our hypothetical opening paragraph and apparently didn't pay too much attention to our results. Please read the study observations, not the articles, for the full story. This was for a data visualization class and we thought it would be cool to mash up the Billboard data with the EchoNest data. There is no "control group" as we were only observing descriptive metadata from "hit songs". We are working on doing some statistical analysis to look at correlations. However, the data is available and we encourage others to play with it as well. Cheers, Shaun and Thomas

  14. Re:genres and trends by carpenoctem63141 · · Score: 3, Insightful

    What if I told you that 90% of movements written in sonata form had the sequence structure 'Exposition-Development-Recapitulation'? What if I told you that blues used a lot of ii-V-I progressions? Nothing interesting in this study, move along.

  15. Complexity of Songs by cpscotti · · Score: 2

    No mention to Knuth's work of art?
    http://en.wikipedia.org/wiki/The_Complexity_of_Songs
    Isn't this slashdot?

  16. Re:Of course by Hatta · · Score: 2

    It's not exactly formulaic when you invent the formula.

    --
    Give me Classic Slashdot or give me death!
  17. Done before ... by sithlord2 · · Score: 2

    "The KLF" already wrote a manual (which is really called "The Manual" :-) ) on how to make a #1 hitsong. I think it was written in the late nineties.

    They more or less mention the same things. If you want to read it, google is your friend :-)

    --
    ...You are over-qualified and under-paid. If we give you a raise, we will break the cosmic balance of the universe.
  18. I-III-IV? by jfengel · · Score: 5, Informative

    Something from the summary really irked me: I doubt they'd find that the best songs use a I-III-IV progression. Pop songs practically all start with a I-IV-V progression. (Remember the lyrics to Hallelujah? "It goes like this, the fourth, the fifth...")

    When the III is used, it's usually minor, though the minor vi is more common ("The minor fall.."). The I-vi-IV-V sequence has been the basis of rock and pop since the 50s. Learn those four chords, and you can play practically any top 40 hit. (You know the guy complaining about Pachelbel's Canon? Most of them are really just using the I-vi-IV-V, which happens to mesh nicely with Pachelbel's real progression: I-V-vi-iii-IV-I-IV-V.)

    So I checked their data and discovered... nothing. Nowhere in their data do they talk about chord progressions. That's not really surprising, since figuring out the chord progressions is much trickier than figuring out the tempo. But they mention it in the summary. Why?

    Because that progression is so universal, of course you'd see it in the top 40 hits. You're also going to see it in the songs you've never heard of. If they really had found that I-III-IV was a frequent hit, they'd actually have learned something.

    This wasn't really intended as news. It's old stuff with new visualization applied. It's a student exercise passed off as research by people who don't actually know the state of the art, like the stories about "Students build 9,000 mpg car; why can't Detroit do that?"

    It just irks me that they're talking a little music theory and betraying their lack of understanding of music theory in the process. What I've just talked about is something every, EVERY musician knows.

  19. Yes, there is by gpig · · Score: 3, Informative