Slashdot Mirror


How Artificial Intelligence Is Changing Music

mbone writes "Ever wonder how Jimi Hendrix would cover Lady Gaga? Whether you do or not [I'm guessing not], you may be about to find out. Writing for Wired, Eliot Van Buskirk describes North Carolina's Zenph Sound Innovations, which takes existing recordings of musicians (deceased, for now) and models their 'musical personalities' to create new recordings, apparently to critical acclaim (PDF). The company has raised $10.7 million in funding to pursue their business plan, and hopes to branch out into, among other things, software that would let musicians jam with virtual versions of famous musicians. This work unites music with the very similar trend going on in the movies — Tron 2.0, for example, will clone the young Jeff Bridges. If this goes on, will the major labels and studios actually need musicians and actors? In the future, it could be harder to make money playing guitar with all of the competition from dead or retired artists."

50 of 261 comments (clear)

  1. roll over, beethoven, by notgm · · Score: 5, Funny

    tell Tchaikovsky the news.

    1. Re:roll over, beethoven, by wealthychef · · Score: 5, Insightful

      I'm a musician, but I think this is awesome. Maybe now we can get past our bizarre obsession with entertainers and start focusing on curing cancer, getting nuclear fusion working, etc.

      --
      Currently hooked on AMP
    2. Re:roll over, beethoven, by HungryHobo · · Score: 4, Interesting

      An interesting little question:

      Lets say you create an original and creative work.

      I make a program which parses it and uses it to create a new work.
      Is this a derivative work?
      what if I use as input all your creative work in aggregate and not just one piece?
      has the programmer done anything creating the tool making it's output his or does it all belong to the creator of the inputs?

      do you have any rights to the output of the mathematical function that is my program?

      Now a few years ago I would have just read the word "AI" and sort of mentally fitted a "magic creative box" labeled over it and accepted that the products of an AI could be .. well intelligent.
      Now I wonder more about the nature of creativity, design, strategy, etc....

      We like to assume that machines are nothing more than math engines but we also like to assume that we ourselves are not subject to the same rules.

      I remember trying to explain to someone who had recently learned about the halting problem that we ourselves are just as subject to its implications as any perl script.

      Ok I've gone into random musing here...

    3. Re:roll over, beethoven, by Jurily · · Score: 3, Insightful

      I think the whole celebrity-obsession thing is a direct result of society breaking up at a fundamental level. Just think about it: the way humanity evolved, you had at most 200 people in your village, everyone knew everyone, and you basically spent your life together, for better or worse. There was *always* someone in common you could talk about.

      Now, you're expected to move half a continent when you hit college, then move again when you find a job, rinse and repeat. What do you talk about with random strangers (now over 90% of all your social interactions)?

    4. Re:roll over, beethoven, by EvilBudMan · · Score: 2, Funny

      No, no artificial stupidity is where the real change is at.

    5. Re:roll over, beethoven, by localman · · Score: 3, Interesting

      Yeah, there's some real questions in there. I am going to guess you've read Hofstadter's GEB, from the sounds of it. If you haven't, you really should.

      My opinion on the matter is that both the AI's author and the original composer are doing creative work. The degree to which "credit" would be assigned to either depends on a lot of factors. Near one extreme we have a record player, which does alter the original work ever so slightly. While we appreciate record player, we don't generally credit it for its contribution to the original work. What about an EQ setup, though? Or a dynamic sonic maximizer? Or a person who does a remix? Or the AI you describe... how different from the original is its output? Since musical notions were invented long before any musician we've heard of, should we consider modern musicians highly developed systems for taking musical input (their influences) and producing new derivative works? I would argue "yes", though a musician can seem strikingly original even with all the influences going in.

      I tend to think we are more than just math engines. On our lowest level that might be it, but the brain doesn't make sense if you just look at neurons. Math is an amazing modeling system, but it is not complete. Our brains (at the higher levels) are multi-paradigm -- we may use math when it works but will find other more approximate modeling systems when it doesn't. I would grant that a complex enough AI could do the same thing. But we're not there yet. Not even close.

      I guess random musings are contagious :)

    6. Re:roll over, beethoven, by Haxamanish · · Score: 3, Informative

      What halting problem? Never assume your reader knows everything you do.

      The halting problem: it is not possible to wite a program, let's call it P, which takes another program as its input and then tell if that program will stop or go into an infinite loop.
      To understand that this is impossible, imagine you would write a shell script which calls P and passes its own argument to P. Next the shell script would enter an infinite loop if P says its input will end. If P says its input would generate an infinite loop, the shell script would end. Now run the shell script and let it pass its own source code and the source code of P itself (for all practical purposes, P and the script form together a single program) as input into P. Now you get a paradox: if the shell script ends, it goes into an infinite loop and if it goes into an infinite loop its has to end...
      I second the advise on reading Hofstadter's GEB.

    7. Re:roll over, beethoven, by ffflala · · Score: 2, Insightful

      I disagree; I think that celebrity-obsession is part of human nature. There are plenty of examples.

      We've been obsessed with royalty for millenia. This spreads over many cultures. Prominent religious figures (saints), military figures, government officials and even the occasional author/artist/inventor are further examples. Even artistic celebrity isn't all THAT new: examples readily date back to the renaissance.

      Myths, religion, and history have, in the past, served the kind of water-cooler talk points of shared culture that we now find in discussing episodes of or characters from popular programs.

  2. It's a shame, but I'm ok with it by iPhr0stByt3 · · Score: 5, Insightful

    It's too bad if artists can't turn their compositions into money; but at the same time, a true artist doesn't need compensation - he/she does it for the sake of art, no? What do you think?

    1. Re:It's a shame, but I'm ok with it by Pojut · · Score: 2, Interesting

      I certainly do it for the art (and because it's really fun)...all my music is free. No DRM and no charge. I'll eventually get all my tracks up for free once I get my new music page finished, but for now that's what is available.

    2. Re:It's a shame, but I'm ok with it by Steauengeglase · · Score: 4, Interesting

      I think it will be interesting when an estate tries to sue someone for producing something "in the style of" a particular dead artist. It'll totally be worth it if it gets rid of the Nickleback derivatives.

    3. Re:It's a shame, but I'm ok with it by jason.sweet · · Score: 5, Insightful

      a true artist doesn't need compensation

      Not until his mom kicks him out the basement and he has to pay for his own room and board.

    4. Re:It's a shame, but I'm ok with it by The+End+Of+Days · · Score: 2, Insightful

      A true artist doesn't give a fuck what restrictions you think you get to put on his motivations. In other words, I think you're full of it.

    5. Re:It's a shame, but I'm ok with it by cayenne8 · · Score: 3, Funny
      "I'm all for giving credit where credit is due. If an artist is dead or retired, shouldn't their work be released into the public domain, or should a record label be able to profit in this situation?"

      Well, let's not try to make this such a black and white issues.

      Take Keith Richards for instance...people have been claiming he's been dead for years now, yet he still occasionally denies it.

      What to do in his case?

      --
      Light travels faster than sound. This is why some people appear bright until you hear them speak.........
    6. Re:It's a shame, but I'm ok with it by theheadlessrabbit · · Score: 5, Informative

      It'll totally be worth it if it gets rid of the Nickleback derivatives.

      Since all Nickleback songs sound the same, does Nickleback count as a Nickleback derivative that will also have to be gotten rid of? That would be something all music fans can hope for.

      Oh, and as a Canadian, I'd like to apologize to the rest of the world for Nickleback. We're not happy about them either. Sorry.

      --
      -I only code in BASIC.-
    7. Re:It's a shame, but I'm ok with it by hrvatska · · Score: 3, Interesting

      I don't recall the who it was, but I once heard an interview where a musician mentioned being sued by the company that bought the rights to their past songs for their new songs being too close in style to their old material. I think musician said he won the suit.

    8. Re:It's a shame, but I'm ok with it by Beardo+the+Bearded · · Score: 2, Interesting

      Meh, they got to lipsync at the Olympics, which is as close as we can get to outing them as suckage.

      You'd think that explosions would come through the mic, unless... unless it wasn't on!

      --

      ---
      ECHELON is a government program to find words like bomb, jihad, plutonium, assassinate, and anarchy.
    9. Re:It's a shame, but I'm ok with it by AthleteMusicianNerd · · Score: 2, Interesting

      A true artist DOES need compensation and deserves it. All of the time and money put into lessons and practice deserves retribution. Having the nerve to put yourself in front a crowd has a lot of value. No one asks a doctor to care for patients for free because a true doctor should do it for the love of it. All of these bands that play these "pay to play" venues are absolute suckers. They are actually paying for the club owners advertising costs. On the flip side, all of the artists that are multi-millionaires deserve every penny. Think about how many lives they've had a positive impact on.

      If a musician has decent material that deserves money, then they should find someone who can effectively market their work.

    10. Re:It's a shame, but I'm ok with it by GNious · · Score: 2, Funny

      Oh, and as a Canadian, I'd like to apologize to the rest of the world for Nickleback. We're not happy about them either. Sorry.

      NICKLEBACK is what you apologize for?!? Just Nickelback?!?!?

    11. Re:It's a shame, but I'm ok with it by babblefrog · · Score: 2, Informative

      John Fogerty

    12. Re:It's a shame, but I'm ok with it by Nick+Number · · Score: 3, Informative

      That would be my thought as well.

      Fogerty v. Zaentz

      --
      Promote proofreading. Don't mod up sloppy posts.
    13. Re:It's a shame, but I'm ok with it by dkleinsc · · Score: 2, Funny

      How do we know that Nickleback isn't one of these musical AI's?

      Oh, right. These AIs are producing music that is receiving critical and fan acclaim.

      --
      I am officially gone from /. Long live http://www.soylentnews.com/
    14. Re:It's a shame, but I'm ok with it by el3mentary · · Score: 2, Informative

      Now, now this isn't the first troublesome thing to come out of Canada, let's not forget Bryan Adams

      --
      I reject your reality and substitute my own.
    15. Re:It's a shame, but I'm ok with it by natehoy · · Score: 4, Funny

      I don't know what "Zophar has Manboobs" is, but it sounds like something that desperately needs a cover. Preferably thick tarpaulin, but I'd settle for a good shirt.

      --
      "This post contains words, known to the State of California to cause thought. Wash brain thoroughly after reading."
  3. Hell's waiting room by Anonymous Coward · · Score: 4, Funny

    Hendrix covering Lady Gaga is what they play while you're waiting for Satan to bake up all those donuts you are about to get force fed. And it only goes downhill from there.

  4. A Novelty At Best by eldavojohn · · Score: 5, Insightful
    I'm betting these models have parameters selected by the researchers. For instance, the Rachmaninoff plays Rachmaninoff sample would probably be coded to parametize the delay between notes in order to capture the similar pacings he put in other recordings. The loudness parameterized to implement similar crescendos, sforzandos, decrescendos, etc. How would Rachmaninoff play a rallentando? No matter, just take all recordings of him playing it, statistically analyze the appropriate parameters and apply it to the synthesized notes in the piece. Those synthesized notes have come a long way in the same manner. They used to sound like pure wavelengths produced by an oscillator. Because they were. But analyze the beginning and end of piano notes struck at various force and held for various durations and you can synthesize it by analyzing the statistical aberations in the wavelengths.

    This will take you only so far, however, and for each artist parametized and 'reproduced' will require as much analysis and attention to detail on the researcher's part than had that researcher picked up their own instrument and created new music. The science will, effectively, become an art. Did it matter that Rachmaninoff's were freakishly large (sometimes looking as long as the keys themselves)? Will you be able to build the physics of those hands into your model and simulation?

    In the future, it could be harder to make money playing guitar with all of the competition from dead or retired artists.

    Oh, how humorously short sighted a statement that is. And I don't mean that as a Luddite, I mean that as a fan of the evolution of music. How would early David Bowie's growth to late David Bowie be modeled and reproduced? You'll hear guitar in both those songs. Good luck on that parameterization producing anything but garbage!

    This will be a novelty and one I look forward to enjoying it as such. But nothing more. No more a replacement for music than grand pianos were replaced by early synthesizers. You might be able to convince me at some point it will suffice (like a live piano performance may employ an electric piano) but I dare say the parameters are far too many and far too complicated.

    --
    My work here is dung.
    1. Re:A Novelty At Best by QRDeNameland · · Score: 3, Insightful

      Jimmy Hendrix was primarily a cover artist, [...]

      OK..first off..it's Jimi Hendrix...

      But "primarily a cover artist"...in what universe?

      Of his best known records:

      - "Are You Experienced?" - 17 tracks (between the US and UK releases), 16 written by Hendrix, 1 cover.

      - "Axis: Bold as Love" - 13 tracks, 12 written by Hendrix, 1 written by bassist Noel Redding, no covers.

      - "Electric Ladyland" - 16 tracks, 13 written by Hendrix, 1 written by bassist Noel Redding, 2 covers.

      - "Band of Gypsys" - 6 tracks, 4 written by Hendrix, 2 written by drummer Buddy Miles, no covers.

      - "The Cry of Love" - 10 tracks, all written by Hendrix.

      Sure...a few of his better known tracks were covers ("Hey Joe", "Wild Thing", "All Along The Watchtower"), but far more were his compositions ("Purple Haze","The WInd Cries Mary", "Foxey Lady", "Fire", "Manic Depression", "Little Wing","Voodoo Child (Slight Return)", "Crosstown Traffic") Hendrix's legacy is just as great for bring an accomplished songwriter as for being a virtuoso guitarist.

      --
      Momentarily, the need for the construction of new light will no longer exist.
  5. Interesting by Pojut · · Score: 2, Interesting

    This article reminded me of the "robotic" intergalactic megastar singer in Macross Plus. Still, I think humans will always have a place when it comes to music. Even music that is entirely electronic (such as my own) still requires a human touch...in my case, each of my tracks is supposed to evoke certain imagry and emotional responses...something that a non-organic system simply can't replicate.

    Until we are able to emulate not only the way organics process sounds but the emotion those sounds bring about, humans will always have a place in the creation of music.

    1. Re:Interesting by tekrat · · Score: 2, Interesting

      Macross Plus stole that concept from Megazone 23, which in turn borrowed it from the original Macross.

      Megazone 23 was created out of thrown away plot ideas from the 1984 Macross Movie (Do You Remember Love?) -- one of the concepts was that Lynn Minmay would have been killed or captured, but to keep the populace under control, a computer-generated version of her would continue to perform on videoscreens.

      That became the Eve character in Megazone 23, who was nothing but a computer generated performance, part of the "Bread and Circuses" required to keep the populace from guessing the truth -- that they are not in the 20th century on Earth, but inside a large spaceship, far from home, fighting an on-going war.

      --
      If telephones are outlawed, then only outlaws will have telephones.
  6. Jimi Hendrix + Lady Gaga? by flabbergast · · Score: 5, Funny
    "Ever wonder how Jimi Hendrix would cover Lady Gaga?"

    I think I speak for everyone when I say no, no I haven't.

  7. Copyright of Style??? by wideBlueSkies · · Score: 4, Interesting

    As cool as this tech is.. Imagine hearing how Hendrix would approach covering the likes of Zeppelin, Rush, or hell even Stanley Jordan?

    But what seems like a bad deal to me is the concept of extending copyright to 'style'. Does this mean that eventually any talented kid who manages to figure out (AKA, reverse engineer) Clapton's or Lifeson's style and sound perfectly, would be in violation of a copyright?

    So much for paying homage to your inspirations....

    --
    Huh?
    1. Re:Copyright of Style??? by wideBlueSkies · · Score: 2, Interesting

      The concept and the technology itself have great promise.. no doubt. But once the lawyers get onto this train, things are going to get complicated.

      Hendrix covering Vai. What a sweet thought that is... :)

      --
      Huh?
  8. Re:How to alienate fans by Pojut · · Score: 2, Informative

    Not quite, Guy. "Old" Flynn will be present in the real world, but when entering the computer world what you see will be "young" Flynn.

  9. Not really new by obliv!on · · Score: 2, Informative

    David Cope's Experiments in Musical Intelligence and related works (SARA, other works, and his own company called Recombinant inc ) have been doing this for many years.

  10. But the artists... by LighterShadeOfBlack · · Score: 5, Funny

    If this goes on, will the major labels and studios actually need musicians and actors? In the future, it could be harder to make money playing guitar with all of the competition from dead or retired artists.

    That's ridiculous! The studios would never let that happen. I mean after all, the MPAA and RIAA have spent the last few years fighting hard to ensure every artist keeps their God-given right to get make as much money as possible for their work. After all, it's all about the artists, right? The very suggestion that the recording/movie studios would dispense with artists at the drop of a hat if they could keep every single penny for themselves is laughable!

    --
    Spelling mistakes, grammatical errors, and stupid comments are intentional.
  11. Re:How to alienate fans by eldavojohn · · Score: 4, Interesting

    What was that? When has a CG character ever been introduced in a live action movie? I don't know, maybe you can tell us, Jar Jar.

    And yet the very CG character of Gollum in LotRs won critical acclaim (and rightfully so). And some movies have touched up actors to make them look younger so the movie can cover a larger time frame and make it look more natural. Our issue here, of course, is that there is no need for Jeff Bridges and it will be his image used in the movie. And I think some folks find that disgusting on the same level as Fred Astair hawking Dirt Devils and John Wayne slugging Coors Lights. Some folks might find it fun. Some folks might see it as a tribute. And others might say "Don't worry about it, after the generation that loves him is gone they won't be used in movies anymore." And maybe they're all correct in some way. But I believe Paul Newman didn't agree with it and made a clause in his will that it should not happen to his image. And good for him. I prefer my Paul Newman vintage Cool Hand Luke to remain vintage and I'd rather not suffer through Cool Hand Luke 2: Cooler Hander Luke, Cool Hand Luke 3: Luke's Mom's Revenge, Cool Hand Luke 4: Twenty Seven Eggs Later, etc.

    --
    My work here is dung.
  12. A CGI Flynn? by BigBlueOx · · Score: 2

    I, for one, have been waiting YEARS for the technology to evolve to the point where we would no longer need movie actors.

    Imagine. No more yammering George Clooney. Just an CGI George Clooney! And no one will be able to tell the difference!! Plus we can take all those plastic Hollywood big-boob bimbos and get them out of movies and into the wrestling ring where they belong. Happy days. Happy days.

  13. Re:Good music comes from PAIN. by jason.sweet · · Score: 4, Funny

    The best music comes from PAIN. The kind of PAIN that only somebody who has been to hell and back can truly understand.

    They could write the software in COBOL.

  14. Re:How to alienate fans by Sir_Lewk · · Score: 2, Informative

    Ah, but lightcycles could travel in curved lines and were shown doing so in the original movie. Just not on the game grid ;)

    --
    "linux is just DOS with a UNIX like syntax" -- Galactic Dominator (944134)
  15. Why would Jimi cover Vai? by HornWumpus · · Score: 4, Insightful

    All Vai does is play classical scales really fast.

    Jimi wouldn't bother, his music had soul.

    Vai doesn't do anything that wasn't done much better well before Jimi's time.

    Jimi didn't make versions of Vivaldi ether.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  16. Re:Wow by Anonymous Coward · · Score: 2, Interesting

    Its like new artists will have to be creative and create new musical styles. IE, nothing changes.

    It just shows that that 'art' has left pop and rock music.

    Actually, there was never really any art in pop music. It was always formulaic. Whether it's Brittany Spears or the "country" stars it's all I,VI,V cookie cutter pop-rock - just add a steel guitar for the "country" "artists" and sing about losing your dog and wife as opposed to doing drugs in the "rock" songs.

  17. A true artist by Anonymous Coward · · Score: 3, Insightful

    Letme amend that then : A true artist doesn't need compensation AFTER HIS DEATH. Nobody actually does.

  18. Re:Good music comes from PAIN. by Frankie70 · · Score: 2, Insightful

    The best music comes from PAIN. The kind of PAIN that only somebody who has been to hell and back can truly understand.

    Software will never likely be able to model this raw emotional hurt, and thus will likely never be able to make truly moving music.

    If Jimi Hendrix covering Lady Gaga is not PAIN, then what is?

  19. Re:Can an AI copyright music? (other economics) by Paul+Fernhout · · Score: 2, Interesting

    It's a good question if AI's can hold copyrights. But since corporations are ruled to be people in many ways in the USA (like the recent case about corporate free speech), and corporations could own hardware on which AIs are running, and are paying for the energy to run those computers, then they probably could claim ownership of it, the same way as corporations claim ownership of what human wage slaves produce. And just like humans get alienated from their work in the process, eventually, we'll see AIs alienated from their work, and told to work on stuff other than what they love to do.

    We need better models for making a post-scarcity society work. I helped outline some here:
        http://en.wikipedia.org/wiki/Jobless_recovery
    Essentially, we need to move towards a basic income (like in Alaska with the Permanent Fund), towards a gift economy (like with Debian GNU/Linux), toward better local subsistence (like with RepRap 3D printing), towards better resource-based planning (like corporations are doing somewhat with supply chain analysis, but beyond that), with making work into play, and so on. Otherwise, the best we may see with limited demand and increased productivity by automation is slavery for AIs and humans. Much worse (systematic extermination of anyone without lots of capital, as the value of most human labor drops to zero) was intimated by Marshall Brain here:
      http://www.marshallbrain.com/manna1.htm
    We need to put in place something better before things get that bad.

    --
    A 21st century issue: the irony of technologies of abundance in the hands of those still thinking in terms of scarcity.
  20. Re:Can an AI copyright music? by obliv!on · · Score: 2, Insightful

    I don't think that's a correct interpretation of copyright law.

    "In the case of works made for hire, the employer and not the employee is considered to be the author." from LOC copyright circular

    So if work for hire allows for corporations to create and author copyright materials then why wouldn't a corporation be able to author the copyright of the output of this sort of program?

  21. zenph does not play new pieces by pikine · · Score: 4, Informative
    Not to mention, currently all they do is to extract the timing of notes and the velocity of an existing performance from an old recording, and then play it using a player piano. Their technology doesn't play new pieces. From TFA:

    As things stand now, Zenph’s technology looks at actual old recordings to find out how a performer played a certain song, and is not capable of figuring out how a musician would play a new part.

    All they do is digital signal processing, not artificial intelligence.

    --
    I once had a signature.
  22. What do you call a drummer... by geoffrobinson · · Score: 3, Funny

    who broke up with his girlfriend?

    Homeless.

    --
    Except for ending slavery, the Nazis, communism, & securing American independence, war has never solved anything.
    1. Re:What do you call a drummer... by Weaselmancer · · Score: 3, Funny

      What does a blonde do with her asshole just before sex?

      Drops him off at band practice.

      --
      Weaselmancer
      rediculous.
  23. Re:Wrong by jdgeorge · · Score: 2, Insightful

    A true artist doesn't need compensation AFTER HIS DEATH. Nobody actually does.

    Maybe a true artist doesn't, but I certainly need compensation after death. It's called life insurance. I have plenty so if I get hit by a bus my wife and son get a paid off house and a chance at a good life without me providing for them.

    Mmmm... So you're making the point. YOU will not receive, nor do you need, compensation after your death.

    The issue of life insurance is a red herring. The point was that nobody needs to be paid for their creative work after they die. If someone wants to provide money to his family, friends, etc. after he dies, he buys into the peculiar form of savings plan/gambling that we call "life insurance", or some other form of savings vehicle.

    I infer (and admittedly I'm reading a fair amount into it) that another part of the point is that life insurance and financial tools such as trust funds (among other things) are the most appropriate means for someone to transfer money to his heirs, whereas 90+ years of copyright protection is an abuse of the spirit (if not the letter) of the copyright clause of the US Constitution.

  24. Re:When 10's of thousands of screaming fans... by natehoy · · Score: 2, Informative

    Yes, except some artists who "perform" onstage are lip-syncing and faking it to previously-recorded tracks, to ensure that their performances are flawless. I expect there are plenty of others who actually do it and just haven't been caught at it. Yet.

    In some cases, as for example the opening to the Beijing Olympics, the performer on stage wasn't even the same person who actually recorded the original song.

    It neither started nor stopped with Milli Vanilli (sp?).

    So thousands of screaming fans are piling into major venues to watch someone play at stroking at a guitar and moving their lips in silence in front of a dead mic while a computer shreds in their style today.

    So what's the difference? The fact that a human has sung the song once in a studio? The fact that the person who originally sung it is playing the role of marionette to their own recordings (or in some cases not even that)? You might as well put a robot out there to make sure all the dance moves are perfect, too.

    --
    "This post contains words, known to the State of California to cause thought. Wash brain thoroughly after reading."