Slashdot Mirror


IBM Watson Created The First-Ever AI-Made Movie Trailer For 'Morgan' (popsci.com)

An anonymous reader shares a Popular Science article: For a film about the risks of pushing the limits of technology too far, it only makes sense to advertise for it using artificial intelligence. Morgan, staring Kate Mara and Paul Giamatti, is a sci-fi thriller about scientists who've created a synthetic humanoid whose potential has grown dangerously beyond their control. Fitting, then, that they'd employ the help of America's AI sweetheart IBM Watson to build the film's trailer. IBM used machine learning and experimental Watson APIs, parsing out the trailers of 100 horror movies. It did visual, audio, and composition analysis of individual scenes, finding what makes each moment eerie, how the score and actors' tone of voice changed the mood--framing and lighting came together to make a complete trailer. Watson was then fed the full film, and it chose scenes for the trailer. A human -- in this case, the "resident IBM filmmaker" -- still needed to step in to edit for creativity. Even so, a process that would normally take weeks was reduced to hours.

58 comments

  1. Good trailers? by Anonymous Coward · · Score: 1

    I did not think trailers take weeks to create. They do not look that good.

    1. Re:Good trailers? by Anonymous Coward · · Score: 4, Insightful

      Everybody thinks everybody else's job is easy.

    2. Re:Good trailers? by Anonymous Coward · · Score: 0

      Are you making trailers? If so what is so complicated about it to take weeks instead of days?

    3. Re:Good trailers? by brantondaveperson · · Score: 1

      They probably make many different versions, and then spend weeks trying to get everyone - from marketing through to legal through all the talent - to actually agree on them.

    4. Re: Good trailers? by Anonymous Coward · · Score: 1

      But those things wouldn't be expedited by an A.I. making the trailer...

    5. Re:Good trailers? by sexconker · · Score: 2

      Everybody thinks everybody else's job is easy.

      I take it you've never seen Dirty Jobs with Mike Rowe.

    6. Re:Good trailers? by Cylix · · Score: 4, Funny

      Not really. I think the guys around the corner building a highly efficient and flexible network stack have a tough job.

      Making a trailer isn't that difficult. Just take all of the scenes that detail every bit of the plot and slap them together. Once you have something that removes any potential chance of enjoying the film then it can be called complete. In some cases, when the film is so incredibly terrible, it may be necessary to fabricate a trailer that has barely anything in common with the film. Sure, you probably should have made that movie instead, but then we wouldn't have done all of this blow.

      --
      "You should always go to other people's funerals; otherwise, they won't come to yours." -- Yogi Berra
    7. Re:Good trailers? by Anonymous Coward · · Score: 1

      I certainly know people who do. You might as well ask why it takes so long to write a book. Or code. It's just text, you know?

    8. Re:Good trailers? by Anonymous Coward · · Score: 0

      Well, tell them they just need to pick about 3 minutes of best scenes from the movie. Slap them together. Maybe add some narrative which is not in the movie to introduce us into the story. And add an information at the end so what we know when the movie gets into the theatres/shops. Don't forget the copyright message or even an FBI warning!

      Programmers can be extremely quick when almost everything what is required is just copy/paste some code snippets. Unfortunately most of the time just copy/paste is not enough ... so it takes longer.

      When creating a trailer, I wanted to know what else is there except copy/paste and the final information about where to get the movie.

    9. Re:Good trailers? by Calydor · · Score: 1

      Slapping together a trailer of scenes from a movie isn't that different from slapping together a quick little program combining libraries someone else already wrote. It's not like the trailer maker has to go out and do a new shoot, edit for lighting and audio, add CGI effects etc. He LITERALLY has to watch the movie and at a few points go "Ooh, that looks awesome, that goes in the trailer!"

      --
      -=This sig has nothing to do with my comment. Move along now=-
    10. Re: Good trailers? by Anonymous Coward · · Score: 0

      The AI simply acts as the benevolent dictator

    11. Re:Good trailers? by Cederic · · Score: 4, Insightful

      Hmm, no.

      1 - you don't want your 'best' scenes in the trailer or people will go 'that film was shit, just watch the trailer'
      2 - you don't want plot spoilers in the trailer
      3 - your trailer will be targeted at specific audiences. Different elements from different scenes will appeal to different audiences
      4 - you want to convey specific messages with a trailer, and so its creation is an inherently creative task to assure this
      5 - trailers can be cut and edited differently to the film. E.g. cutting the middle from a scene to hide a plot spoiler
      6 - trailers can use scenes not included in the film. Some directors shoot scenes for the trailer
      7 - trailers need to make narrative sense in their own right. Shit, even people posting crap on Youtube do more than post a sequence of scenes from a film
      8 - trailers can fuck with a film's running order to support the above

      That's before you add in a trailer voiceover, interstitial text/images, the need for trailers to provide consistency between Cinema (three minutes of trailer) and TV (30 seconds), the need for trailers to keep consistency with other marketing and PR (cast interviews, written reviews, press releases, 'fluff' pieces, astroturfing, all the other shit the media industry do).

      But sure, just fucking slap together a trailer. Go for it. You clearly have a sparkling career ahead of you.

    12. Re: Good trailers? by AchilleTalon · · Score: 2

      Exactly that, instead of wasting and spending weeks in discussions about the trailers and possible trailers, they just accepted the trailer proposed by Watson. The discussion near the end about Watson creativity is pure marketing bullshit from IBM.

      --
      Achille Talon
      Hop!
    13. Re:Good trailers? by lucm · · Score: 1

      Slapping together a trailer of scenes from a movie isn't that different from slapping together a quick little program combining libraries someone else already wrote.

      npm install scene --save-trailer

      --
      lucm, indeed.
    14. Re:Good trailers? by Anonymous Coward · · Score: 0

      Everybody thinks everybody else's job is easy.

      I take it you've never seen Dirty Jobs with Mike Rowe.

      What's even more annoying is when it's someone who used to do the job, who got moved into management, who then starts bullying his employees because he doesn't remember how difficult the job truly was all those years ago and has a bad case of rose-colored glasses. My current manager recently expressed so much disdain for his own former discipline that I'm looking for a new job as a result.

    15. Re:Good trailers? by Anonymous Coward · · Score: 0

      Did you even read the summary? Watson chose segments of the film, and a human assembled the trailer. If Watson chose an exciting scene that contained spoilers, the human was probably smart enough not to include it in his trailer.

    16. Re:Good trailers? by ravenshrike · · Score: 1

      Ah, I see you graduated from the same school as both the Ghostbusters and Suicide Squad trailer creation teams.

    17. Re:Good trailers? by Anonymous Coward · · Score: 0

      >just take all of the scenes that detail every bit of the plot and slap them together.

      That, unfortunately, is how trailers are made these days. Point of trailers is to attract the audience into spending money at the film's showing. Intrigue, suspense, and a 'few' action shots will get that. Showing all the highlights actually can ruin it for movie goers.
      - good
      https://www.youtube.com/watch?v=QsCbQKqiW-g

    18. Re:Good trailers? by Anonymous Coward · · Score: 0

      2 - you don't want plot spoilers in the trailer

      Have you seen any trailers in the last few years? They all have spoilers. Trailers go outta their way to explain the premise, the beginning and the middle of the movie. Once you've seen a trailer, you're going to the theater to only watch the ending. Fuck the sadistic nazis who create trailers.

  2. Human Editor Helped by mentil · · Score: 4, Insightful

    The trailer was alright. Given a human helped edit what Watson came up with, I wonder how much work they did or how different the final trailer is from Watson's trailer. Given how formulaic film trailers are already, it makes sense that Watson could learn this pattern and then reproduce it given footage from the film; ensuring that the scenes used hint at a premise without being straight-up spoilers would probably require a human editor.
    That said, the film currently has a 48% rating on Metacritic, and apparently isn't that great from a sci-fi or thriller point of view.

    --
    Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    1. Re:Human Editor Helped by Anonymous Coward · · Score: 0

      Given that a human did 99% of the selection and actual editing. What Watson did was analyze the stream and find the "action" scenes.

    2. Re:Human Editor Helped by Anonymous Coward · · Score: 1

      "What Watson did was analyze the stream and find the "action" scenes."

      i.e. it looked for small time intervals between key frames and chose a selection of 100 of those.

      I think IBM are keeping Watson away from actual AI stuff, lest we know how crap they are. This way they can pretend to be leaders in AI, patent a lot of fluff and make money leaching off the real AI companies doing self driving cars, image search, and so on.

      Here they can pretend to be capable of video comprehension, which will come in handy when they try to shake companies down for money as Google etc get a deeper understanding of image recognition. A judge won't remember the detailed work involved, he will remember the "Watson makes a video trailer" soundbite.

    3. Re:Human Editor Helped by Anonymous Coward · · Score: 0

      FFS, then I have a hell of a hard time believing this is the first trailer made that way. Or movie, for that matter.

      Either it is the first one made by AI, or it is made by AI and humans in collaboration like almost everything for at least 50 years.

    4. Re:Human Editor Helped by Anonymous Coward · · Score: 0

      I suppose, then, it's a good thing our legal system isn't based around making decisions off of information the judge barely remembers from headlines months ago.

    5. Re:Human Editor Helped by lucm · · Score: 5, Insightful

      I think IBM are keeping Watson away from actual AI stuff

      Who cares? The real danger here is that they let the most advanced AI machine on Earth watch tons of horror movies. Am I he only one who finds that a bad idea?

      --
      lucm, indeed.
    6. Re:Human Editor Helped by MrL0G1C · · Score: 1

      Doesn't matter because IBM Watson isn't remotely intelligent, it has no idea what it is doing, it doesn't make choices, it's just an advanced database with 'neural net's thrown in. Data in, data out, nothing more.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  3. Pattern Recognition by nateman1352 · · Score: 4, Insightful

    Its a little disingenuous to say that Watson "created" the trailer. The only thing Watson did was run a pattern recognition algorithm to figure out which clips in the movie were tense, happy, scary, etc. Then a human editor sorted through all of the clips, picked the good ones and put them in sequence to create a trailer that actually had narrative instead of just being a hodge podge of disjoint clips.

    Pattern recognition is getting better which is the first step to creating an AI... but Watson, and AI in general is still very far off from creating a computer program that is capable of original thought.

    1. Re:Pattern Recognition by Anonymous Coward · · Score: 0

      Pattern recognition? You really need "powerful ai"?

      I'd like to see this compared to the result of having a regular computer just pick a bunch of random clips from the film, and then take the sound from a subset of those clips (extended past its own clip, so a voiceover ends on the scene of the person talking etc?), chosen randomly, but with some audio processing to make sure it starts and ends between beats/syllables.

    2. Re:Pattern Recognition by geoscodin · · Score: 1

      That's what Watson WANTS you to think. See how smart he is?

    3. Re:Pattern Recognition by judoguy · · Score: 4, Interesting
      In the real world, no studio will ever make much use of this. My oldest son is a trailer editor in Hollywood and he has great stories about the process.

      The studios subcontract trailers out to the trailer houses, usually multiple ones for each film. Then they micromanage the crap out of the process at each house. Then they sometimes take all the trailers and re cut in house to come with a Frankentrailer that some committee agrees on. That's often the best case scenario.

      My son has been made to make up dialog that's not in the movie at all before. The talent couldn't be gotten to record something so he was instructed to create a line from phonemes cut and pasted into a file. I kid you not. Sometimes a studio will bring in the dailies and have him start picking stuff knowing that the actual film might not even have the scenes after the final edit.

      And then there is the fact that many trailers of different length and content are made for different markets and media.

      --
      Peace is easy to achieve, just surrender. Liberty is much harder get/keep.
    4. Re:Pattern Recognition by Ichijo · · Score: 1

      Sometimes a studio will bring in the dailies and have him start picking stuff knowing that the actual film might not even have the scenes after the final edit.

      That explains this story.

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  4. Bringing things to the extreme... by ctrl-alt-canc · · Score: 4, Funny

    movies will be reviewed by AI based system replacing critics, and will be shown in the movie theatre to an audience of robots.
    So humans will have more time to do something interesting, live viewing old b/w movies at home, while robots are elsewhere at the movie...

  5. yeah... by wept · · Score: 1

    bullshit.

  6. So what's the big deal? by 93+Escort+Wagon · · Score: 1

    I watched this trailer for "Morgan", and I gotta admit - I just don't get it.

    It was just a bunch of people standing with one knee in the air.

    --
    #DeleteChrome
    1. Re:So what's the big deal? by Anonymous Coward · · Score: 0

      You're right. I've seen the full movie and it'll be panned by the critics. Movie has one hook and nothing much else. Now if you want to watch Kate Mara kicking some butt, go right ahead. Cinematographer at least did a decent job even with poor directing and acting.

    2. Re:So what's the big deal? by nbritton · · Score: 1

      I watched this trailer for "Morgan", and I gotta admit - I just don't get it.

      It was just a bunch of people standing with one knee in the air.

      lol, I think I'm the only one who got that joke.

  7. Misleading by Anonymous Coward · · Score: 1

    It is misleading to say 'IBM Watson' did it. Watson is nothing but a bunch of cobbled API that do nothing that could not be done with APIs from other vendors.
    Notably, Watson is not 'intelligent' and the APIs do not include any off-the-shelf conversational agent you can talk to, or for that matter any creative component
    that could produce a movie or trailer. Sure, it's good marketing, but it's dangerous to succumb to that imprecise hype, because it creates unreasonable expectations
    about what's possible.

    Kudos to the developers of the application that uses some Watson APIs to create a trailer by exploiting knowledge implicit in existing movies from the horror domain, that's neat. Whatson had no agency in it.

    1. Re: Misleading by Anonymous Coward · · Score: 0

      Agreed. It's all hype. This type of stuff really well to naive, corporate, middle managers.

  8. Well, up to a point... by Anonymous Coward · · Score: 0

    "The only thing Watson did was run a pattern recognition algorithm to figure out which clips in the movie were tense, happy, scary, etc"

    Recognising tense happy and scary is interesting in itself.

    Here is a interview from 16 September 2015. Note that Ryan Calo is a professor of law not of Computing or AI, but a year after the "Creepy Clown" scenario, we have computer putting together a "Creepy trailer".

    It would be very interesting to know how much human editing was done on the final trailer.

    http://www.bbc.co.uk/programmes/p032nvf4

    "Ryan Calo, Professor of law at Washington university, explained the difference between the way robots with artificial intelligence, and humans think.

    Mr Calo uses the example that a robot would see the image of a clown offering free hugs as a positive friendly image, whereas people would be less enthusiastic about hugging the clown, because of the context attached to that situation."

    1. Re:Well, up to a point... by AthanasiusKircher · · Score: 2

      It would be very interesting to know how much human editing was done on the final trailer.

      Well, from the Youtube video description:

      Utilizing experimental Watson APIs and machine learning techniques, the IBM Research system analyzed hundreds of horror/thriller movie trailers. After learning what keeps audiences on the edge of their seats, the AI system suggested the top 10 best candidate moments for a trailer from the movie Morgan, which an IBM filmmaker then edited and arranged together.

      Obviously this is just a brief explanation, but to me this implies the "Ai system" did little more than suggest 10 moments from the movie to string together. The human editor then actually did all the work of editing the clips, choosing the order, etc. That implies a HUGE amount of freedom on the part of the human -- if I can use a 1-second clip or a 20-second clip from a particular "moment" (perhaps edited as many movie clips in trailers are?) and I can put the order however I want, then most of the actual "filmmaking" is done by the human here.

      It would be interesting to see a comparison with a randomly chosen set of "moments" from the film. Could a skilled filmmaker make a reasonable trailer from them too? I'd bet with this flexibility that it could be done in a lot of cases. Not that this AI did nothing, but how much value did it really add?

    2. Re:Well, up to a point... by mrclevesque · · Score: 1

      "Recognising tense happy and scary is interesting in itself."

      It didn't do that. The computer analyzed 100s of horror movie trailers and then selected parts of the movie that where the similar to the trailers.

      "It would be very interesting to know how much human editing was done on the final trailer"

      After the computer selected bits of the movie, which of those bits were used, edit points, and everything else was done by humans.

  9. Anyone still wondering... by Torp · · Score: 1

    ... why all the recent movies are basically the same thing with slightly different skins?
    Here's your answer.

    --
    I apologize for the lack of a signature.
  10. That can't be true by Anonymous Coward · · Score: 0

    I thought every movie trailer I've seen in the last decade was made by AI. No human could comp up with such trite, predictable mishmashes.

  11. Don't expect much by Anonymous Coward · · Score: 0

    IBM used machine learning and experimental Watson APIs, parsing out the trailers of 100 horror movies.

    Garbage in, garbage out.

  12. Captured it by SpaghettiPattern · · Score: 1

    Harnessed reverberation, bass voice and predictable plot the US audience loves so much.

    AI for brilliant mediocrity. Yay!

    --

    I hadn't the slightest objection to his spending his time planning massacres for the bourgeoisie... (P.G. Wodehouse)
  13. Resistance is Futile by xtsigs · · Score: 1

    Resistance is futile, but who cares? Just entertain us.

  14. Humans? Who needs 'em? by shanen · · Score: 3, Insightful

    Greatly disappointed by the lack of humorous or insightful comments, but maybe they exist without visibility or sufficient positive moderation. Not surprised, but that's how slashdot has evolved. I don't see the joke in the topic, so I'll go for insight, such as it was. Kudos to you if you can see a joke in this topic.

    This article is a good example of how Watson can be leveraged to cut out the humans. Where the studios used to need a significant number of people to do the work, now a single editor with this leverage will probably be able to keep up with all the movies they want to make, and use the leftover time to make more trailers to pick from for each movie, to boot.

    I think it's part of the big secret plan of today's so-called IBM. "Respect for the individual" was the OLD idea. The new goal is "Replace the individuals". A few transient employees brought onboard as briefly required. The only question will be "Who can do the work most cheaply?" Actually, there might be one question before that: "Can Watson to do this work without needing any human being?"

    --
    Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
    1. Re:Humans? Who needs 'em? by Anonymous Coward · · Score: 0

      Watson will be able to do the work without needing any human beings. That is if and only if other AI are the only ones watching.

    2. Re:Humans? Who needs 'em? by tobiasly · · Score: 1

      Greatly disappointed by the lack of humorous or insightful comments, but maybe they exist without visibility or sufficient positive moderation.

      You may not realize this, but 90% of Slashdot stories and 98% of commenters have now been replaced by AI. Humor & insight will come along in future versions.

    3. Re:Humans? Who needs 'em? by shanen · · Score: 1

      I think that deserves a funny mod (on the theory you are in the other 2%), but I haven't had a mod point to give in many years.

      --
      Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
    4. Re:Humans? Who needs 'em? by fustakrakich · · Score: 1

      Humor & insight will come along in future versions.

      We're half way there

      --
      “He’s not deformed, he’s just drunk!”
  15. Oh thank God! by Anonymous Coward · · Score: 0

    "Even so, a process that would normally take weeks was reduced to hours."

    It is always so gratifying to see the latest in computer technology applied to help resolve problems that have been plaguing mankind for so long. Thankfully, humanity will finally be free of the dreadful scourge of having to wait for a new movie trailer.

  16. Resident Electronic Video Interface Library by Anonymous Coward · · Score: 0

    So one of the first things we teach this new AI (Watson) is about human horror.

    Oh the horror, the horror.

    Never get out of the boat. Absolutely goddam right.

  17. Kate by Anonymous Coward · · Score: 0

    It is a travesty to cast a woman as hot as Kate Mara creating artificial life form. If it was a natural one on the other had I am all in

  18. Solsbury Hill by T.E.D. · · Score: 1

    If its a learning algorithm, that learns how to make a trailer by looking at other trailers, then there's about a 60% chance it played Peter Gabriel's Solsbury Hill at some point in the trailer.

  19. Repeatable? by holophrastic · · Score: 1

    Only the one question then: what happens when Watson is fed the film a second time? Does it produce the same trailer as the first time?

    If so, it's totally useless.

    No one's interested in an algorithm to creativity. It quickly becomes an expression of nothing at all. I believe we used the term "formulaic" to insult any such "creative" process.

    And no, random different isn't any better.

    This is intended to be art, people. If it doesn't express creativity, then it simply isn't art.

    I'll give you that Watson, as a process, is art -- absolutely. But I'm not seeing the process, I'm seeing the resulting trailer.

  20. Can you say "Gimmick" 'cause that's what it is by Anonymous Coward · · Score: 0

    gimmick
    imik/
    noun
    noun: gimmick; plural noun: gimmicks

            a trick or device intended to attract attention, publicity, or business.
            synonyms: publicity stunt, contrivance, scheme, stratagem, ploy; informal shtick