Slashdot Mirror


IBM Watson Created The First-Ever AI-Made Movie Trailer For 'Morgan' (popsci.com)

An anonymous reader shares a Popular Science article: For a film about the risks of pushing the limits of technology too far, it only makes sense to advertise for it using artificial intelligence. Morgan, staring Kate Mara and Paul Giamatti, is a sci-fi thriller about scientists who've created a synthetic humanoid whose potential has grown dangerously beyond their control. Fitting, then, that they'd employ the help of America's AI sweetheart IBM Watson to build the film's trailer. IBM used machine learning and experimental Watson APIs, parsing out the trailers of 100 horror movies. It did visual, audio, and composition analysis of individual scenes, finding what makes each moment eerie, how the score and actors' tone of voice changed the mood--framing and lighting came together to make a complete trailer. Watson was then fed the full film, and it chose scenes for the trailer. A human -- in this case, the "resident IBM filmmaker" -- still needed to step in to edit for creativity. Even so, a process that would normally take weeks was reduced to hours.

36 of 58 comments (clear)

  1. Good trailers? by Anonymous Coward · · Score: 1

    I did not think trailers take weeks to create. They do not look that good.

    1. Re:Good trailers? by Anonymous Coward · · Score: 4, Insightful

      Everybody thinks everybody else's job is easy.

    2. Re:Good trailers? by brantondaveperson · · Score: 1

      They probably make many different versions, and then spend weeks trying to get everyone - from marketing through to legal through all the talent - to actually agree on them.

    3. Re: Good trailers? by Anonymous Coward · · Score: 1

      But those things wouldn't be expedited by an A.I. making the trailer...

    4. Re:Good trailers? by sexconker · · Score: 2

      Everybody thinks everybody else's job is easy.

      I take it you've never seen Dirty Jobs with Mike Rowe.

    5. Re:Good trailers? by Cylix · · Score: 4, Funny

      Not really. I think the guys around the corner building a highly efficient and flexible network stack have a tough job.

      Making a trailer isn't that difficult. Just take all of the scenes that detail every bit of the plot and slap them together. Once you have something that removes any potential chance of enjoying the film then it can be called complete. In some cases, when the film is so incredibly terrible, it may be necessary to fabricate a trailer that has barely anything in common with the film. Sure, you probably should have made that movie instead, but then we wouldn't have done all of this blow.

      --
      "You should always go to other people's funerals; otherwise, they won't come to yours." -- Yogi Berra
    6. Re:Good trailers? by Anonymous Coward · · Score: 1

      I certainly know people who do. You might as well ask why it takes so long to write a book. Or code. It's just text, you know?

    7. Re:Good trailers? by Calydor · · Score: 1

      Slapping together a trailer of scenes from a movie isn't that different from slapping together a quick little program combining libraries someone else already wrote. It's not like the trailer maker has to go out and do a new shoot, edit for lighting and audio, add CGI effects etc. He LITERALLY has to watch the movie and at a few points go "Ooh, that looks awesome, that goes in the trailer!"

      --
      -=This sig has nothing to do with my comment. Move along now=-
    8. Re:Good trailers? by Cederic · · Score: 4, Insightful

      Hmm, no.

      1 - you don't want your 'best' scenes in the trailer or people will go 'that film was shit, just watch the trailer'
      2 - you don't want plot spoilers in the trailer
      3 - your trailer will be targeted at specific audiences. Different elements from different scenes will appeal to different audiences
      4 - you want to convey specific messages with a trailer, and so its creation is an inherently creative task to assure this
      5 - trailers can be cut and edited differently to the film. E.g. cutting the middle from a scene to hide a plot spoiler
      6 - trailers can use scenes not included in the film. Some directors shoot scenes for the trailer
      7 - trailers need to make narrative sense in their own right. Shit, even people posting crap on Youtube do more than post a sequence of scenes from a film
      8 - trailers can fuck with a film's running order to support the above

      That's before you add in a trailer voiceover, interstitial text/images, the need for trailers to provide consistency between Cinema (three minutes of trailer) and TV (30 seconds), the need for trailers to keep consistency with other marketing and PR (cast interviews, written reviews, press releases, 'fluff' pieces, astroturfing, all the other shit the media industry do).

      But sure, just fucking slap together a trailer. Go for it. You clearly have a sparkling career ahead of you.

    9. Re: Good trailers? by AchilleTalon · · Score: 2

      Exactly that, instead of wasting and spending weeks in discussions about the trailers and possible trailers, they just accepted the trailer proposed by Watson. The discussion near the end about Watson creativity is pure marketing bullshit from IBM.

      --
      Achille Talon
      Hop!
    10. Re:Good trailers? by lucm · · Score: 1

      Slapping together a trailer of scenes from a movie isn't that different from slapping together a quick little program combining libraries someone else already wrote.

      npm install scene --save-trailer

      --
      lucm, indeed.
    11. Re:Good trailers? by ravenshrike · · Score: 1

      Ah, I see you graduated from the same school as both the Ghostbusters and Suicide Squad trailer creation teams.

  2. Human Editor Helped by mentil · · Score: 4, Insightful

    The trailer was alright. Given a human helped edit what Watson came up with, I wonder how much work they did or how different the final trailer is from Watson's trailer. Given how formulaic film trailers are already, it makes sense that Watson could learn this pattern and then reproduce it given footage from the film; ensuring that the scenes used hint at a premise without being straight-up spoilers would probably require a human editor.
    That said, the film currently has a 48% rating on Metacritic, and apparently isn't that great from a sci-fi or thriller point of view.

    --
    Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    1. Re:Human Editor Helped by Anonymous Coward · · Score: 1

      "What Watson did was analyze the stream and find the "action" scenes."

      i.e. it looked for small time intervals between key frames and chose a selection of 100 of those.

      I think IBM are keeping Watson away from actual AI stuff, lest we know how crap they are. This way they can pretend to be leaders in AI, patent a lot of fluff and make money leaching off the real AI companies doing self driving cars, image search, and so on.

      Here they can pretend to be capable of video comprehension, which will come in handy when they try to shake companies down for money as Google etc get a deeper understanding of image recognition. A judge won't remember the detailed work involved, he will remember the "Watson makes a video trailer" soundbite.

    2. Re:Human Editor Helped by lucm · · Score: 5, Insightful

      I think IBM are keeping Watson away from actual AI stuff

      Who cares? The real danger here is that they let the most advanced AI machine on Earth watch tons of horror movies. Am I he only one who finds that a bad idea?

      --
      lucm, indeed.
    3. Re:Human Editor Helped by MrL0G1C · · Score: 1

      Doesn't matter because IBM Watson isn't remotely intelligent, it has no idea what it is doing, it doesn't make choices, it's just an advanced database with 'neural net's thrown in. Data in, data out, nothing more.

      --
      Waterfox - a Firefox fork with legacy extension support, security updates and better privacy by default.
  3. Pattern Recognition by nateman1352 · · Score: 4, Insightful

    Its a little disingenuous to say that Watson "created" the trailer. The only thing Watson did was run a pattern recognition algorithm to figure out which clips in the movie were tense, happy, scary, etc. Then a human editor sorted through all of the clips, picked the good ones and put them in sequence to create a trailer that actually had narrative instead of just being a hodge podge of disjoint clips.

    Pattern recognition is getting better which is the first step to creating an AI... but Watson, and AI in general is still very far off from creating a computer program that is capable of original thought.

    1. Re:Pattern Recognition by geoscodin · · Score: 1

      That's what Watson WANTS you to think. See how smart he is?

    2. Re:Pattern Recognition by judoguy · · Score: 4, Interesting
      In the real world, no studio will ever make much use of this. My oldest son is a trailer editor in Hollywood and he has great stories about the process.

      The studios subcontract trailers out to the trailer houses, usually multiple ones for each film. Then they micromanage the crap out of the process at each house. Then they sometimes take all the trailers and re cut in house to come with a Frankentrailer that some committee agrees on. That's often the best case scenario.

      My son has been made to make up dialog that's not in the movie at all before. The talent couldn't be gotten to record something so he was instructed to create a line from phonemes cut and pasted into a file. I kid you not. Sometimes a studio will bring in the dailies and have him start picking stuff knowing that the actual film might not even have the scenes after the final edit.

      And then there is the fact that many trailers of different length and content are made for different markets and media.

      --
      Peace is easy to achieve, just surrender. Liberty is much harder get/keep.
    3. Re:Pattern Recognition by Ichijo · · Score: 1

      Sometimes a studio will bring in the dailies and have him start picking stuff knowing that the actual film might not even have the scenes after the final edit.

      That explains this story.

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
  4. Bringing things to the extreme... by ctrl-alt-canc · · Score: 4, Funny

    movies will be reviewed by AI based system replacing critics, and will be shown in the movie theatre to an audience of robots.
    So humans will have more time to do something interesting, live viewing old b/w movies at home, while robots are elsewhere at the movie...

  5. yeah... by wept · · Score: 1

    bullshit.

  6. So what's the big deal? by 93+Escort+Wagon · · Score: 1

    I watched this trailer for "Morgan", and I gotta admit - I just don't get it.

    It was just a bunch of people standing with one knee in the air.

    --
    #DeleteChrome
    1. Re:So what's the big deal? by nbritton · · Score: 1

      I watched this trailer for "Morgan", and I gotta admit - I just don't get it.

      It was just a bunch of people standing with one knee in the air.

      lol, I think I'm the only one who got that joke.

  7. Misleading by Anonymous Coward · · Score: 1

    It is misleading to say 'IBM Watson' did it. Watson is nothing but a bunch of cobbled API that do nothing that could not be done with APIs from other vendors.
    Notably, Watson is not 'intelligent' and the APIs do not include any off-the-shelf conversational agent you can talk to, or for that matter any creative component
    that could produce a movie or trailer. Sure, it's good marketing, but it's dangerous to succumb to that imprecise hype, because it creates unreasonable expectations
    about what's possible.

    Kudos to the developers of the application that uses some Watson APIs to create a trailer by exploiting knowledge implicit in existing movies from the horror domain, that's neat. Whatson had no agency in it.

  8. Anyone still wondering... by Torp · · Score: 1

    ... why all the recent movies are basically the same thing with slightly different skins?
    Here's your answer.

    --
    I apologize for the lack of a signature.
  9. Captured it by SpaghettiPattern · · Score: 1

    Harnessed reverberation, bass voice and predictable plot the US audience loves so much.

    AI for brilliant mediocrity. Yay!

    --

    I hadn't the slightest objection to his spending his time planning massacres for the bourgeoisie... (P.G. Wodehouse)
  10. Resistance is Futile by xtsigs · · Score: 1

    Resistance is futile, but who cares? Just entertain us.

  11. Humans? Who needs 'em? by shanen · · Score: 3, Insightful

    Greatly disappointed by the lack of humorous or insightful comments, but maybe they exist without visibility or sufficient positive moderation. Not surprised, but that's how slashdot has evolved. I don't see the joke in the topic, so I'll go for insight, such as it was. Kudos to you if you can see a joke in this topic.

    This article is a good example of how Watson can be leveraged to cut out the humans. Where the studios used to need a significant number of people to do the work, now a single editor with this leverage will probably be able to keep up with all the movies they want to make, and use the leftover time to make more trailers to pick from for each movie, to boot.

    I think it's part of the big secret plan of today's so-called IBM. "Respect for the individual" was the OLD idea. The new goal is "Replace the individuals". A few transient employees brought onboard as briefly required. The only question will be "Who can do the work most cheaply?" Actually, there might be one question before that: "Can Watson to do this work without needing any human being?"

    --
    Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
    1. Re:Humans? Who needs 'em? by tobiasly · · Score: 1

      Greatly disappointed by the lack of humorous or insightful comments, but maybe they exist without visibility or sufficient positive moderation.

      You may not realize this, but 90% of Slashdot stories and 98% of commenters have now been replaced by AI. Humor & insight will come along in future versions.

    2. Re:Humans? Who needs 'em? by shanen · · Score: 1

      I think that deserves a funny mod (on the theory you are in the other 2%), but I haven't had a mod point to give in many years.

      --
      Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
    3. Re:Humans? Who needs 'em? by fustakrakich · · Score: 1

      Humor & insight will come along in future versions.

      We're half way there

      --
      “He’s not deformed, he’s just drunk!”
  12. Re:Well, up to a point... by AthanasiusKircher · · Score: 2

    It would be very interesting to know how much human editing was done on the final trailer.

    Well, from the Youtube video description:

    Utilizing experimental Watson APIs and machine learning techniques, the IBM Research system analyzed hundreds of horror/thriller movie trailers. After learning what keeps audiences on the edge of their seats, the AI system suggested the top 10 best candidate moments for a trailer from the movie Morgan, which an IBM filmmaker then edited and arranged together.

    Obviously this is just a brief explanation, but to me this implies the "Ai system" did little more than suggest 10 moments from the movie to string together. The human editor then actually did all the work of editing the clips, choosing the order, etc. That implies a HUGE amount of freedom on the part of the human -- if I can use a 1-second clip or a 20-second clip from a particular "moment" (perhaps edited as many movie clips in trailers are?) and I can put the order however I want, then most of the actual "filmmaking" is done by the human here.

    It would be interesting to see a comparison with a randomly chosen set of "moments" from the film. Could a skilled filmmaker make a reasonable trailer from them too? I'd bet with this flexibility that it could be done in a lot of cases. Not that this AI did nothing, but how much value did it really add?

  13. Re:Well, up to a point... by mrclevesque · · Score: 1

    "Recognising tense happy and scary is interesting in itself."

    It didn't do that. The computer analyzed 100s of horror movie trailers and then selected parts of the movie that where the similar to the trailers.

    "It would be very interesting to know how much human editing was done on the final trailer"

    After the computer selected bits of the movie, which of those bits were used, edit points, and everything else was done by humans.

  14. Solsbury Hill by T.E.D. · · Score: 1

    If its a learning algorithm, that learns how to make a trailer by looking at other trailers, then there's about a 60% chance it played Peter Gabriel's Solsbury Hill at some point in the trailer.

  15. Repeatable? by holophrastic · · Score: 1

    Only the one question then: what happens when Watson is fed the film a second time? Does it produce the same trailer as the first time?

    If so, it's totally useless.

    No one's interested in an algorithm to creativity. It quickly becomes an expression of nothing at all. I believe we used the term "formulaic" to insult any such "creative" process.

    And no, random different isn't any better.

    This is intended to be art, people. If it doesn't express creativity, then it simply isn't art.

    I'll give you that Watson, as a process, is art -- absolutely. But I'm not seeing the process, I'm seeing the resulting trailer.