Slashdot Mirror


Someone Used a Deep Learning AI To Perfectly Insert Harrison Ford Into "Solo: A Star Wars Story" (gizmodo.com)

Andrew Liszewski, writing for io9: Casting anyone other than Harrison Ford in the role of Han Solo just feels like sacrilege, but since Ford is now 76 years old, playing a younger version of himself would be all but impossible. Or at least impossible if you rely on the standard Hollywood de-aging tricks like makeup and CG. Artificial intelligence, it turns out, does a pretty amazing job at putting Ford back into the role of Solo. The YouTube channel "derpfakes" has been posting videos that demonstrate the impressive, and at times frightening, capabilities of image processing using artificial intelligence. Using a process called deep learning, an AI analyzes a large collection of photos of a given person, creating a comprehensive database of them in any almost any position and pose. It then uses that database to intelligently perform an automatic face replacement on a source clip, in this case replacing actor Alden Ehrenreich's face with Harrison Ford's.

65 of 130 comments (clear)

  1. Not bad, but not perfect by wonkey_monkey · · Score: 5, Interesting

    It's far from perfect, and the bitrate on that video is abysmal. If he tried this on Blu-ray footage and kept the quality up, Harrison Ford's face would stick out like a sore... face.

    --
    systemd is Roko's Basilisk.
    1. Re:Not bad, but not perfect by cyn1c77 · · Score: 5, Insightful

      It's far from perfect, and the bitrate on that video is abysmal. If he tried this on Blu-ray footage and kept the quality up, Harrison Ford's face would stick out like a sore... face.

      But if this is a single user effort, imagine what the resources of a movie studio could do with the concept.

    2. Re:Not bad, but not perfect by Dorianny · · Score: 1

      To be fair, the data of "young Ford" the algorithm had to work with is decades old. It would be really interesting to see what it could do with data from an actor of the "Blue-ray" era, although in second though the algorithms used to compress the data would actually make things worst. Lossless scans from the high quality film era would probably be ideal but the shear amount of data to be analyzed would make things enormousness computationally expensive

    3. Re:Not bad, but not perfect by Anonymous Coward · · Score: 2, Funny

      It's far from perfect, and the bitrate on that video is abysmal. If he tried this on Blu-ray footage and kept the quality up, Harrison Ford's face would stick out like a sore... face.

      But if this is a single user effort, imagine what the resources of a movie studio could do with the concept.

      Uh, give us a Disneyfied, PG-13, poorly written, and poorly cast Solo movie? Wasn't that major movie studio the entire problem to begin with?

    4. Re:Not bad, but not perfect by shaitand · · Score: 1

      By the time an actor from that era is old enough for this to have a point that quality will be even worse, analog scales up where digital really doesn't.

    5. Re:Not bad, but not perfect by Aighearach · · Score: 1

      It isn't nearly as good as that Hoff guy in Gaurdians' Inferno

      https://www.youtube.com/watch?...

      It almost makes me want to paint my car and install some red LEDs with a ring counter!!!

    6. Re:Not bad, but not perfect by Aighearach · · Score: 1

      They might even do it all the time, but they didn't tell you.

    7. Re:Not bad, but not perfect by HarrySquatter · · Score: 1

      To be fair, the data of "young Ford" the algorithm had to work with is decades old.

      And mostly on high quality 35mm stock.

      It would be really interesting to see what it could do with data from an actor of the "Blue-ray" era, although in second though the algorithms used to compress the data would actually make things worst.

      Why would that make any difference. Pretty much all of Ford's old movies are out on Blu-Ray by now. Also 1080p digital has far less detail than high quality 35mm.

    8. Re:Not bad, but not perfect by Dru+Nemeton · · Score: 1

      Which is why it's super important for actors to copyright their "likeness" and closely guard that IP!

    9. Re:Not bad, but not perfect by jellomizer · · Score: 4, Informative

      I think it is more due to Star Wars fatigue. Star Wars really never was a good set of movies. However it was often people first step into the Epic Sci-Fi action flick. So a few movies every 20 years, isn't the big of a problem, because a new generation will come in and enjoy it. But with one every year, The generation is already sick of it. Because they are not getting an new experience from it.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    10. Re: Not bad, but not perfect by Anonymous Coward · · Score: 1

      We needed a dark, gritty R rated new Star Wars trilogy.

      WE NEEDED THRAWN.

      Instead we got garbage and Star Wars is a ruined brand.

    11. Re:Not bad, but not perfect by commodore64_love · · Score: 4, Insightful

      > To be fair, the data of "young Ford" the algorithm had to work with is decades old. It would be really interesting to see what it could do with data from an actor of the "Blue-ray" era,

      You spelled Blu-ray wrong. Also the data of young Ford from the 1970s/80s is in Ultra High Definition (aka film), so the data is not deficient.

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    12. Re:Not bad, but not perfect by The+Grim+Reefer · · Score: 1

      I looked like a cross between Matt Smith and Harrison Ford.

    13. Re:Not bad, but not perfect by sheramil · · Score: 1

      I hope you got better.

    14. Re:Not bad, but not perfect by rtb61 · · Score: 2

      A good story well told is always fun. What fucked star wars, idiots who did not understand science what so ever, thinking they were geniuses at everything because that's what their marketing department told everyone, allowing really, really, dumb stories, like bad Saturday afternoon cartoon stories, being told with hundreds of millions of dollars and trying to cover over the mess with PR=B$.

      The animated series Star Wars Clone troopers was better written and had better stories than the movie even Star Wars Rebels was better written and had better stories. Reality is the star wars movies a Kathleen mary sue rey Kennedy egoistic shit show, to push her ego into the story and parade it to the rest of the world, what an asshat, short people https://www.youtube.com/watch?.... Nothing to do with SJW nonsence just the ego of one person, a short person who felt they were short changed on the sale of Lucas Arts (seriously in the movie, men suck, tall women are stupid and the taller you they are the worse you were portrayed in the story, the whole thing is a silly and funny as fuck).

      --
      Chaos - everything, everywhere, everywhen
    15. Re:Not bad, but not perfect by JoeDuncan · · Score: 1

      You spelled Blu-ray wrong.

      Oh, so you were confused about what they meant? No? (obviously not)

      Then you're just being a dick for the sake of it...

    16. Re:Not bad, but not perfect by wonkey_monkey · · Score: 1

      We've seen what they can do: they can still only get it almost, but not quite, perfect.

      --
      systemd is Roko's Basilisk.
    17. Re:Not bad, but not perfect by Mattcelt · · Score: 1

      Easier to imagine than none on /.

      (Such as yourself.)

  2. "perfectly" by celeb8 · · Score: 2

    no not perfectly at all

    1. Re:"perfectly" by Roger+W+Moore · · Score: 1

      It might not be perfect but it is a lot better than what the studio did with Carrie Fisher and Peter Cushing in Rogue One only a couple of years ago.

    2. Re:"perfectly" by cshark · · Score: 1

      I agree. The chin's all wrong.

      --

      This signature has Super Cow Powers

    3. Re:"perfectly" by mark-t · · Score: 2

      Two words, "small screen".

      Honestly, I expect if you blew up that fan-made clip to watch on a 60 foot screen, you'd probably notice it far more than you did watching this video on a comparatively tiny computer monitor.

  3. Not really perfect by guruevi · · Score: 1

    The uncanny valley comes to mind. In some scenes the face droops a bit too much for it to be unrealistic. He's done similar ones on his channel in which the problems are more clear, fitting one face on another is possible but not invisible.

    --
    Custom electronics and digital signage for your business: www.evcircuits.com
    1. Re:Not really perfect by thomst · · Score: 1

      guruevi observed:

      The uncanny valley comes to mind. In some scenes the face droops a bit too much for it to be unrealistic. He's done similar ones on his channel in which the problems are more clear, fitting one face on another is possible but not invisible.

      And there's a least one driving scene where his face is visibly out of proportion to both his body and the face of his girlfriend (who's in the passenger's seat next to him). It looks like he's wearing a Young Harrison Ford Halloween Mask (tm) ...

      --
      Check out my novel.
  4. Not good, needs replacement audio by SuperKendall · · Score: 1

    Frankly I preferred the original actor face to the replacement.

    Now what I would have liked, was to tweak the audio so he sounded more like Harrison Ford, with at least a bit deeper voice. This clip was educational in that respect as when watching the movie I was trying to think why he didn't seem much like the original.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  5. close by thebullshitpatrol · · Score: 1

    would be better with blockchain.

  6. But the really big questions are .. by OzPeter · · Score: 5, Funny

    Can they erase Jar-Jar? Or replace Hayden Christensen with an actual wooden post?

    --
    I am Slashdot. Are you Slashdot as well?
  7. James Bond by grumbel · · Score: 1

    His previous work of inserting Elon Musk as Bond is even better.

    1. Re:James Bond by squiggleslash · · Score: 2

      Wouldn't Elon Musk be better as a Bond Villain? Billionaire, running numerous secret projects, capable of launching stuff into space, carefully built populist public image... could easily be Max Zorin, Elliot Carver, or Gustav Graves.

      --
      You are not alone. This is not normal. None of this is normal.
    2. Re:James Bond by Megane · · Score: 1

      We need a Bond movie with both an Elon Musk and Jeff Bezos character. Bezos would be the villain, of course, Musk would just be the red herring. With all the money going into Blue Origin, and they're still not further along than they are? He's definitely hiding some tech for evil purposes! The climax scene would involve Bond in a space suit, crawling into a Dragon v1 capsule so that he can save the day.

      --
      #naabhaprzrag, #sverubfr-000, #agi-fcbafberq, negvpyr[pynff*=' negvpyr-ary-'] { qvfcynl: abar !vzcbegnag; }
  8. Re: Deep Fakes should be illegal by Anonymous Coward · · Score: 1

    So we can sexually assault someone now by creating pixels on a screen? Man this world sucks more and more each day.

  9. Re:Deep Fakes should be illegal by The+Grim+Reefer · · Score: 5, Insightful

    Using them in sexual videos without their consent should be considered sexual assult.

    I'm all for protecting people from sexual assault and harm, but really? This is what you call assault? Let me guess, if someone looks at you and you don't want them to, you consider it sexual assault. This is the problem with calling everyone Hitler, or a racist, mysognist, pedophile, etc. After a while those words have no meaning and you have to amp it up even further.

    How about we call it misuse of someone's likeness, or just plain rude and obnoxious. If there are laws against this, then they should be charged. But let's not go full tilt stupid.

  10. Estates of Dead Moviestars will need good Lawyers by Danathar · · Score: 1

    I think it's not unreasonable to find more de-aging being done (like in Ant-Man and the Tron Sequel). Actors better have good estates that can defend (and license) their likeness because it's going to get easier and easier to replicate them as technology gets better and better. The money involved would be crazy. Imagine if Terantino got Clint to do voice over work for a new Spaghetti western style flick where the actor is being played by a stand in that is manipulated by CG to look like Clint from the 60's. If it was done right and believable people would line up at the theater to see it.

  11. Impressive by 110010001000 · · Score: 1

    Looks as realistic as Jar-Jar. But it is deep learning AI so it must be good.

  12. Good start by bobstreo · · Score: 1

    Now let's go back to Episodes 4,5,6 and remove all the added Lucas crap to the original theatrical releases, and oh yeah, Han shoots first...(yeah I do know about the fan versions and have them.)

    Then back to 1,2,3 and remove Jar Jar, except for killing the character in EP 1

    Then you could make it look like Hayden actually cared about being in a movie, instead of waiting in a line for a new iPhone.

    1. Re:Good start by Misagon · · Score: 1

      There are many fan-edits to Star Wars out there, both for restoring the original Star Wars, removing the SE additions, and for making the prequels less cringey. The most famous de-specialisation project has an article on even.

      There are also a few groups that have located surviving prints of the original movies, scanned them in 4K and are performing digital restoration on them. See for instance, Team Negative1's work on.

      For Disney/Lucasfilm to re-release the original trilogy in good quality would be difficult though. The original negatives were cut apart when making the SE and before the 2004 DVD release, their copy of the SE was scanned only in Full HD (1920), not even 2K (according to Lowry Digital who did it)

      --
      "We mustn't be caught by surprise by our own advancing technology" -- Aldous Huxley
    2. Re:Good start by Lord+Kano · · Score: 1

      You should search on your favorite P2P tracker for the "Despecialized edition" of the original Star Wars movies.

      Full HD with minimal BS.

      LK

      --
      "Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
  13. Re: Deep Fakes should be illegal by Anonymous Coward · · Score: 2, Insightful

    Nope. He's right. These words have specific legal meanings. You can't have "assault" without physical harm. Otherwise you might as well call it "rape" and be done with it.
    Now if you had said "sexual harassment" or "defamation", you might have had a point.

  14. The actors weren't the problem... by Noishkel · · Score: 1

    ... as much as the atrocious writing in that tire fire of a movie. And their ain't much we can do to fix that, at least not for the foreseeable future.

  15. Re:Deep Fakes should be illegal by anegg · · Score: 2

    Using them in sexual videos without their consent should be considered sexual assult.

    That would be contrary to the plain definition of assault: "make a physical attack on" and even the extended legal (in some jurisdictions) definition fo assault: "a credible threat or attempt to cause battery" (where battery refers to the actual bodily contact). I'm not arguing against the idea that using someone's likeness in photos or videos without their consent being illegal, just the idea that it be labeled as "assault." Otherwise, this would dilute the definition of assault. Perhaps someone could come up with a more appropriate label apart from borrowing one from a different kind illegal act.

  16. Re: Deep Fakes should be illegal by wed128 · · Score: 5, Insightful

    Ok, here's the problem. I have a neighbor that's on the sex offender database. I asked him about it.

    Turns out, he was caught peeing an an alley next to a bar. Being a little gross, but harming nobody. The cop booked him for indecent exposure, and it snowballed from there.

    All of a sudden, there's no line between a rapist and a drunk kid. Do you see the problem with labeling everything as "Sexual Assault"?

  17. Re: Deep Fakes should be illegal by Anonymous Coward · · Score: 4, Insightful

    Your daughter gets banged like a screen door every Thursday at the truck stop.

  18. Re:Estates of Dead Moviestars will need good Lawye by Misagon · · Score: 1

    Deepfakes is using only existing footage of the actors and of the movie it is inserted in.
    In your scenario, there would instead be access to a 3D-scan of the original actor's face which could be fixed up and animated based on motion capture dots on the new actor's face. With those, you could produce an even better result.

    ... Which is exactly what was done to Peter Cushing and Carrie Fisher in Rogue One - A Star Wars Story and to Sean Young in Blade Runner 2049 .
    While Peter Cushing is not alive, life-casts of his face remain -- once made for making rubber appliances for make-up effects. The same goes for many actors.
    As with any old genuine movie props, there are also people who collect nth generation life-casts of famous actors...

    --
    "We mustn't be caught by surprise by our own advancing technology" -- Aldous Huxley
  19. Re: Deep Fakes should be illegal by dunkelfalke · · Score: 3, Insightful

    With this kind of parental upbringing you are showing he'd probably voluntarily stay away. People with messed up childhoods are often too difficult to be worth the hassle.

    --
    "It's such a fine line between stupid and clever" -- David St. Hubbins, Spinal Tap
  20. Re: Deep Fakes should be illegal by DalM · · Score: 1

    Wasn't meant to be.

  21. Re:Deep Fakes should be illegal by cascadingstylesheet · · Score: 1

    That would be contrary to the plain definition of assault: "make a physical attack on" and even the extended legal (in some jurisdictions) definition fo assault: "a credible threat or attempt to cause battery" (where battery refers to the actual bodily contact). I'm not arguing against the idea that using someone's likeness in photos or videos without their consent being illegal, just the idea that it be labeled as "assault." Otherwise, this would dilute the definition of assault. .

    Oh, and we certainly can't have that.

    Someone hasn't been watching the news lately.

  22. Re: Deep Fakes should be illegal by wed128 · · Score: 1

    Ok, let's try it this way, hypothetically:

    Your daughter comes home, and says "Mommy/Daddy, I've been sexually assaulted!".

    Do you want to know if they were Raped, Flashed, or photoshopped into an image? Are those three things really entirely equivalent to you? you have no more questions?

    I have two daughters myself. I'm not interested in yours. I also want words to have meaning, and not just use one scary phrase to describe any kind of harm that may come to a person.

  23. Re:Deep Fakes should be illegal by drjoe1e6 · · Score: 2

    This kind of deepfake could fall under libel laws, which include both written information and pictures. Libel is certainly different from a physical attack, and is clearly a type of harm.

    --
    Lose = not win ...... Loose = not tight
  24. Re:Deep Fakes should be illegal by mark-t · · Score: 1

    I'm guessing you've never heard of slander/libel laws?

  25. assault? how about defamation? by gosand · · Score: 2

    Wouldn't defamation of character be a better charge for this?

    --

    My beliefs do not require that you agree with them.

  26. Can't Fake Stature by Rob+Riggs · · Score: 1

    Short people are easy to spot based on the head to torso ratio. While not exactly short, Ehrenreich does not have the same stature as Ford. It makes the fake look really weird to me.

    --
    the growth in cynicism and rebellion has not been without cause
  27. Re:Deep Fakes should be illegal by Kyr+Arvin · · Score: 2

    Using a person's likeness in photos or videos without the person's consent should be illegal.

    To a certain extent, it is. Little fan works like this might go under the radar, but Lucasfilm, even though they own all the footage of Harrison Ford from the Star Wars days, would need to get permission from Ford to insert him into a new movie, just like they needed from Peter Cushing's estate to get Cushing inserted into Rogue One.

    Many of these rules date back to Back to the Future Part II, where test footage of Crispin Glover (George McFly) from the first movie was used along with actor Jeffrey Weissman who used chin, nose, and cheek prosthetics to appear as Glover. Glover sued, and now the SGA has clauses in their contracts forbidding the use of an actor's likeness without permission. That's why when there's an actor replacement for a role, very little effort is done to make the new actor look like the old character. If you make the "new" character look too much like the old one, there can be legal action if this wasn't already worked out with the old actor.

  28. Re: Deep Fakes should be illegal by smooth+wombat · · Score: 1

    Do you want to know if they were Raped, Flashed, or photoshopped into an image?

    Yes, so I can know whether to use a red hot pair of pliers to remove his genitals and stuff them down his throat, smack the person upside the head, or fry their system.

    --
    We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
  29. Gah by Maury+Markowitz · · Score: 1

    Pretty amazing job my ass. Looks absolutely terrible.

    Yeah I know this is a fanboi job and I give *him* credit for this, but boo on Gizlozer for overhyping it.

  30. Re: Deep Fakes should be illegal by The+Grim+Reefer · · Score: 1

    Ok, fine. We should call it "misuse if someone's likeness in a sexual manner" and force the guy register on a "misuse of someone's likeness in a sexual manner" database and to send out notifications to all if his neighbors that he misses people's likeness in a sexual manner.

    Yeah, great idea. We should create a database for everyone. Anyone who speeds shouldn't be allowed to drive. We should put alcoholic and pot smokers on a list.too, or should we make a list for individual drugs? Anyone who can think should go on a list too, obviously they're a threat. You obviously need to be on the list of people who should be medicated.

    While the sexual predator list sounded like a good idea in theory, in practice it's a fucking disaster. Some who gets caught taking a piss in the bushes doesn't belong on that list. It a biological function and we all have to do it. When did a picture of someone partially or fully naked become porn? Context matters. Or should we burn and destroy any art with nudity? Medical texts should also all be burned as porn right?

    Stay the hell away from my daughter. Creep.

    I never mentioned or have any interest on you daughter. Perhaps you're a little too obsessed with you own daughter and are projecting you mental health issues. It looks to me like you forgot your medication today

  31. Re:Deep Fakes should be illegal by iMadeGhostzilla · · Score: 1

    That sounds like an excellent new topic for the ever expanding area of Social Justice.

  32. Need the voice, too by RespekMyAthorati · · Score: 1

    One of the worst aspects of "Solo" was the actor's thin reedy voice v.s. Ford's deep super-masculine voice.

  33. Re:Deep Fakes should be illegal by HeckRuler · · Score: 1

    This has been a REALLY WEIRD curveball that I've noticed out on the fringes. Violence doesn't have to be violent anymore. Words can be violent. You can "cause violence" against someone without ever even being in the same room as them or knowing their name. It's all utter bullshit, but for some reason they want to redefine terms until.... I dunno.... it's easier to claim victim status?

  34. Next step... by Mats+Svensson · · Score: 1

    Next step;
      Keep Ford, and replace everything else with the footage and story from A New Hope.

  35. Deep Learning AI - the new buzzphrase by Tony+Isaac · · Score: 1

    The article doesn't say anything about the technology, other than to describe it as "deep learning AI." What exactly does this mean? Is it a neural network? If it's not, it's not really "AI." Deep learning? Maybe, or maybe it's just brute force that runs on really powerful equipment. Can't tell from the article.

  36. Re: Deep Fakes should be illegal by wed128 · · Score: 1

    $1000 sounds like a perfectly reasonable punishment. Being labelled a sex offender for an act that was entirely not sexual is not reasonable.

  37. Re:Deep Fakes should be illegal by Lord+Kano · · Score: 1

    I get the feeling that this Dallas May character is someone who screams "RAPE" at the top of her lungs when people won't let her cut them in line at the grocery store.

    She'll justify it by saying that they're "raping" her time by making her stand in line, just like everyone else.

    LK

    --
    "Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
  38. Re:Estates of Dead Moviestars will need good Lawye by Danathar · · Score: 1

    Yea, If I were a big movie star I'd have my face detail mapped when I was young (or immediately to retain as much youth as possible) so that in my later years the accuracy would be there. I wonder if some big actors are voluntarily doing that yet?

  39. Amazing, but absolutely not by holophrastic · · Score: 1

    It looks like someone wearing a Harrison Ford mask. It shows, very clearly, just how good Harrison Ford is as an actor.

    This is certainly his face, but it isn't his facial expressions. It isn't his smile. It isn't his brow furl. Those aren't the way that his eyes widen.

    Simply put, it doesn't move correctly.

    And that means that the mechanisms by which Harrison Ford's face is attached to his head are betrayed. Dimples might be there, but they don't restrict the skin's movement.

    It's awesome, in terms of technology, and it's certainly enough to make a casual viewer believe that this is Harrison Ford. But it's also enough to make an expert acting coach believe that Harrison Ford is a terrible actor.

  40. Re:Deep Fakes should be illegal by J05H · · Score: 1

    It's libel at worst. There's no way Deep Fake videos would qualify as assault or sexual assault. This is basic jurisprudence. It's much closer to stating publicly that "Stacey is a slut" versus assaulting Stacey.

    --
    gigantino.tv - Heavy but weighs nothing.