Slashdot Mirror


Algorithm Automatically Spots 'Face Swaps' In Videos (technologyreview.com)

yagoda shares a report from MIT Technology Review: Andreas Rossler at the Technical University of Munich in Germany and colleagues have developed a deep-learning system that can automatically spot face-swap videos. The new technique could help identify forged videos as they are posted to the web. But the work also has sting in the tail. The same deep-learning technique that can spot face-swap videos can also be used to improve the quality of face swaps in the first place -- and that could make them harder to detect. The new technique relies on a deep-learning algorithm that Rossler and co have trained to spot face swaps. These algorithms can only learn from huge annotated data sets of good examples, which simply have not existed until now. In semi-related news, the Screen Actors Guild-American Federation of Television and Radio Artists (SAG-AFTRA) says it's "fighting back" against the dangers posed by new face-swapping technologies that have been used to digitally superimpose the faces of its members onto the bodies of porn stars.

"SAG-AFTRA has undertaken an exhaustive review of our collective bargaining options and legislative options to combat any and all uses of digital re-creations, not limited to deepfakes, that defame our members and inhibit their ability to protect their images, voices and performances from misappropriation. We are talking with our members' representatives, union allies, and with state and federal legislators about this issue right now and have legislation pending in New York and Louisiana that would address this directly in certain circumstances. We also are analyzing state laws in other jurisdictions, including California, to make sure protections are in place. To the degree that there are not sufficient protections in place, we will work to fix that..."

40 comments

  1. Superman vs God by PopeRatzo · · Score: 1

    So, can the algorithm create a face swap that even it couldn't detect? I think this may be something of a Zen koan.

    --
    You are welcome on my lawn.
    1. Re:Superman vs God by Anonymous Coward · · Score: 0

      Yes, it is tautological

    2. Re:Superman vs God by alvinrod · · Score: 1

      It runs the other way too though. Once you've created some videos that can't be detected, you can use those as training data for the detection algorithm to make improvements to it until it's able to accurately detect those at which point you can train the creation algorithm to make better fakes.

    3. Re:Superman vs God by goombah99 · · Score: 4, Insightful

      Yes! that's what the whole principle of adversarial learning is based on.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    4. Re:Superman vs God by PopeRatzo · · Score: 1

      Yes! that's what the whole principle of adversarial learning is based on.

      But then wouldn't the face swap detection algorithm also be getting better via adversarial learning at spotting face swaps?

      My question is, who wins, the face swap detecting algorithm or the face swap detecting algorithm trying to create the perfect face swap?

      --
      You are welcome on my lawn.
    5. Re:Superman vs God by goombah99 · · Score: 1

      Yes! that's what the whole principle of adversarial learning is based on.

      But then wouldn't the face swap detection algorithm also be getting better via adversarial learning at spotting face swaps?

      My question is, who wins, the face swap detecting algorithm or the face swap detecting algorithm trying to create the perfect face swap?

      Either the egg or the chicken wins. It's called the optional stopping problem in statistics.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    6. Re:Superman vs God by Anonymous Coward · · Score: 0

      My question is, who wins, the face swap detecting algorithm or the face swap detecting algorithm trying to create the perfect face swap?

      The face swap algorithm wins, it is the only one with a winning state.

      At some point it will reach a quality where the output quality is equivalent with what it would have been in a non-faked video, at that point the competition ends.

    7. Re:Superman vs God by trabby · · Score: 2

      If a fake video algorithm could fake a fake video algorithm, how much could a fake video algorithm fake?

    8. Re:Superman vs God by goombah99 · · Score: 2

      My question is, who wins, the face swap detecting algorithm or the face swap detecting algorithm trying to create the perfect face swap?

      The face swap algorithm wins, it is the only one with a winning state.

      At some point it will reach a quality where the output quality is equivalent with what it would have been in a non-faked video, at that point the competition ends.

      While your logic is on track it omits a crucial ground truth. It's like saying all crypto can be cracked. It's not the same as saying it can be cracked cheaply. If the detection is cheaper to implement than the synthesis then there will be a resource cap in the arms race that favors the detection.

      --
      Some drink at the fountain of knowledge. Others just gargle.
    9. Re:Superman vs God by amicusNYCL · · Score: 1

      That doesn't matter, if it has greater than a 50% confidence then they send out a demand letter for money or to knock you offline anyway and see if you try to fight back. Think back to how often DMCA notices were abused when they were handed over to automated platforms to send them out. That's all this is, the Screen Actors' Guild is not here to protect society (quite the opposite, some might argue). They don't care about you or spotting fake news or whatever, they're just trying to make sure the actors get paid when appropriate and have the ability to order things to be taken offline otherwise.

      This artificial intelligence tool has the ability to steal our images and superimpose them onto another person’s body in potentially unpleasant and inappropriate digital forms. SAG-AFTRA is focused on these emerging processes and fighting back when the technology infringes on our members’ rights.

      If you're not one of their members, then they aren't fighting for you. Hell, they'll probably copyright their tool so that only they can use it.

      Stay woke, bitches.

      --
      "Our two-party system is like a bowl of shit looking at itself in a mirror." - Lewis Black
  2. SAG-AFTRA by PPH · · Score: 1

    "fighting back" against the dangers posed by new face-swapping technologies that have been used to digitally superimpose the faces of its members onto the bodies of minimum scale movie extras.

    FTFY.

    --
    Have gnu, will travel.
  3. dangers? be happy! by ooloorie · · Score: 4, Interesting

    "fighting back" against the dangers posed by new face-swapping technologies that have been used to digitally superimpose the faces of its members onto the bodies of porn stars

    Where is the "danger" in that? Porn stars usually have great bodies, so you'll end up looking great. And you don't have to worry about leaked sex tapes anymore because you always have plausible deniability.

    I think the real reason the screen actor's guild is so up in arms about this is because it makes it much easier for movie producers to mix and match acting ability with looks: they can go for an unknown actor and paste exactly the kind of face on him they want. And licensing your face to be pasted on an unknown actor isn't as lucrative as acting yourself.

    1. Re: dangers? be happy! by Anonymous Coward · · Score: 0

      Thatâ(TM)s exactly what I was gonna say. Anyone can make a sex vid now and if it gets out âoeThat wasnâ(TM)t me. âoe

    2. Re: dangers? be happy! by houghi · · Score: 1

      You mean like they already do? Body of a stunt person, CGI face of a famous apwrson

      --
      Don't fight for your country, if your country does not fight for you.
    3. Re:dangers? be happy! by Anonymous Coward · · Score: 0

      Agreed. Actors should embrace this. Leaked nude selfies and films are now credibly deniable. And if popular films are made using their likeness, they can sue.

      Basically it means that anything seen on film is unreliable unless provenance can be traced fully back to the person who holds the camera. We just have to get more used to this.

    4. Re:dangers? be happy! by Anonymous Coward · · Score: 0

      No way CGI'ing a President could say, trigger a war. https://www.youtube.com/watch?v=ohmajJTcpNk

    5. Re:dangers? be happy! by AmiMoJo · · Score: 1

      The Screen Actor's Guild cares about this for the same reason they care about impressionists and rubber masks - they want to protect their member's likenesses. A big star is an attraction by themselves, even if they are only voicing a character in an animated movie. They certainly don't pay the stars 1000x the going rate because they are a 1000x better actor.

      In the case of deepfakes, a female actress showing some skin is a big draw for a movie. Of course there is also the fact that involuntary pornography is legally dubious at best, but I imagine money is the primary motivation.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    6. Re: dangers? be happy! by Anonymous Coward · · Score: 0

      Sure, but now it is cheap to do.
      When it needed manual matching it was too expensive to use for things that weren't large budget movies or political/military propaganda.

      Now that you can do it on a low budget it is used for shits and giggles, and that is a problem.

    7. Re: dangers? be happy! by houghi · · Score: 2

      If it is cheaper to do, look at the bright side: the studios can put more money in the story, right? Right? That is what they are going to do, right?

      --
      Don't fight for your country, if your country does not fight for you.
    8. Re:dangers? be happy! by Anonymous Coward · · Score: 0

      That's exactly what you guys are feverishly working on in St Petersburg right Ivan?

  4. Someone should earn a award for this! by Fly+Swatter · · Score: 4, Funny

    They correctly used the term algorithm instead of AI.

    1. Re:Someone should earn a award for this! by invalid_user · · Score: 2

      Even "algorithm" is incorrect in this case. The current state of the art depends a lot on data quality, model architecture, and hyperparameters. As an algorithmist, I shudder to call such things algorithm.

  5. Defense attorneyâ(TM)s dream come true by Anonymous Coward · · Score: 1

    Actually, I am waiting the first defense attorney to get an expert to say the criminal caught on camera wasnâ(TM)t the accused. It was a face swap.

  6. Well, it was only a matter of time... by Anonymous Coward · · Score: 1

    Until Emma Watson's photo got superimposed onto Kiera Knightly's body with a photoshopped cock in its mouth.

  7. They tried it with creimer's channel by Anonymous Coward · · Score: 0

    but the algorithm said "Whoah! Whoah! ONE face at a time!"

  8. Porn stars against body-swaps by Anonymous Coward · · Score: 1

    I hear the porn stars are pissed that their bodies are "swapped" onto ordinary actors' faces.

  9. Better Fakes Increase Hollywood Profits by Anonymous Coward · · Score: 0

    When the singularity happens A-list Hollywooders never have to litigate sex tapes, and they can collect royalties for their likeness. Chart please.

    1. Re: Better Fakes Increase Hollywood Profits by Anonymous Coward · · Score: 1

      Disney really dropped the ball on this one. Surprising really.

  10. Algorithm makes deepfakes better by viperidaenz · · Score: 1, Insightful

    If it can spot face swaps and flag them, it can be used to train the face swap algorithms to make them better.

    1. Re:Algorithm makes deepfakes better by Anonymous Coward · · Score: 0

      Yes. Like the summary says.

    2. Re:Algorithm makes deepfakes better by AmiMoJo · · Score: 1

      The main limiting factor seems to be the original video onto which the new face is being mapped. Odd angles, things obscuring parts of the face, poor lighting and the like all make it struggle and look less realistic. Of course, it also helps if the actor the face is being applied to looks somewhat like the target.

      As such, I expect there will soon be a market for porn stars who look a bit like a famous actress and who produce videos specifically designed to make the algorithm work better. If they could get away with things like dots on their faces they would, but for plausible deniability they might have to rely on the deepfake algorithm alone.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  11. Is it just me? by Anonymous Coward · · Score: 1

    Is anyone else imagining this technology being used the other way to put their favourite porn star faces on non-porn movies?

  12. No machines that imitate a human... by bferrell · · Score: 1

    Am I the only one seeing a Butlerian Jihad on the way?

    1. Re:No machines that imitate a human... by Anonymous Coward · · Score: 0

      Also known as the robot apocalypse in pretty much everything not Dune.

      Presumably you aren't the only one since it has been such a common theme in popular culture the last century.

      Depending on how liberal you want to be with your definitions "creation turning on its creator" have been used in storytelling for as long as we have cared to write the stories down.
      The thing that makes Dune a bit different here is that the story isn't focused around the Butlerian Jihad and it is only used to explain why some things are like they are.
      OTOH one can argue that it still shares the same theme since the Kwisatz Haderach program is a creation that turns on its creator.

  13. You all are missing the point by 93+Escort+Wagon · · Score: 4, Funny

    Some grad student figured out a way to get a PhD for watching pornography all the time!

    --
    #DeleteChrome
  14. Rule 34 enforcement by Anonymous Coward · · Score: 2, Funny

    Why are they trying to break one of the laws of the internet? Arrest those fucks.

  15. Not remotely the scariest application of face swap by trg83 · · Score: 2

    It's clear that the SAG is on this because there is a massive amount of money at stake. The real story here is that, should we evolve the technology to the point where no AI or person can detect it, there is a real hazard to liberty. Political enemies could be placed (virtually) in embarrassing or illegal positions, surveillance footage of crimes could be faked, criminals could go free by claiming their surveillance footage was faked. This really shakes the core of things we've learned as "truth." We've known photos were able to be faked, with various amounts of success/believability, for a long time, but the idea of producing videos that can't be detected as fakes is crazy.

  16. Re:Not remotely the scariest application of face s by Anonymous Coward · · Score: 0

    You can't put it back in the box. And in any event, was liberty less endangered when all we had was the printing press? Who is to say that the newspapers weren't providing fake news. After all, how was it possible to travel to the sources of the stories? We just had to take it on blind faith.

    So everyone who believed in "truth" is now getting a rude awakening that everything is and always was assertion.

    Here's another example: I was talking to a Spanish friend about the defeat of the spanish armada by the brits. He said what?!?!? the armada was lost at sea. Which got me to thinking. Who is to say who is correct? The brits or the spanish. Even if you were alive at the time you would have had to be physically present to be able to see it. Then what you tell people afterwards depends on how much of a liar you are.

  17. stop with the deep-learning by Anonymous Coward · · Score: 0

    So dumb, please stop with that descriptor. We get that you did something hard.

  18. Re:Not remotely the scariest application of face s by epine · · Score: 1

    The real story here is that, should we evolve the technology to the point where no AI or person can detect it, there is a real hazard to liberty.

    I've seen thousands of liberty narratives, in all manner formal dress and dishabille.

    Have I ever seen a narrative about liberty which frames liberty as something we're lucky to have only because we we gifted a milieu of sufficient objective agreement (and this only through the magic social pixie-dust of unfakeable images?). No, I have not.

    Libertarian defendant: But your honour, I rendered all these faultlessly realistic videos of my sworn enemies engaging in plausible criminal behaviours for my own personal enjoyment in the privacy of my own home!

    Judge: If we had found ricin on your premises, that wouldn't be a good excuse. I fail to see much real difference here. Both of these activities are equally terrible hobbies.

    ———

    This is the new equivalence: sticks and stones can break your bones, whereas misaligned zeros and ones can get your bones clad in an orange prison jumpsuit. The privacy of your own home shall not remain sufficient cover for certain categories of sticks, stones, sick zeros, and icky ones.

    ———

    Suppose the Feds broke into Guy Fawkes' house on a search warrant and find all the gunpowder stocked in his basement.

    Guy Fawkes: I'm just a novelist, for cripes sake!

    Justice: Right. You need to stockpile actual gunpowder in your house, in large quantities, to write a novel?

    Guy Fawkes: But the realism! The closer I surround myself with the elements of my diabolical plot, the more I really get into the mindset of my traitorous protagonist.

    Justice:Well then, consider this a joint trial: you and your "fictional" protagonist on the docket together. How's the realism feeling now?

    Guy Fawkes: Perhaps I should have bargained for a larger advance.

    Justice: You had a publisher lined up?

    Guy Fawkes: Just a figure of speech, your honour; I was, er, planning to self-publish all along.

    Privacy is sacrosanct up to a point: try not to get a boner over activities identical to planning a real crime.

    ———

    Scratch a libertarian, uncover a slippery-sloper.

    The slippery slope of government overreach just came hard aground on the equally slippery-slope of reputation sabotage.

    That's the real story here: all viable solutions now contain a term that reeks of "up to a point"-ism, distilled from the scandalous snot rag of social consensus (yes, most people agree on this point; the quibbles begin when you wade into the finer points about what to actually do about this).

    Dumbest idea ever: that there's no way to constitutionally triage government overreach. We can't yet do this in social democracy for much the same reason that African states suffering under the legacy of tinpot dictators in the dark aftermath of colonial excess have a lot of trouble adopting democratic institutions western democracies now take for granted.

    If the Central African Republic can some day fully embrace democracy, then Sweden and Britain and Singapore can someday manage to fully embrace government overreach triage. Hard, but doable.

    And thus there will eternally remain certain earthbound activities where privacy is no excuse.

    ———

    And then, all the fake incrimination porn will beam down from asteroid-belt outlaws. Meanwhile, Ceres shall overtake the Cayman Islands as the solar system's foremost tax haven.

    And then one day the President of China wakes up on a foul mood and mutters (audible, just off camera) "nice asteroid you've got there, shame if something happened to it." A week later, a largish well-developed asteroid mysteriously disintegrates, and practically overnight the deluge of fake incrimination porn