Slashdot Mirror


Researchers Have Figured Out How To Fake News Video With AI (qz.com)

An anonymous reader quotes a report from Quartz: A team of computer scientists at the University of Washington have used artificial intelligence to render visually convincing videos of Barack Obama saying things he's said before, but in a totally new context. In a paper published this month, the researchers explained their methodology: Using a neural network trained on 17 hours of footage of the former U.S. president's weekly addresses, they were able to generate mouth shapes from arbitrary audio clips of Obama's voice. The shapes were then textured to photorealistic quality and overlaid onto Obama's face in a different "target" video. Finally, the researchers retimed the target video to move Obama's body naturally to the rhythm of the new audio track. In their paper, the researchers pointed to several practical applications of being able to generate high quality video from audio, including helping hearing-impaired people lip-read audio during a phone call or creating realistic digital characters in the film and gaming industries. But the more disturbing consequence of such a technology is its potential to proliferate video-based fake news. Though the researchers used only real audio for the study, they were able to skip and reorder Obama's sentences seamlessly and even use audio from an Obama impersonator to achieve near-perfect results. The rapid advancement of voice-synthesis software also provides easy, off-the-shelf solutions for compelling, falsified audio. You can view the demo here: "Synthesizing Obama: Learning Lib Sync from Audio"

46 of 87 comments (clear)

  1. You don't need A.I. for that. by Narcocide · · Score: 2

    Call me when they can get the A.I. to reliably produce real news broadcasts.

  2. ain't nothin' true no more by turkeydance · · Score: 2

    slide guitar

  3. I'm sure it will improve by 93+Escort+Wagon · · Score: 2

    But when I watched the video, I kept seeing places where the lip/mouth movements did not jibe with what was being said. As is, it's not going to convince anyone who's paying attention.

    Of course, nowadays almost everyone is staring at their cell phone most of the time... so perhaps the bar is lower than I expect.

    --
    #DeleteChrome
    1. Re:I'm sure it will improve by ShanghaiBill · · Score: 2

      I kept seeing places where the lip/mouth movements did not jibe with what was being said.

      If you can see the difference, a GAN can also see it ... and correct it. This is the first demo. The tech to will improve rapidly, especially since the demand for fake news is high.

    2. Re:I'm sure it will improve by ale2011 · · Score: 1

      especially since the demand for fake news is high.

      I'm not sure they aimed at producing fake news. Otherwise they would not have designed the tool to require a voice impressionist.

  4. It'll convince people who want to be convinced by rsilvergun · · Score: 5, Insightful

    and that's the point. There's millions of folks out there itching for an excuse to do what they already want to do. Fake news doesn't work on people thinking critically, but you're not after those.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:It'll convince people who want to be convinced by sound+vision · · Score: 3, Insightful

      It's likely this kind of video manipulation can be done better. When someone does do it better, we might not hear about it from "researchers" but see the videos begin to appear in the wild.

    2. Re:It'll convince people who want to be convinced by basecastula+ · · Score: 1

      Fake news doesn't work on people thinking critically, but you're not after those.

      Valid point.

    3. Re:It'll convince people who want to be convinced by Mashiki · · Score: 4, Insightful

      Fake news doesn't work on people thinking critically, but you're not after those.

      Not true in the least. Remember when Dateline used model rocket boosters to blow up the gas tanks on pickup trucks? You know their target audience for that show at the time was 30-45 college educated or higher. Fake news works well on anyone who's ideologically deep in a rabbit hole and wants to engage in confirmation bias.

      Let's look at two cases over the last 3 years: Gamergate, where the FBI could find no incidences of harassment from anyone tied to it. Demographics educated at college level or higher, married, has family, has high disposable income, roughly 15% are female, has a significant minority quotient from all over the world to boot and aligns politically left. But the media continues on with the lie that they're harassers who pump out death threats, are worse then isis, and then scrub away those women and minorities because they don't fit the narrative(that is if the anti-gg people simply don't call them house n*iggers, or uncle toms). The media view of the people in Gamergate are: single, white, males who live in their parents basement or are virgins living alone. Nice fabrications huh?

      Or you can take a look at the "Trump-Russia-Collusion" story. Which has evolved from "Russia colluded with Trump" to "his son talked with a lawyer who's visa expired that the Obama administration specifically let back in at the behest of Susan Rice" along with "Putin talked with Trump during dinner." But the entire thing has fallen apart to the point where pundits outside of the main of the party are saying "shut-up, this is hurting us more then helping." If the media has one narrative, it's very easy to see from the outside. But it sure is self-reinforcing if you're in that rabbit hole.

      --
      Om, nomnomnom...
    4. Re:It'll convince people who want to be convinced by Anonymous Coward · · Score: 1, Insightful

      Oh, have they started coming out with details now? I've stopped reading any stories on it because I got sick of "according to an anonymous source I got from my brothers girlfriends roommates uncles third cousin".

      Care to cite these details in stories that don't include "according to an anonymous source" that are actually crimes?

    5. Re:It'll convince people who want to be convinced by Baron_Yam · · Score: 1

      How nice of you to, as AC, to imply I'm bullshitting.

      Of course, you already know these details are coming from the people actually involved. Trump Jr. Trump's lawyer. The Russian lawyer. Various tweets from the POTUS.

      And Trump financial ties to Russia are a matter of public record - or, in the case of Trump Jr., public bragging.

    6. Re:It'll convince people who want to be convinced by Mashiki · · Score: 1, Troll

      Really? That's the example you're going with? The one where the whole last week has been detail after detail coming to light showing collusion is incredibly likely to any reasonable person?

      You mean the one with the sources of "anonymous" "anonymous" "anonymous" "anonymous source" and so on? Oh yeah. Very solid sources there, just like the one about Russia hacking that electrical grid that WAPO published right.

      I heard through an anonymous source that your waifu is shit. That's 100% true right?

      Just because your panties are in a twist, I'll even add something that doesn't relate to it. Where Kotaku and Destructiod Turns around and lies about a mentally ill person filing multiple false DMCA's to get games taken down, and issuing death threats against those people. But Kotaku ignores the death threats that the person filing the DMCA's is sending.

      But just jumping back to Trump, the only dog I've got in this race is that he's doing more for Canada then Trudeau is. But nice job on showing how much of a bubble you're really in. I'd hate to see what your comments on Andrew Jackson back in the day would have been like.

      --
      Om, nomnomnom...
    7. Re:It'll convince people who want to be convinced by Mashiki · · Score: 1

      No, Trump Jr., his lawyer, the Russian lawyer he met with, and Trump's tweets.

      You mean that meeting that lasted less then 20 minutes? How funny that the facts don't fit your version of reality especially after it's all been publicly aired.

      Odd that as a Canadian you're a fanatical Trump supporter. Perhaps you're butthurt that Harper lost and Canada failed to pursue more American-style politics?

      Want to show me that fanatical support? Canada could do more with perusing US style politics, especially weakening of federal powers towards the public and provinces. Actually guaranteeing land ownership(something we don't have in Canada), and having actual freedom of speech. Again something we don't have in Canada. We have "speech which is permitted under law."

      Personally I'm not aligned with any of the parties or their platforms, American or Canadian, and consider the Liberals to have been a case of 'least evil'.

      The same liberals that have simply rolled from one scandal to another everytime that they're in power? Under Chretien it was Adscam, under Trudeau Jr., it's pay-for-play and multiple ethics violations. Under Trudeau Sr., it was the night-of-long-knives. Yes, less evil there...

      Perhaps you should ask yourself how well it's reflecting in the province of Ontario, where the provincial Liberals are expected to be a non-party by July of next year.

      --
      Om, nomnomnom...
  5. This shit's getting way too dangerous. by Anonymous Coward · · Score: 1

    I remember when something similar happened a few years ago when it came to changing the video/voice on pre-recorded media. What I fear, is a 1984 situation where people in power change what context to suit their agenda. What happened, won't necessarily be what happened.

  6. Progress, but not yet out of the Uncanny Valley by Anonymous Coward · · Score: 2, Insightful

    There's a lot of progress I see, but watching the video, the artificial bit still looks a bit creepy and weird. We're not out of the uncanny valley for this sort of thing yet.

  7. Re:Using Obama might have been a mistake by ArchieBunker · · Score: 1

    Larry Bud Melman?

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
  8. Trump by Anonymous Coward · · Score: 1, Funny

    Great, now we can make a video of our current president saying some crazy shit ... oh wait.

  9. That's the best you've got? by Anonymous Coward · · Score: 1

    It looks like dog shit. Superdelux on YouTube does a better job.

  10. The Running Man by Lije+Baley · · Score: 1

    Pretty soon somebody's gonna get framed and end up on a deadly game show, and not that rip-off version with the whiney kids.

    --
    Strange things are afoot at the Circle-K.
    1. Re:The Running Man by PoopJuggler · · Score: 2

      The Apprentice?

  11. Obligatory by fred911 · · Score: 1

    https://m.youtube.com/watch?v=...

    Just a more polished version.

    --
    09 F9 11 02 9D 74 E3 5B - D8 41 56 C5 63 56 88 C0 45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  12. Oh yeah. by dohzer · · Score: 1

    Oh yeah, Obama is definitely the one I'd be using the software on first. Definitely not the "grab her by the pussy" speech, no way.

    1. Re:Oh yeah. by Mal-2 · · Score: 3, Insightful

      They probably started this research while Obama still was president, and besides, they probably liked him. If there's anyone who can use the "fake video" defense now, it's him -- even if it's someone else's work. In that way, they've done him a favor.

      --
      How is the Riemann zeta function like Trump rallies? Both have an endless number of trivial zeros.
  13. Re:Now Trump can deny anything by skids · · Score: 1

    I think they'd need more footage than they have of him actually talking about "adoption"... and to train it on Russian.

    Though they do have plenty of footage of him talking about golf and grandchildren...

  14. Lipreader says no. by mykro76 · · Score: 5, Informative

    I'm deaf and have been lipreading for more than 40 years. I can confirm these videos are not lip-readable - many words are only half formed (one syllable where there should be two) and the mouth transitions are too jerky. It's a good attempt and I'm positive the tech will just keep getting better, but right now, it's not there yet.

    1. Re:Lipreader says no. by Anonymous Coward · · Score: 2, Insightful

      Chances are it's more than good enough to feed the typical viewer, who will be very quick to "inform" you that not only is lip-reading inaccurate but that you're just a crackpot trying to make shit up to feel better about being crippled.

      Then they'll remind you that Oceania has always been at war with Eastasia and that you'd know this if you could understand news.

    2. Re:Lipreader says no. by Gussington · · Score: 1

      I'm deaf and have been lipreading for more than 40 years. I can confirm these videos are not lip-readable - many words are only half formed (one syllable where there should be two) and the mouth transitions are too jerky. It's a good attempt and I'm positive the tech will just keep getting better, but right now, it's not there yet.

      The scary part is that the 'yet' is probably only a couple of years away. Then imagine a world where anyone can create their own production of any person saying anything they like.

  15. Re:Using Obama might have been a mistake by fustakrakich · · Score: 1

    He already plays Trump...

    --
    “He’s not deformed, he’s just drunk!”
  16. They call this news?? by FrankHaynes · · Score: 4, Funny

    I've seen recent news broadcasts and the only thing that would mimic them successfully would be Artificial Stupidity.

    --
    slashdot: A failed experiment.
  17. Nothing new by holophrastic · · Score: 2

    A long time ago, news was spoken, and you decided to believe, or not to believe, the person telling the tale.

    A while ago, news was written, and you decided to believe, or not to believe, the author writing it.

    Somewhere along the way, more and more people began to presume that everything is true -- maybe because most of it was, or maybe because they were just that stupid.

    Congrats! Those times are over.

    Now, once again, you get to spend more time evaluating the source than the content. Enjoy!

    1. Re:Nothing new by Gussington · · Score: 1

      A long time ago, news was spoken, and you decided to believe, or not to believe, the person telling the tale.

      A while ago, news was written, and you decided to believe, or not to believe, the author writing it.

      Somewhere along the way, more and more people began to presume that everything is true -- maybe because most of it was, or maybe because they were just that stupid.

      Congrats! Those times are over.

      Now, once again, you get to spend more time evaluating the source than the content. Enjoy!

      I think you have that wrong. A long time a go there was a cost to distributing information, so only a few could do it, and those people sent consistent messages (rightly or wrongly). Over time the information source was mostly reliable so trust was developed. Now information is free to create, distribute and imitate, and the messages are inconsistent and unreliable. This creates a situation where no information can be trusted. Not even smart people will have the means to validate the information since the validation sources can also be easily faked. the result is no information is trusted, thus information becomes worthless. I feel a prophecy of doom coming on...

  18. Let me save you some money by merky1 · · Score: 1

    Instead of investing time on this, just go to reddit / 4chan and wait a few minutes. This whole "fake news" debacle is really just the same old trolls with new outfits.

    --
    --WooooHoooo--
  19. It doesn't matter anymore by bussdriver · · Score: 2

    They can easily fool 33% of the nation with flat out lying why do they need to fake anything. Trump Jr can admit a meeting happened, release evidence and still have 1/3 believe it never happened! Trump really could shoot somebody out in the street on TV and not do any worse in the polls.

  20. it's just things he said by gl4ss · · Score: 1

    out of context.

    with a rendered bobblehead? why the fuck would you need that.

    just take them out of context and boom, there you have it.

    --
    world was created 5 seconds before this post as it is.
  21. About suckers and tricksters by CustomSolvers2 · · Score: 1

    When using software and mainly when being in internet, convincingly faking anything is very difficult or even impossible. Simply because there are usually many ways to reliably confirm any issue. The most curious bit is that the most afraid-to-be-tricked (= the most ignorant individuals) are the ones making the smallest effort to avoid such an outcome. People falling for fake anything in internet are usually the ones blindly trusting in the first thing appearing in front of their faces; behaviours which seem to support ideas like these people really deserving to be lied.

    DISCLAIMER: I never lie or try to trick anyone into anything. In fact and as explained in one of my last posts, I am having lately an extremely honest and direct attitude in each single aspect of my (software development) activity, what seems to have provoked the curious consequence of the unmotivated fears of some people to unmotivatedly grow even stronger (not precisely concerned; I am actually kind of enjoying so much stupidity).

    DISCLAIMER 2: I don't defend criminal/dishonest activity of any kind. I don't feel much sorry for people suffering the consequences of their negligence or even dishonesty (the scenario of the sucker seriously thinking that is tricking the trickster seems quite common) either.

    DISCLAIMER 3: even by forgetting about all what I am writing above and other relevant issues like training/validating the algorithm, the linked video seems quite fake to me.

    --
    Custom Solvers 2.0 = Alvaro Carballo Garcia = varocarbas.
  22. Autist says no. by Anonymous Coward · · Score: 5, Informative

    Being on the autism spectrum, I have a tendency to focus on peoples' mouths when they speak. I would characterize the quality of the generated content as abysmal.

    One of the major giveaways is that phonemes which involve the lips interacting with teeth are way off. Just not even close. The word "visited" looks for all the world like what's being said is "dizited". How can they generate a 'd' motion for a 'v' sound and still have the balls to publish their paper, let alone make any sort of claims that it's believable? It's absolutely galling, precisely because it's only accurate enough to fool people who want to be fooled, leaving those of us who know better shouting weakly from the proverbial back of the room.

    1. Re:Autist says no. by nazrhyn · · Score: 1

      "Galling" might be a bit strong; this is definitely an incremental improvement over some previous techniques. You're also making a soft implication ascribing nefarious intent to this research that I'm not sure is reasonable.

  23. Foreigners says no. by Zaatxe · · Score: 3, Interesting

    I grew up in a country where most foreign shows and movies are shown dubbed on TV. The result videos look exactly like a dubbed movie to me. My brain automatically says "this is not the original audio from this footage" when watching this.

    --
    So say we all
  24. German researchers did this last year by Harald+Paulsen · · Score: 1

    https://qz.com/654669/nothing-...

    A research team has created software that allows them to control the face of anyone in any video. Using advanced facial recognition, it looks at about 15 seconds of any face in a video and creates a 3D model of that face in real time.

    --
    Harald
  25. Commence Running Man! by midifarm · · Score: 1

    The predictions are here!

  26. Pelevin predicted this by stiebrs · · Score: 1

    Full-parliament renders from Generation P coming to countries of your choice soon

  27. Block chain to the rescue? by Aristos+Mazer · · Score: 3, Interesting

    Sci-fi author Ian Banks had this problem in his futuristic The Culture novels. His solution: have repositories of record scattered everywhere that any recording device would upload to in real time. The repository would cryptographically sign the recording then download it back to the recording device. That provided both the sequence ordering and verifiability for the recordings at any future date. Banks wrote that before the arrival of block chain tech. The crowdsourced signing ability of the block chain is being used for things far beyond digital currency already. Seems like we need recording devices that can add hashes of their recordings to the block chain so that there is a record of where and when a given video was shot that cannot be falsified or denied. If we get to the point where most commercial recorders are using that service, we could once again have verifiable news. Seem viable?

  28. Another chunk taken out of free will by computerchimp · · Score: 1

    How can we have free will when our world is artificially shaped to manipulate us?
    There is something to be said for the time when we had to dwell in caves.

  29. Um.. if you're engaging in confirmation bias by rsilvergun · · Score: 1

    you've already stopped thinking critically...

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Um.. if you're engaging in confirmation bias by Mashiki · · Score: 1

      you've already stopped thinking critically...

      Sentence unclear. Contains supposition only, contains no argument. I sure hope you're not a programmer by trade.

      --
      Om, nomnomnom...
  30. 'V' fail. It might have helped if at least by PJ6 · · Score: 1

    one of the researchers was a native English speaker.