Researchers Have Figured Out How To Fake News Video With AI (qz.com)

An anonymous reader quotes a report from Quartz: A team of computer scientists at the University of Washington have used artificial intelligence to render visually convincing videos of Barack Obama saying things he's said before, but in a totally new context. In a paper published this month, the researchers explained their methodology: Using a neural network trained on 17 hours of footage of the former U.S. president's weekly addresses, they were able to generate mouth shapes from arbitrary audio clips of Obama's voice. The shapes were then textured to photorealistic quality and overlaid onto Obama's face in a different "target" video. Finally, the researchers retimed the target video to move Obama's body naturally to the rhythm of the new audio track. In their paper, the researchers pointed to several practical applications of being able to generate high quality video from audio, including helping hearing-impaired people lip-read audio during a phone call or creating realistic digital characters in the film and gaming industries. But the more disturbing consequence of such a technology is its potential to proliferate video-based fake news. Though the researchers used only real audio for the study, they were able to skip and reorder Obama's sentences seamlessly and even use audio from an Obama impersonator to achieve near-perfect results. The rapid advancement of voice-synthesis software also provides easy, off-the-shelf solutions for compelling, falsified audio. You can view the demo here: "Synthesizing Obama: Learning Lib Sync from Audio"

Comments

You don't need A.I. for that.

[Narcocide]

Call me when they can get the A.I. to reliably produce real news broadcasts.

ain't nothin' true no more

[turkeydance]

slide guitar

I'm sure it will improve

[93 Escort Wagon]

But when I watched the video, I kept seeing places where the lip/mouth movements did not jibe with what was being said. As is, it's not going to convince anyone who's paying attention.

Of course, nowadays almost everyone is staring at their cell phone most of the time... so perhaps the bar is lower than I expect.

Re:I'm sure it will improve

[ShanghaiBill]

I kept seeing places where the lip/mouth movements did not jibe with what was being said.

If you can see the difference, a GAN can also see it ... and correct it. This is the first demo. The tech to will improve rapidly, especially since the demand for fake news is high.

It'll convince people who want to be convinced

[rsilvergun]

and that's the point. There's millions of folks out there itching for an excuse to do what they already want to do. Fake news doesn't work on people thinking critically, but you're not after those.

Re:It'll convince people who want to be convinced

[sound vision]

It's likely this kind of video manipulation can be done better. When someone does do it better, we might not hear about it from "researchers" but see the videos begin to appear in the wild.

Re:It'll convince people who want to be convinced

[Mashiki]

Fake news doesn't work on people thinking critically, but you're not after those.

Not true in the least. Remember when Dateline used model rocket boosters to blow up the gas tanks on pickup trucks? You know their target audience for that show at the time was 30-45 college educated or higher. Fake news works well on anyone who's ideologically deep in a rabbit hole and wants to engage in confirmation bias.

Let's look at two cases over the last 3 years: Gamergate, where the FBI could find no incidences of harassment from anyone tied to it. Demographics educated at college level or higher, married, has family, has high disposable income, roughly 15% are female, has a significant minority quotient from all over the world to boot and aligns politically left. But the media continues on with the lie that they're harassers who pump out death threats, are worse then isis, and then scrub away those women and minorities because they don't fit the narrative(that is if the anti-gg people simply don't call them house n*iggers, or uncle toms). The media view of the people in Gamergate are: single, white, males who live in their parents basement or are virgins living alone. Nice fabrications huh?

Or you can take a look at the "Trump-Russia-Collusion" story. Which has evolved from "Russia colluded with Trump" to "his son talked with a lawyer who's visa expired that the Obama administration specifically let back in at the behest of Susan Rice" along with "Putin talked with Trump during dinner." But the entire thing has fallen apart to the point where pundits outside of the main of the party are saying "shut-up, this is hurting us more then helping." If the media has one narrative, it's very easy to see from the outside. But it sure is self-reinforcing if you're in that rabbit hole.

Progress, but not yet out of the Uncanny Valley

[Anonymous Coward]

There's a lot of progress I see, but watching the video, the artificial bit still looks a bit creepy and weird. We're not out of the uncanny valley for this sort of thing yet.

Re:Oh yeah.

[Mal-2]

They probably started this research while Obama still was president, and besides, they probably liked him. If there's anyone who can use the "fake video" defense now, it's him -- even if it's someone else's work. In that way, they've done him a favor.

Lipreader says no.

[mykro76]

I'm deaf and have been lipreading for more than 40 years. I can confirm these videos are not lip-readable - many words are only half formed (one syllable where there should be two) and the mouth transitions are too jerky. It's a good attempt and I'm positive the tech will just keep getting better, but right now, it's not there yet.

Re:Lipreader says no.

[Anonymous Coward]

Chances are it's more than good enough to feed the typical viewer, who will be very quick to "inform" you that not only is lip-reading inaccurate but that you're just a crackpot trying to make shit up to feel better about being crippled.

Then they'll remind you that Oceania has always been at war with Eastasia and that you'd know this if you could understand news.

They call this news??

[FrankHaynes]

I've seen recent news broadcasts and the only thing that would mimic them successfully would be Artificial Stupidity.

Nothing new

[holophrastic]

A long time ago, news was spoken, and you decided to believe, or not to believe, the person telling the tale.

A while ago, news was written, and you decided to believe, or not to believe, the author writing it.

Somewhere along the way, more and more people began to presume that everything is true -- maybe because most of it was, or maybe because they were just that stupid.

Congrats! Those times are over.

Now, once again, you get to spend more time evaluating the source than the content. Enjoy!

It doesn't matter anymore

[bussdriver]

They can easily fool 33% of the nation with flat out lying why do they need to fake anything. Trump Jr can admit a meeting happened, release evidence and still have 1/3 believe it never happened! Trump really could shoot somebody out in the street on TV and not do any worse in the polls.

Autist says no.

[Anonymous Coward]

Being on the autism spectrum, I have a tendency to focus on peoples' mouths when they speak. I would characterize the quality of the generated content as abysmal.

One of the major giveaways is that phonemes which involve the lips interacting with teeth are way off. Just not even close. The word "visited" looks for all the world like what's being said is "dizited". How can they generate a 'd' motion for a 'v' sound and still have the balls to publish their paper, let alone make any sort of claims that it's believable? It's absolutely galling, precisely because it's only accurate enough to fool people who want to be fooled, leaving those of us who know better shouting weakly from the proverbial back of the room.

Foreigners says no.

[Zaatxe]

I grew up in a country where most foreign shows and movies are shown dubbed on TV. The result videos look exactly like a dubbed movie to me. My brain automatically says "this is not the original audio from this footage" when watching this.

Re:The Running Man

[PoopJuggler]

The Apprentice?

Block chain to the rescue?

[Aristos Mazer]

Sci-fi author Ian Banks had this problem in his futuristic The Culture novels. His solution: have repositories of record scattered everywhere that any recording device would upload to in real time. The repository would cryptographically sign the recording then download it back to the recording device. That provided both the sequence ordering and verifiability for the recordings at any future date. Banks wrote that before the arrival of block chain tech. The crowdsourced signing ability of the block chain is being used for things far beyond digital currency already. Seems like we need recording devices that can add hashes of their recordings to the block chain so that there is a record of where and when a given video was shot that cannot be falsified or denied. If we get to the point where most commercial recorders are using that service, we could once again have verifiable news. Seem viable?