Reddit Bans 'Deepfakes' AI Porn Communities (theverge.com)

Reddit has banned the r/deepfakes subreddit that's devoted to making AI-powered porn using celebrities' faces, classifying it as a form of "involuntary pornography." Reddit follows several other platforms that have already banned deepfakes pornography, including Pornhub, which said yesterday that deepfakes imagery counted as nonconsensual pornography. The Verge reports: In a post today, Reddit announced an update to its rules on posting sexual imagery of a person without their consent. The new rule extends a ban on posting photos or video of people who are nude or engaged in sexual acts without the subject's permission, saying that this includes "depictions that have been faked" -- including the sophisticated face-swapped videos that have become especially popular on Reddit over the past month. "Do not post images or video of another person for the specific purpose of faking explicit content or soliciting 'lookalike' pornography."

This doesn't affect all AI-based face swapping enthusiasts on Reddit. The subreddit for FakeApp, a program that allows anyone to swap faces in videos, is still online. So is r/SFWdeepfakes, which is devoted to non-pornographic use of the technology. At least one small, specific subreddit devoted to simulated porn for an individual actor also seems to have slipped under the radar. But along with the central deepfakes hub, the main subreddit for posting not-safe-for-work deepfakes has gotten shut down, and so has the community r/YouTubefakes. The subreddit r/CelebFakes, which focused on non-AI-powered photoshopped pornographic images, was initially left online, but removed shortly after the announcement. The site will rely on "first-party reports" to shut down future deepfakes material.

Comments

Re:Setting a bad precedent

[irrational_design]

Except now you can see that the technology to do it is not revolutionary, but merely evolutionary.

Re:Setting a bad precedent

[Anonymous Coward]

I think I agree with you. I've gone back and forth about this and haven't been sure what to make of it.

The thing about deepfakes, from a moral or legal perspective, is that they are explicit about the porn being fake. So it doesn't make sense to me that it's "nonconsensual" pornography because the posters are posting it explicitly as being fake, because it's fake. That's part (emphasizing the part) of the reason for its appeal--the novelty of it.

If someone posted some deepfake porn and misrepresented it as real, it seems then you'd have real grounds for liable or something like that.

I guess I also see this as setting a really bad precedent, because I see the logic as basically flawed.

Think of it another way: if I make deepfake porn on my own computer, and don't share it, have I now engaged in some sort of sexual assault or nonconsensual act? Because that's what this logic leads to. But that seems flawed to me because I created it without any involvement of the other person at all, with nothing that was obtained without their consent.

Precedent on this was set decades ago

[Solandri]

In most of the world, you have the right to control your own image. Someone can't create a likeness of you and distribute it without your permission. That's why reality shows blur out the faces of people walking around in the background.

If someone using this app got the celebrity's written permission before pasting their face onto a porn star's (and permission of the original movie copyright holder), I'm sure Reddit wouldn't have a problem with it. But likely all of this is being done and distributed without the consent of the people whose faces are being used. That makes it a huge liability for Reddit to allow its distribution via their site, and they're wisely taking steps to keep themselves from being sued into oblivion in what are pretty clearly open and shut cases..

The future you cite can still happen. But the actor you pick for your customizable movie has to have given consent before their likeness can legally be used in the movie. And you can still do it as much as you like and to anyone whom you wish in the privacy of your own home. You just can't distribute it.

But what about satire?

[Miles_O'Toole]

I think a pretty good First Amendment case could be made for a "Deepfakes" porno of a chubby old gay man with Trump's face being enthusiastically backscuttled by a hugely hung dude wearing Putin's face. Call it satire, call it comedy, call it fair comment. It doesn't matter. Even done perfectly, nobody would believe it was real, so it would be hard to argue that either Trump or Putin would suffer the kind of opprobrium associated with a porn video intended to deceive people into believing such an event actually took place.

Voat = Good intentions; invaded by assholes

[Anonymous Coward]

To be, as a newbie, at first glance, this looks like a site, interested in breaking the groupthink and circle-jerk that is emerging from and inherent in the concept of upvoting, on sites like Reddit. At least the buttons title "subversive" on the right tell me that. That sounds very nice.

At second glance, I see loads of people posting racist shit about "kikes" and old Nazi depictions of Jews, etc. And even though as a half-German, I have seen both sides of this, with Jews being one of the groups suffering in WWII, and Jews themselves becoming the Nazis in Israel (making their grandparents turn in their graves [which is why Germany will soon run purely on renewable power ;]), I ended up not wanting anyone to hate anyone, full stop. So I obviously think this is not very nice, nor very smart.

And at third glance, I remember reading the Snowden leaks, about how various TLAs approach anything they deem "subversive", no matter if good or bad for the American people: By injecting moles, to divide the group via infighting, and to act as agents provocateurs, doing stupid and evil shit that make the group look bad, attracting bad people into the group, and making good people from the group do bad things, ... all in order to discredit them so the media can come down on them and finish them off.
There were, I think, 43 organizations listed in the leaks, that had this done to them... in a single year. Among them were Occupy, Wikileaks (partial "success"), and even the Tea Party. (Which made me re-think my view about all of them, and look up how they originally started out. Most of the groups that were attacked that way, were not originally bad.)
So of course, looking at how those agencies have such a high budget that they don't even know what to spend all of it on, and knowing that they have huge numbers of Internet trolls (yes, just like Russia, except an order of magnitude bigger... but less effective per person, due to having the luxury of being able to be wasteful), I must allow the possibility, that those assholes on voat.co might just be such trolls, trying to ruin the site.

Then again, they might also not be.

Fuck, not being able to ever know, really sucks.
Not having a site that isn't obedient goose-stepping circle-jerking groupthink, sucks nearly as much.

<ramble/><ramble/><ramble/>