Facebook To Fight Revenge Porn by Letting Potential Victims Upload Nudes in Advance (bleepingcomputer.com)
Catalin Cimpanu, writing for BleepingComputer: Facebook is testing new technology that is designed to help victims of revenge porn acts. It works on a database of file hashes, a cryptographic signature computed for each file. Facebook says that once an abuser tries to upload an image marked as "revenge porn" in its database, its system will block the upload process. This will work for images shared on the main Facebook service, but also for images shared privately via Messenger, Facebook's IM app. The weird thing is that in order to build a database of "revenge porn" file hashes, Facebook will rely on potential victims uploading a copy of the nude photo in advance. This process involves the victim sending a copy of the nude photo to his own account, via Facebook Messenger. This implies uploading a copy of the nude photo on Facebook Messenger, the very same act the victim is trying to prevent. The victim can then report the photo to Facebook, which will create a hash of the image that the social network will use to block further uploads of the same photo.
I already have a service that handles this, just send me the pic and I'll handle it....
Cheap storage VM.
I know they "claim" they will not keep the pictures, but only a hash of the image. But do you really trust Facebook that much?
First law of people: People are generally stupid.
April Fools Day on Slashdot?
What's wrong with putting all the nudes of every person on facebook on a database ?
What could go Equifax?
~ People that think they are better than anyone else for any reason are the cause of all the strife in the world.
This reminds me of the humorous PSA where some teenage boys are offering free mammograms...
and sell it to advertisers and the government along with all the other PI you give him. For your protection of course.
You all laughed at me when I started building my labia shape hash algorithm, modded me funny.
Now you see how serious this issue is.
Ladies, send in your labia prints. Otherwise there can be no guarantee you'll be notified.
Next: Unlock you phone with the new 'snail trails' app.
John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
The public reaction to this is understandably somewhat muted and off-put. Why upload nude photos to Facebook, indeed? The claim is that they will compute a hash of the image, and store that to prevent future uploads.
If that is really the case, when why not compute the hash locally on the user's machine, and upload only the hash? Surely that can be done on essentially all modern hardware from cell phone to desktop in a reasonable amount of time.
Put my fist through my alarm clock with its ding-dong death inside my ear. - The Blackjacks.
If you don't want your nudes to end up on the internet, don't send them to other people.
Forcing users to upload highly-sensitive pics to make sure others' won't post them.
There HAS to be a better way.... like: how about analyzing an image and computing the hash on a client device and uploading just the hash + analysis data? Or at the very least.... mask any public individual identifying info inside the image before uploading.
You can't tell me this idea did not come from a bunch of Facebook admins tired of the work it took to Google nudes.
"Let the nudes come to us!", they thought... and so it was.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
Theoretically you could hash files using FileAPI in modern browsers. Alternatively, an offline tool could be used to index your photos on your computer. Both of those scenarios would likely not be accessible via mobile devices although there's nothing preventing the development of a dedicated mobile app that does all of this locally on the device. Open source it so it can audited.
I'm not certain what the exposure is with this approach, in theory someone could abuse the process to claim hashes for other peoples images but I don't think there's any more risk of that with a local process than an online process. Regardless, the idea that you would upload nude images to a third party service like this seems ridiculous. Also, one seventeen year old does it and suddenly the service is in possession of child porn, it's nuts.
The idiocy of this is that if the revenge poster slightly alters the image (resize, re-compress, slight quality change, etc) it changes the hashing.
"All your nub are belong to us"
And I thought I was lazy.
So the proper way to do this is a one way transfer between servers and then disconnect each server from the internet when it's full. Then send requests over a highly restricted local network for comparisons. How they'll actually probably do this is on live, public-facing servers and just try to permissions-protect them or something stupid like that.
If facebook only needs a hash of the image, it should allow users to upload only the hash by providing the hashing function. Or are we talking about something super proprietary here?
Or, maybe, instead of blaming the person who obtained the image fairly for whatever use pleases them, the "victims" should assume the blame themselves and correct their own behavior.
Does no one see the potential pitfalls of training certain 'protected classes' to believe that they have no personal responsibility for their actions?
Imagine the enlargement pill ads when they start figuring out who would actually benefit!
I'm terrible, I'm sorry. I couldn't help myself, the article made it too easy.
He wants to see you neked.
" . . . its system will block the upload process."
Given that revenge porn is a crime in an increasing number of places, shouldn't be include "and notify the police of the attempt"? Does it even notify the user of the attempt?
What are the terms of service on these uploads? Do they include the clause that says "and we can change these TOS any time we want, to anything we want, and there's nothing you can do about it"?
Simply create a utility that lets a user open an image, calculate the hash, and send to facebook. They have enough machine learning ability to look and tell if something is a hot dog or not a hot dog. Or are they going to rely on human beings to review every photo and validate that it isn't, say, a cat photo?
Cute... Facebook pretending they don't have nude photos or a naked composite of everyone already.
"That's the way to do it" - Punch
Wouldn't this be trivially defeated by running the pic through some sort of very minimal filter and then uploading the "new" pic?
Or even just re-saving it as jpeg with the compression cranked up a few percent?
I presumed they would employ an "image hashing" algorithm of sorts, you know like audio fingerprinting. Then again, with how poorly thought out their solution is, I wouldn't expect them to have considered this. Having said that, even the simple hash blocking would prevent many non-savvy users from uploading. A better solution would be to let the uploader think it went through, but keep the post only visible to him so that he/she wouldn't keep trying defeat the filter.
make a tool that computes the hash locally that you then upload, FFS.
The prudishness endemic in American society is not universal. Thankfully, I live in a society that does not tie itself in hypocritical knots because a nipple was shown on TV.
Democracy is a sheep and two wolves deciding what to have for lunch. Freedom is a well armed sheep contesting the issue
Comment removed based on user account deletion
This won't work because someone from Facebook would need to look at the images to determine if a request is legit, which, as the article says, is EXACTLY the thing the victim wants to avoid.
If nobody looks at the image, or, as some have suggested, the hash is computed client side (so nobody would be able to look at the image) it would be ripe for abuse. I could easily file takedowns for any pictures I want.
As a side note, someone also mentioned hashes won't work since they can be foiled by simple image manipulations. Doubtless this will be true in some cases, but it is certainly possible to make an image comparison that can take some of these things into account. Plus, the goal is likely to get the easy image postings automatically, while the remainder will be much smaller in number and easier for Facebook support staff to deal with manually as requested.
I'm personally suspicious of anyone who asks me for my private data -- all the more-so, when the first thing out of their mouth is that they only need it to protect me. And the thought that promptly entered my mind upon reading this particular blurb, is that perhaps somebody deep within the confines of Facebook HQ is positively drooling at the prospect of all those uploaded nudes that will soon be coming his way...
Comment removed based on user account deletion
Awesome, because the day that leaks will be the beginning of the end for Facebook. They say they won't save them, but I don't trust them, not even a little, to keep their word.
There are much better methods of hashing images than stupidly taking a file checksum, such as this one here:
https://pippy360.github.io/tra...
This algorithm here does not care about affine transformations applied to the image, so it can be scaled, rotated, skewed, and still be a match.
Well this is interesting.
You have to send the image to FB. That prevents abuse of the system, since you won't be able to get a hash of the Mona Lisa or some stock photo up there. What it also implies is that the image is verified before the hash is computed. That means that some dude will be looking at your nudes before deciding if it's a real or fake one.
But, why aren't they using an algorithm for this? Well, current models (IsItPorn) aren't remotely there yet. A lot of weird stuff will get hashed and submitted. Second, an algorithm will not have the talent to identify fake stuff or funny stuff. And third, what do you think happens if FB gets it wrong? If they are actively participating in the revenge porn activity they will in fact be liable for any mistake (and the person in question is unlikely to be amicable at the time). So they will absolutely have an employee go through the details to avoid mishaps.
I really hope I can sign up for that job.
There are image similarity algorithms out there that do not care about the absolute hash of the file, and can detect the same image cropped, scaled, or rotated just fine.
Here is one such algorithm:
https://pippy360.github.io/tra...
Assuming this is all automated, I can just upload any picture I don't want anyone else to upload?
If it is not automted/if it is verified by a human, I live it 6 monthes before the leaks start.
You'd only have to tweak one pixel, just a little bit, and the hash would be completely different. I don't believe that "hash" thing. They act like this is gonna be unhackable but it won't be. It's just a very very bad idea unless there is some clever and perfect way to prevent tempering the the picture to change the hash, which would surprise me.
Facebook NudeProtect by Facebook Inc. [invisible unicode here]. Just a simple interface where users can upload their nudes to have them scanned by FB... could even include some fake Hollywood-looking scans and jargon, followed by a "destroying image" blurb. Nothing bad will come of this idea FB has.
As dumb as it sounds, this is how the copyright office handles it already. http://money.cnn.com/2015/04/2...
I haven't read the article, but I assume a file hash won't prevent the abuser from resizing the picture, changing a pixel on the image which will change the hash completely. Unless of course Facebook does something like scale and rotation invariant pattern detection and hashes off of those.
I've made it impossible to take pictures of my junk in the first place, by way of a thick and luxuriant man-bush which tastefully covers all. And the ladies laughed at it! WELL WHO'S LAUGHING NOW!?
"When information is power, privacy is freedom" - Jah-Wren Ryel
First off, is there really a problem with revenge porn on facebook and if there is, it would seem that the easiest solution for
facebook is to block all porn. I've never seen nudes on facebook. I always assumed that it would be against facebook policy
as facebook is mostly a PG-13 kindof place.
Second, I would think that facial recognition would be the correct solution. Let someone upload a picture of their face and
facebook can make sure that that particular face doesn't appear in nudes. An unidentified nude without a face even if someone
says "this is so-in-so" is pretty harmless as if you can't see the face you could pretty much say it is anyone.
Lastly, google just came out with facial recognition for dogs so presumably you could also use that same technology for
tattoos, or specific body parts too.
But again, I would think revenge porn would be primarily a problem on other services not facebook.
Silly iPhone with their limited facial recognition. Facebook will soon offer you the confidence of the far more secure full-body recognition experience.
Check your premises.
Facebook announces new partnership with YouPorn and RedTube.
#DeleteFacebook
If nobody looks at the image, or, as some have suggested, the hash is computed client side (so nobody would be able to look at the image) it would be ripe for abuse.
There is a very easy fix for this - the first time the hash matches the takedown requires human approval. This way someone only looks at the image if the image is already uploaded for people to look at and you can't abuse the system by filing takedowns for random pictures. This would even reduce Facebook's work because instead of checking every upload they only have to check ones which match.
1) Are we sure it isn't April 1st? I've heard of companies doing dumb things but I can't imagine how this anyone thought this was a good idea, are we sure the whole article isn't some kind of prank?
2) IF they were going to try this simple facial recognition should be enough.
I stole this Sig
Yes, but that's not how relationships work. People want to do things that don't work 100% because for that moment they want that person to have access to such things. Then the relationship sours and things that were wanted become unwanted.
If South Park is not making an episode out of this, they dropped the ball[s]!
Seriously, photoshop your own face onto your favorite porn star and send it to Facebook... then wait and see what happens. (if it surfaces anywhere, sue Facebook!)
Stupidity Tests are awesome and I'm glad that the suits haven't taken over Facebook and forced them to lose their sense of humor. I like how Facebook gets to take things to the next level (they already have a population of volunteers who are pre-selected as being ok with Facebook in general). Let's see how many fall for it. 2018 needs good news stories too.
I think this is one of the very best prank ideas, ever. And would Google have thought of something so invasive? Would Microsoft have thought of something so dark? Would Apple have thought of something so limited and constraining? Would Amazon have thought of something this obviously-hair-brained? Facebook wins this round, period, beating everyone else at their own game.
"Believe me!" -- Donald Trump
Seriously, just let the hashes be uploaded in the first place and not the photo. If the tool really is just using hashes, there is no need to send the photo. The only thing that the photo could be used for is for all the other data mining that you have already agreed to, such as advertising uses...
Then of course, there is the insider threat that someone with the keys to the kingdom will have one heck of an amatuer collection on their hands....
We were all warned a long time ago that MS products sucked, remember the Magic 8 Ball said, "Outlook not so good"
we already know that FB is the king of metadata porn, and you want to volunteer genuine porn?
is there an antidote for the Stupid Virus, which seems to be spreading exponentially?
if this is supposed to be a new economy, how come they still want my old fashioned money?
For who?
Facebook? Not a thing, only a new profit center...
For the poor unfortunate unwashed masses who are uploading embarrassing pictures for free? The cat's already out of the bag so what are they going to lose now?
Hey, idiots, here's a thought.... How about not taking such pictures in the first place? That way there is no risk of "exposure" no matter what happens.
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
FB could release an app (maybe more geared for a desktop) to generate the hash on THEIR OWN FREEKIN' PC. Then the hash itself is added to the database.
Sure, the admins at FB won't be able to do....umm, Quality Control?....on the image, but more people would use it if they knew no one else would see it.
But, what if they don't have the image (i.e. the guy took it on his cell and never sent it to her, etc.) This still would not help. Maybe some type of facial recognition tech, but more like Ms. Ballbreaker on Porky's where they would recognize it/them anywhere in a lineup? Boobie-metrics?
I'm starting to like this idea...
"File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
Seriously, Facebook just wants more data to blackmail you with.
Either be OK with pictures of you naked not being private or don't take them at all.
Well, anyone going into a relationship, assuming that it will last forever is an idiot.
We're all human, we all fuck up and most of the time, we split, and not all the time amicably.
So, if you keep that in mind...you'll know it isn't a good idea to let yourself be photographed in nude or sexual situations.
Light travels faster than sound. This is why some people appear bright until you hear them speak.........
.. I was born into. Times really have changed. Funnily enough for by now, I would have ventured personal space travel and flying cars, the preemption of revenge porn never crossed my mind.
But it is a good idea... at the time. It's only after the relationship sours that it becomes a bad idea. People are state machines and every moment is a forever, so it does last forever, just not for all eternity.
"Unless Zuckerberg wants to browse the actual photos." He probably already does.
If I take that view though I'll never get married because by extension, I'd be an idiot to not assume financial ruin.
While this is over the top and probably would have done it, my 'truth is stranger than fiction' moment was when I found out all that stuff on the Internet about the banksters really was true.e.g. almost all the money is really just evidence of interest bearing debt i.e. there is no money, just debt.
"I'd be an idiot to not assume financial ruin."
Yes, you would be. A pre-nup is nearly a must in this day and age.
I don't get this. Why can't you just upload the hash? There are some really fantastic algorithms that are virtually impossible to falsely collide. Then if your former SO uploads something that collides, a real human can still make the final call. A smart algorithm could also "fuzz" the pictures so that if your ex tries to sprinkle pixels, resize, crop, etc., the "fuzzed" shot still has the same hash as the clean shot. All of that could be done client side. FB has no need for the data... but when did that ever stop them?
For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
Oliver's law of assumed responsibility: If you're seen fixing it, you will be blamed for breaking it.
This has been addressed before, as anything that pops up anymore - The accepted approach is if you do have your pix taken, wear a mask. It's that simple. It can be as unobtrusive as the ones Google shows if you search for: nude pictures with mask and view images.
The first step of hashing, per the linked article, involves finding keypoints in the image that are still detected as keypoints even in an affine transformed copy of an image. How is this done? Does it involve scale-invariant feature transform (SIFT) or some other feature detection means subject to a United States patent?
As you say, humans fuck up. An amazingly common form of fuckup is making the assumption that the person you're dating/fucking is completely trustworthy. When people are in love (or just really, really horny, as the case may be), they're just not prepared to think that this person would betray them.
Can't you do stuff to the photo to change the hash? I mean, it can't be that simple, no?
"I believe in Karma. That means I can do bad things to people all day long and I assume they deserve it." : Dogbert
You know it will happen. Especially for nudes.
"I believe in Karma. That means I can do bad things to people all day long and I assume they deserve it." : Dogbert
If Facebook is more trustworthy than your lovers then you've really made some poor choices in your life.
This is just back to basics for what facebook's original intention was; mark zuckerberg's personal snoop and fap source.
Even though I understand the technical explanation behind this, Facebook is going to have a very very hard time suggesting such a thing
Ladies and gentlemen i give you the next big hack target
Will FB be able to fix the obvious and simple dodge: minor changes to the file completely change the hash, making hash-matching filters almost meaningless.
It doesn't have to be completely butt naked does it? Like seriously they need the hash of your dick to know it's you? Can't just use faces, arms and everything else but no?? They need you dick! ;)
Clearly a scam if you ask me.
I'm going to upload photos of things I'm sick of people posting on facebook. :-)
The problem in fact is with the site AssFaceBook. Also RedFaceBook, PronFaceBook, and DoYouKissYourMotherWithThatFaceBook!
None of which to my knowledge facebook has any control over so they can have the best blocker in the world on facebook and it won't do any good.
Or at least make sure that everything on the wedding gift registry is in multiples of two so it's easier to sort things when you split up.