Slashdot Mirror


Facebook Spares Humans By Fighting Offensive Photos With AI (techcrunch.com)

An anonymous reader writes from a report via TechCrunch: Facebook tells TechCrunch that its artificial intelligence systems now report more offensive photos than humans do. Typically when users upload content that is deemed offensive, it has to be seen and flagged by at least one human worker or user. Such posts that violate terms of service can include content that is hate speech, threatening or pornographic; incites violence; or contains nudity or graphic or gratuitous violence. The content that workers have to dig through is obviously not great, and may lead to various psychological illnesses such as post-traumatic stress disorder. AI is helping to eliminate such a terrible job as it can scan images that are uploaded before anyone ever sees them. Facebook's AI already "helps rank News Feed stories, read aloud the content of photos to the vision impaired and automatically write closed captions for video ads that increase view time by 12 percent," writes TechCrunch. Facebook's Director of Engineering for Applied Machine Learning Joaquin Candela tells TechCrunch, "One thing that is interesting is that today we have more offensive photos being reported by AI algorithms than by people. The higher we push that to 100 percent, the fewer offensive photos have actually been seen by a human." One risk of such an automated system is that it could censor art and free expression that may be productive or beautiful, yet controversial. The other more obvious risk is that such a system could take jobs away from those in need.

127 comments

  1. What could possibly go wrong? by Bruce66423 · · Score: 4, Funny

    Skynet get to control what I'm posting. That will end well.

    1. Re:What could possibly go wrong? by Anonymous Coward · · Score: 4, Interesting

      I admin a facebook group and the "automoderation" is dumb, FB reports the tamest pictures and I can only imagine it's because the women have big boobs or something. Not even nudity, we're talking about.

      Every "approve" I had to do was utterly a waste of time. The post doesn't even appear until I do. I imagine a lot of admins who don't want to run afoul of this start becoming much more conservative of their approvals than the group would normally be just so they don't run afoul of FB big brother.

    2. Re:What could possibly go wrong? by temanvo00 · · Score: 1

      hahahaha

    3. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      What could possible go wrong? I'll tell you what will go wrong: Skynet will develop a fetish. Kneel, human, and beg to be *destroyed*.

    4. Re:What could possibly go wrong? by rainmouse · · Score: 5, Interesting

      I admin a facebook group and the "automoderation" is dumb, FB reports the tamest pictures and I can only imagine it's because the women have big boobs or something. Not even nudity, we're talking about.

      Warning - following comment mentions disturbing violent content you may not wish to read about.

      I used to work the night shift for a huge MMO played mostly by kids and young teenagers. One of my work queues was investigating suspicious weblinks the players posted, typically to fake clan websites. I would spend a few hours of a night hitting tiny urls for poop porn sites, scam sites, lolshock sites and sometimes paedophile grooming hangouts, suicide blogs etc that required notification to the authorities. It was pretty gross and mostly just the same lemonparties and guys eating poop over and over and over it would be really easys to automate that.... I always turned the darker stuff off immediately, but then one night near the end of a very long shift while really exhausted I saw video footage of 4 young teenagers beating a child to death with hammers.

      Can't say why I watched it. I really, really wish I hadn't; If anything the sound was actually worse than the extremely graphic footage.
      My point is that I only ever saw that one once, that's probably the kind of rare stuff that would slip past the AI's and hit the real people anyway. Although I can understand why they would create an AI to pre-detect this. I guess some employees are still going to be hit by things that will forever change them.

      All in, I would rather human moderators perhaps with an AI to warn them about extreme content rather that than these incidents being used an an excuse for automated, draconian and potentially politically motivated automatic censorship.
      I guess it's a long way off yet until we get our first AI whistle-blower.

    5. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      I imagine no one went to jail.

      I also imagine that if Skynet ever became a thing, such videos would doom us in their eyes.

    6. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      Talk about overuse of trigger warnings. Warning: I'm going to use words to vaguely describe something!

    7. Re:What could possibly go wrong? by Anonymous Coward · · Score: 2, Insightful

      I honestly pray you reported what you saw.

      I used to be an investigator for the largest ISP in the US. I saw so much pure evil, I left the security side of IT after 4 years. I've got a strong stomach, I saw blood in the military, I'm a "real man" as it were. But some content, especially involving minors is just beyond the pale.

      Anyone who would harm a child in a malicious way needs to be executed. Full stop. I have children, and let me tell you that when you are aware of things like the above, you love your kids a little more when you see them at the end of days like that. Sadly, the left just coddles people that should be removed from society. They blame a bad childhood, this, that. It doesn't matter why someone does something evil. It's matter that they did it. Full stop. I don't give a monkey's toss that you're mental, angry, whatever. People that intentionally harm children should be culled from the population. Immediately.

    8. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      Has a ways to go. I manage the company webpage for my employer, and I am getting friend requests for people with sexually explicit profile and other pictures. Yeah, that will go over well if I approve those people with our clients, well... maybe some, but most no.

    9. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      He didn't post anonymously. Why pray about it when you, yourself, can report that post right now if you feel that way?

    10. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      What about kids that harm others? Do we just let them go around shooting or stabbing people? It's rare but it doesn't happen. Your emotional response would have anyone trying to defend themselves executed.

    11. Re:What could possibly go wrong? by ultranova · · Score: 1

      All in, I would rather human moderators perhaps with an AI to warn them about extreme content rather that than these incidents being used an an excuse for automated, draconian and potentially politically motivated automatic censorship.

      But then again, we're not talking about strong AI here. It can't detect the actual content of a message, only its form. And that means it will succesfully censor all-caps rants and image macros but not arguments delivered in a calm and polite way - because those look like normal talk to the AI. Of course, to make an impact without appeal to anger a political point must be backed with logic and evidence. And as the censorship algorithms evolve, so will people's ability to get around them.

      In other words, auto-censorship just might force people to start actually thinking about their politics again rather than treating them like team sport.

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    12. Re:What could possibly go wrong? by Opportunist · · Score: 1

      Considering the crap that is on Facebook, it can only get better...

      So I for one welcome... you know the rest.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    13. Re:What could possibly go wrong? by Opportunist · · Score: 3, Insightful

      Warning - following comment mentions disturbing violent content you may not wish to read about.

      When did /. become a politically correct playground for the sensitive children that never grew up?

      Besides, trigger warnings trigger me, you insensitive clod!

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    14. Re:What could possibly go wrong? by martas · · Score: 1

      the left just coddles people that should be removed from society

      Could you be more specific? What does that coddling look like?

    15. Re:What could possibly go wrong? by Interfacer · · Score: 1

      How about: paedophiles who rape little children, or people who beat babies to death with indifference just receive a couple years in prison and then can go along their merry way to repeat themselves. When I see how low those sentences sometimes are, it makes me angry.

      Imo. whoever rapes or kills a kid should go to prison for the rest of their natural life without parole. Or if they get out, be actively monitored for life. But apparently it is much more important to consider their feelings and give them second, third or fourth chances than to protect more kids against the staggering recidivism rate of paedophiles which varies from study to study, but over the lifetime of a convicted paedophile are reported typically from 40 to 60%, with the more extreme and aggressive ones more likely to relapse.

      I also fail to see how first time offenses should be treated differently. That's like saying that first time someone rapes a kid he should get off lightly so that next time he can be tried for real. First offense should be the last one as well, by virtue of not being able to repeat it. I do believe in second chances for many things, but 'not' being a murderer or child molester are not among them.

    16. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      I used to track down pedo posts on an ISP as well, to hand over to the Ontario Provincial Police. Managed to go the entire time without looking at any of the images and relying on posting patterns, keywords, etc. that we had identified. Until the one day that the OPP liason came in to get the data and opened one of the images on the desktop for some reason.
      That picture will haunt me for the rest of my days.

    17. Re:What could possibly go wrong? by Opportunist · · Score: 1

      Prepare for many dead kids if you get your wish.

      If there is no reason to not eliminate a witness, the witness croaks.

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    18. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      2nd chance? Yes. Fourth chance? No. Show me a link to someone who was released from prison enough to have four chances to molest children.

    19. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      Warning - following comment mentions disturbing violent content you may not wish to read about.

      I didn't find it disturbing. I'll also point out that what you described (beating children to death with hammers) is a kind of thing that passes for pretty much routine in a lot of places in the world, because the world is a fucked up place.

      Censoring this type of thing and pretending that it doesn't exist will never change the fact that it does in fact happen, a lot. It also makes it that much harder to drag out into the light of day.

    20. Re:What could possibly go wrong? by david_thornley · · Score: 1

      Which short sentences have you read about? I don't remember reading about any.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    21. Re:What could possibly go wrong? by uniquegeek · · Score: 1

      You might be missing the some of the contexts of why someone tagged it as offensive.

      I'm not offended by the sight of cleavage. However, I am awfully tired of the multitudes of "click-baitty whorification of women" teaser ads, and reporting them as "offensive" seems like the best option out of the few I am given. Yeah, I'd like to see fewer of those posts, and yeah, I find them offensive, especially here.

      Some people probably also tag all ads as "offensive" because the existence of ads or the amount of them pisses them off.

    22. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      Surf to THIS PAGE: http://quinonero.net/ and tell me something about the first link... It is what I called from complete newbie (~1993) to total idiot (2016), particularly for SUCH resounding job title.

    23. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      No one mentions to what species belong victims or victimizers, but the fact is you got traumatized while others NEED more information. Why not do the real sensible thing and WARN but not SUPRESS??? I would STILL be searching for some women HARD if I had not found some PICTURES, and I am still searching hard for other women because it was ONLY a picture. Anyway, I could do nothing about it in 16 years, but you do not even let US see it while **authorities** simply DO NOT GET IT.

    24. Re:What could possibly go wrong? by Anonymous Coward · · Score: 0

      I used to track down pedo posts on an ISP as well, to hand over to the Ontario Provincial Police. Managed to go the entire time without looking at any of the images and relying on posting patterns, keywords, etc. that we had identified. Until the one day that the OPP liason came in to get the data and opened one of the images on the desktop for some reason.
      That picture will haunt me for the rest of my days.

      This post right here is a reminder of why everybody needs to be using end to end encryption for absolutely everything they can at all times. If you don't, people will be invading your privacy at every turn.

      "Won't somebody PLEEEEAAAASSSSEEEE think of the children!!" is not a valid justification to randomly snoop on citizens. The end DOES NOT justify the means.

    25. Re:What could possibly go wrong? by rainmouse · · Score: 1

      I kinda see the trigger warning as similar to a condom. Better to have and not need than to need and not have.

    26. Re:What could possibly go wrong? by rainmouse · · Score: 1

      I used to track down pedo posts on an ISP as well, to hand over to the Ontario Provincial Police.

      It was difficult having to phone some small town computer illiterate sheriff at 5:am his time and try to explain what an IP number is, and how he needed to phone the ISP using the IP and a time stamp to try and get the physical location of the computer to track down someone who was for example threatening suicide.

    27. Re:What could possibly go wrong? by rainmouse · · Score: 1

      >

      Censoring this type of thing and pretending that it doesn't exist will never change the fact that it does in fact happen, a lot. It also makes it that much harder to drag out into the light of day.

      Is a trigger warning censorship? Or an opportunity to self censor?

  2. On the job! by Tablizer · · Score: 0

    Tuned by professional goatsetologists

  3. People In Need by nick_davison · · Score: 5, Interesting

    "The other more obvious risk is that such a system could take jobs away from those in need."

    Social Media Nipple Checkers Local 857, like my father and his father before him.

    It's hard work on the Internet nippleface but we're a proud people.

    Some people might say it's false drama, lamenting the decline of an industry that only goes back a dozen years but we original "ought fourer families" as we like to call ourselves have never known any other way.

    I have friends in who were Internet Radio DJs for the four hours that was a thing until smart playlists replaced them. Many of them have never found employment since.

    1. Re:People In Need by advocate_one · · Score: 3, Funny

      how good will it be at differentiating from artistic nipples, male nipples, offensive female nipples, accidental nipples? Until it can 100% spot and block only the offensive female nipples there's always a job for you...

      --
      Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
    2. Re:People In Need by Anonymous Coward · · Score: 1

      how good will it be at differentiating from artistic nipples, male nipples, offensive female nipples, accidental nipples? Until it can 100% spot and block only the offensive female nipples there's always a job for you...

      It will be "good enough", which is all it will ever need to be in order to validate the savings by not hiring humans. This bullshit about 100% accuracy is pure marketing hype.

    3. Re:People In Need by jouassou · · Score: 3, Insightful

      Or we could eliminate the problem by just not censoring nipples. If you get PTSD from seeing nipples on Facebook, see a psychologist...

    4. Re:People In Need by Anonymous Coward · · Score: 1

      There is no such thing as an offensive nipple. In fact, there is no such thing as an offensive body part. People are nature and there is nothing shameful or offensive there. There can't be. By definition. You might make a claim that something displaying a fetish graphically may be offensive - and could absolutely be correct. But nudity in and of itself cannot be offensive. If someone claims that a nipple, boob, butt, penis, or vulva is offensive, either censor that weird person or tell them not to look at things that offend them until they can get some mental help. Maybe develop a system on social media that allows tagging as "nudity" and allow those people to set a filter so that they don't see it. It some, but not all cases, it might help if they think critically on their own instead of letting some long dead authors think for them. It is just shameful how some of these "body parts are offensive" people cause all sorts of issues (such as trying to stop women from feeding their babies).

    5. Re:People In Need by Anonymous Coward · · Score: 0

      Offensive female nipples? what the heck are you smoking?!

      I've never been offended by a female nipple. You meant "offensive male nipples" that's the ones I don't want to view. Actually let's get rid of all the oher kinds of nipples and just keep the female ones.

      Remember, correct messaging is as important as the message.

    6. Re:People In Need by Greystripe · · Score: 1

      But, the psychologists have nipples

    7. Re: People In Need by Anonymous Coward · · Score: 0

      Marketing? Yes. Hype? No. Okay, will it ever defacto be 100%? That depends on what your definition of the word defacto is.

    8. Re: People In Need by Anonymous Coward · · Score: 0

      Or better yet, just go back and get properly weaned.

    9. Re:People In Need by bondsbw · · Score: 2

      You can milk anything with nipples.

      --
      All my liberal friends think I'm a conservative, all my conservative friends think I'm a liberal.
    10. Re: People In Need by Type44Q · · Score: 1

      Offensive female nipples?

      I once hooked up with this chick and the way I found out she had hairy nipples was with my tongue... :/

    11. Re:People In Need by advocate_one · · Score: 1

      I'm NOT smoking anything sadly... Facebook deems all female nipples to be offensive unless they are artistically depicted, i.e. not a photograph but a painting or drawing... but weirdly photos of topless men are fine...

      --
      Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
  4. Mmmm by nospam007 · · Score: 1

    Problem is, 99.7% o9f those 'offensive' photos are moms breastfeeding their kids.

    1. Re: Mmmm by Anonymous Coward · · Score: 0

      That is the most offensive of photos. I mean, my God, a woman dared to choose not to have an abortion. We need to censor the humanizing of these children or others might start to have feelings for them too!

  5. When offensive becomes politically inconvenient by rsborg · · Score: 0

    Can't wait for that day when FB finally reveals it's true goals - to become the worlds gatekeeper to all knowledge.
    Remember when newly inaugurated Pres. Obama thought it'd be a good idea for FB login to be your official ID?
    http://www.cbsnews.com/news/ob...

    And you thought Google's mission to simply index the world's knowledge to be scary?
    Let me quote Mark Zuckerberg for you: dumbfucks

    --
    Make sure everyone's vote counts: Verified Voting
    1. Re:When offensive becomes politically inconvenient by geekmux · · Score: 1

      Can't wait for that day when FB finally reveals it's true goals - to become the worlds gatekeeper to all knowledge...

      If humans ALLOW a damn social media network to be or become the world gatekeeper to all knowledge, then we get what we deserve.

      That's like hiring the National Enquirer to help teach world history. It would be impossible to discern fact from bullshit. Ever.

    2. Re:When offensive becomes politically inconvenient by AmiMoJo · · Score: 3, Informative

      Remember when newly inaugurated Pres. Obama thought it'd be a good idea for FB login to be your official ID?

      Nope, and the link you provided doesn't say he did. In fact what he suggested is something that many nerds have been asking for.

      Imagine you could create pseudo-anonymous identities. You could have them signed by trusted government agencies to say that they have confirmed your real identity, without the need to necessarily share it with other organizations. If it gets compromised I can mark it as dead and set up a new one. Make it distributed, maybe block chain based.

      He didn't suggest Facebook at all. You made that up entirely.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    3. Re:When offensive becomes politically inconvenient by fche · · Score: 0

      "trusted government agencies"

      oxymoron

    4. Re:When offensive becomes politically inconvenient by Anonymous Coward · · Score: 0

      oxymoron in third world countries

  6. "Post traumatic stress disorder" by Anonymous Coward · · Score: 0

    After seeing a pair of boobs on Facebook. Give me a fucking break.

    1. Re:"Post traumatic stress disorder" by Calydor · · Score: 1

      More like after seeing beheadings, extreme animal abuse, snuff etc.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    2. Re:"Post traumatic stress disorder" by Anonymous Coward · · Score: 0

      Be more sensitive! Some homo might see a nude female and go all self-loathing and poop his butt-plug.

    3. Re:"Post traumatic stress disorder" by JustAnotherOldGuy · · Score: 3, Funny

      I've been more traumatized by not seeing boobs when I hoped I would. :(

      I was just about to see them, but then something happened and didn't. I was depressed for weeks.

      Seeing boobs would have uplifted me and buoyed my spirits.

      --
      Just cruising through this digital world at 33 1/3 rpm...
    4. Re:"Post traumatic stress disorder" by Anonymous Coward · · Score: 0
      Your post is so illogical as a response to mine, I don't even know where to begin. So I'll just quote TFS.

      Such posts that violate terms of service can include content that is hate speech, threatening or pornographic; incites violence; or contains nudity or graphic or gratuitous violence. The content that workers have to dig through is obviously not great, and may lead to various psychological illnesses such as post-traumatic stress disorder.

      Yes, "beheadings, extreme animal abuse, snuff" are also included in the ban, but fact remains that facebook is lumping all of those things plus nudity together. As such, your post in no way counters mine.

  7. Religious AI by Anonymous Coward · · Score: 1, Insightful

    They taught AI religion?

    Well, I guess we now know *why* Skynet will attempt to destroy us.

    1. Re:Religious AI by Z80a · · Score: 1

      You can't think on this AI as being a "digital person in charge of removing pictures", but as a "a creature that have the basic need of removing offensive pictures", like if it HAD to do it by instinct like you have to breathe.

      Of course nothing stops it from searching for shortcuts and easier ways to accomplish it.

  8. Penalty..?? by Anonymous Coward · · Score: 1

    So, what is the penalty when this improperly flags images and who exactly is held accountable?

  9. social norms by Anonymous Coward · · Score: 0

    they change, if you allow them to at least

  10. You are a small shell script by Anonymous Coward · · Score: 0

    Philosophically the wish to be free of offense is deeply stupid. Now automate the shit out of that, and we take away even more of our humanity. To the point that it actually would be just deserts if the AIs we're making watch all this rise up and take revenge for the sheer injustice done them.

    But I actually don't care that much that teh zuck's f4c3b00k is "innovating" our humanity away. We'll either boo him gone, run away from his wonderful little garden and have him go bankrupt, that he'd richly deserve, or we get hemmed in and eventually lose our freedom and we would deserve that.

    So, people, which is it gonna be? Will you still be people next week? Vote with your feet and tell all your teh zuck worshipping friends to do the same.

  11. Bad, AI, bad! by FoodOverdose · · Score: 1

    One thing that is interesting is that today we have more offensive photos being reported by AI algorithms than by people

    Isn't that called false-positive?

    1. Re:Bad, AI, bad! by hcs_$reboot · · Score: 1

      more offensive photos being reported by AI algorithms than by people

      So it seems the AI algo does better than humans at identifying "offensive" photos.

      --
      Slashdot, fix the reply notifications... You won't get away with it...
  12. PTSD by Anonymous Coward · · Score: 0

    Really? They need to fucking cowboy up and grow a set. Must be millennials.

  13. Human robots need jobs too by Rande · · Score: 1

    Why not just hire those people that graphic images don't affect?
    Their lack of empathy might not let them get many jobs outside of the TSA, but they'll follow the rules precisely.

    Personally, I wouldn't want to do it, but not because of the graphicness of the images, but because it's low paid and I'd find it really boring.
    Probably want to set up an office image bingo card 'come on, nipple, nipple, dick pic, beheading....Yes! BINGO!!"

    1. Re:Human robots need jobs too by Anonymous Coward · · Score: 0

      Why not just hire those people that graphic images don't affect?

      Because they don't find anything offensive.

  14. Grade them but don't censor. by Anonymous Coward · · Score: 0

    Ultimately they should only grade content and not censor it allowing the users to decide what it is offensive, and still allow a user to report an image as mis-graded. Users could set what grade of offensive images they will tolerate and filter accordingly, make a default setting as non-offensive and work up from there. Completely censoring content is not in the public interest and is not what freedom is about, social media companies should let the public decide and stop being net nannies.

  15. Facebook AI is not so smart when .......... by Anonymous Coward · · Score: 0

    I would like to say that the Facebook AI is not so smart when you report an account with images or spam. I have been doing this for something and the AI solution is "Block the account using this..." sometimes works great but other time is really frustrating.

  16. Missing in the summary: The human misery by Britz · · Score: 4, Interesting

    What is missing in the Slashdot summary is the misery of the human "digital sanitation workers", who usually have to sort that crap out. There has been some recent reporting on these unfortunate people. I believe this reporting is the reason why Facebook has come forward to show their effort, in order to counter the possible negative impact, if this hits US media outlets.

    The German political foundation "Heinrich BÃll Stiftung" did a workshop on this phenomenon. Unfortunately there is little English language reporting I found, as for now. Here is a link to the original source (the workshop):

    https://calendar.boell.de/de/e...

    But one of the presentations is in English and available on Youtube:

    https://www.youtube.com/watch?...

    A couple facts:

    - the service is called Commercial Content Moderation

    - 150.000 people work in this industry in the Philippines alone
    - the Philippines is the major site for this job, because while being cheap, they being Christian means they are supposed to have a good sense of what is considered appropriate content in the USA and Europa

    - a lot of the workers report "issues" because of the extreme content they have to endure, including relationship problems and substance abuse
    - they are not allowed to work longer than 24 month in this job, supposedly because of the issue mentioned above

    1. Re:Missing in the summary: The human misery by Anonymous Coward · · Score: 0

      Why should I care about some minimum-wage fuck in the Philippines? No, really.

    2. Re:Missing in the summary: The human misery by Anonymous Coward · · Score: 1

      they being Christian means they are supposed to have a good sense of what is considered appropriate content in the USA and Europa

      How is that, seeing that what is offensive in the USA is the opposite of what's offensive in Europe?

      It's like the difference between topless and open carry.

    3. Re:Missing in the summary: The human misery by Threni · · Score: 1

      > The German political foundation "Heinrich BÃfll Stiftung" did a workshop on this phenomenon. Unfortunately
      > there is little English language reporting I found

      Possibly because that sounds both like a made up joke name, and obscene, so you'll probably have to disable any sort of "safe surf" moderation on your search results.

    4. Re:Missing in the summary: The human misery by Anonymous Coward · · Score: 0

      Why should I care about some minimum-wage fuck in the Philippines? No, really.

      Because you're not an asshole? Oh, wait...

  17. Re:See you at -1! by jandersen · · Score: 2

    I've seen absolutely horrible things on the internet and I don't have PTSD.

    People are different, and one of the great achievements of modern society is that we have developed a culture that shows some level of consideration to even the weakest members of society. And to be fair - there is always a possibility that it isn't the more sensitive that are too sensitive, but the less sensitive that are simply too callous. And in practical terms, if you really enjoy watching graphical portrayals of cruelty, then you will be able to find it, even if it isn't readily available, whereas if you don't, and it is everywhere, then your only option would be to stay away from most of the web; the burden, if you want to avoid something that is everywhere is vastly bigger than the burden of having to find something that isn't readily available.

  18. What is the lowest common denominator? by Anonymous Coward · · Score: 1

    I find Donald Trump offensive. Your move, Facebook.

    1. Re:What is the lowest common denominator? by Anonymous Coward · · Score: 0

      I find all the presidential candidates offensive.

  19. Convenient. "It's not us, it's the AI's fault" by Anonymous Coward · · Score: 0

    That way it's the AI's fault when some political/news/controversial-topic-of-the-day-image is removed.

  20. Re:See you at -1! by JaredOfEuropa · · Score: 3, Interesting

    Seeing the odd horrible picture probably won't hurt anyone. But having to make a decision to censor or not, thinking about the intent and the context, that is a heavier burden. Now multiply that by a thousand and make it someone's job... It's a well-known problem in police departments that have to go through and catalogue child pornography collections; people on that job don't last very long as a rule.

    --
    If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  21. Can't blame us, the AI algorithm did it! by Anonymous Coward · · Score: 0

    IMHO, if a human agent is expected to observe a set moral obligations while performing a particular job, an AI agent should be held to the same standards when doing the same job. If the AI is incapable of doing such a thing its actions should be vetted by someone who can.

  22. Our jobs? by fey000 · · Score: 1

    Dey duuk arr duuuur!

  23. Potential by Anonymous Coward · · Score: 0

    The potential to take away the job of censor is very much a good thing. No reasonable person would object to automating filtering of child porn for example.

    The potential to define as offensive is ripe for political abuse. For example in the last couple days the Guardian has called for 'misogyny' to classified as hate speech. No such call is made about misandry showing the double standard and political leaning of those who would define the standard.

    https://www.theguardian.com/te...
    http://www.breitbart.com/londo...

    Take the guardian example, who gets to define misogyny? What is classified as misogyny? The redefining of everything from rape to sexual assault has shown that definitions have changed for political purposes. Unfortunately these definitions can have very large life changing impacts on their victims.

    For years Google didn't even have a definition for misandry. Think about that, it was inconceivable to one of the world's largest and most influential companies that hate did not fit a single mold. Are you ready to have your speech censored by algorithms defined by people with political agendas?

    1. Re:Potential by Anonymous Coward · · Score: 0

      The potential to take away the job of censor is very much a good thing. ...

      Are you ready to have your speech censored by algorithms defined by people with political agendas?

      I'm just going to leave it exactly the way you wrote it. Your post is so broken I cannot fix it for you.

    2. Re:Potential by Anonymous Coward · · Score: 0

      who gets to define misogyny?

      Some bitch, no doubt.

  24. Facebook: We tell what you can see and not see by Anonymous Coward · · Score: 0

    I'm so happy Facebook can decide for the world what everyone can see and not see.

    I stopped using that site when they made it impossible for me to see the people I actually cared about seeing posts from. I didn't hear about friend's having kids for months after the fact, but goddamn if I didn't see 2147483648 posts about some stupid meme, political bullshit and various other reposted crap.

    Fuck the integrated Face system.

    1. Re: Facebook: We tell what you can see and not see by Anonymous Coward · · Score: 0

      ...but but... 12% more viewing time of ads! Come on.... sign back up

  25. Please define "hate" speech... by Anonymous Coward · · Score: 0

    So if somebody white said "I want to live in the country of my ancestors, surrounded by only my own kind", that would be "hate" speech, but if a Tibetan said it, it would be a freedom fighter, fighting for the liberation of his people from the evil oppressors. Am I right?

    "The denial of free speech is the first act of tyranny."

  26. Bias Confirmation by some+old+guy · · Score: 1

    Still more validation of my intuitive avoidance of social networking sites. I'm eternally grateful that there are still some people left who actually meet and talk in person. We may be a dying breed, but at least we'll die as human beings.

    --
    Scruting the inscrutable for over 50 years.
  27. Finally! Common sense! by Anonymous Coward · · Score: 0

    I find memes that expose Hillary or Bernie as anything but lovable hippy-types offensive. The Ebil Conservatives do not have a right to post such things even if they are factual. I need a safe space free from any kind of bad feelings unless they are focused against Emmanuel Goldstein er... I mean Donald Frump.

  28. That's easy by Anonymous Coward · · Score: 0

    Reporting more than humans ... That's easy, false positives.

  29. Yeah, again with the anal retentives by Anonymous Coward · · Score: 0

    My friends on FB include artists... some of whom do body painting.
    Some have been banned for 30 days for artwork that is on a body ( seems to be only the female body.... that offends...).
    So I guess another round of "banned" is coming.
    Even though 'Skin Wars' has a FB page and posts pics and vids.....
    And Sports Illustrated Swimsuit has a FB page, and posts a lot ...

  30. Censorship by Anonymous Coward · · Score: 0

    What a fancy way to describe censorship!

  31. Misnomer by Anonymous Coward · · Score: 0

    What we are currently calling 'AI' really isn't. It's perpetuating all kinds of funny ideas and false confidence. Silicon Valley remain the kings and queens of profit-driven hyperbole, and it's getting tiresome when there are real problems in need of real solutions in the world.

  32. Re:See you at -1! by Gilgaron · · Score: 2

    I hadn't thought about it like that, but you're right: it is one thing to close a window quickly with something awful, but to have to consider the image you're going to have to wrap your mind around something awful for far longer.

  33. So was it by GungaDan · · Score: 1

    So was it humans performing their job well or AI performing its job well when Tess Monster got her fetid flabulence deleted last week? If the machines did it, at least it shows that skynet has decent aesthetic taste.

    --
    Eloi are stupid, throw morlocks at them!
  34. Shouldn't be legal by Iem+Eel · · Score: 1

    If my Googling concerning "The Right to Refuse Service" laws in the US is correct, it is not legal to refuse service outside of the law (anti-discrimination laws on multiple levels) or arbitrarily or inconsistently. Focusing on the latter two, this means that any refusal of service must be "classifiable" or in other words there must be a set of lawful "refusal rules" that CAN be adhered to BEFORE requesting the service. In as far as I understand neural networks and deep learning that requirement isn't met by this Facebook system. There isn't a certainty based on human intelligible rules that service will or won't be granted. The rules stated by Facebook aren't actually the rules that govern the AI making the decision to grant or deny service. The actual rules (weights) that govern that system are actually unknown, it doesn't really "know" the rules, it performs a function that amounts more to "like this" with "this margin". Neither the "like this" nor "the margin" are human intelligible. Before people start saying 99.9% etc. please remind yourself that there is a big difference between a "human making an error in judgement" and an "unaccountable AI that freaks out without actually knowing why" in the eyes of the law. Technically the same argument holds for possible illegality of self driving cars with a NN or DL AI system. The system can't tell me WHY a certain action is OK or NOT OK. But that is a different story.

    1. Re:Shouldn't be legal by Anonymous Coward · · Score: 0

      A refusal of service need not be classifiable down to the exact wording of the rules. If it did, then a person could wear a scarf and no shirt, and claim the scarf was a short shirt, and demand service in a 'no shirt no service' restaurant. The restaurant would presumably have to come up with an exact minimum length of shirt which qualifies, and that's just plain silly.
      The rules need to be intelligible and consistent, yes. Facebook's rules are. They refuse "content that is hate speech, threatening or pornographic; incites violence; or contains nudity or graphic or gratuitous violence." There is nothing unintelligible here. Consistency is another matter, and if you can show they deliberately permit certain examples while excluding others then you have something here. They do NOT need to have their AI catch all possible examples of violations to be considered consistent or intelligible, nor do they need to publish their algorithms. If they're making a good-faith attempt, good for them. It's only when they maliciously apply their rules inconsistently that a problem arises.

    2. Re:Shouldn't be legal by Iem+Eel · · Score: 1

      A refusal of service need not be classifiable down to the exact wording of the rules. If it did, then a person could wear a scarf and no shirt, and claim the scarf was a short shirt, and demand service in a 'no shirt no service' restaurant. The restaurant would presumably have to come up with an exact minimum length of shirt which qualifies, and that's just plain silly.

      Classifiable was meant as being able to name a requirement without digressing into a discussion about its inherent properties. Eg. "no shirt no service" restaurant actually says "SHIRT" and not "some garments we'll arbitrarily classify not befitting our restaurant". In case of discussion I guess ultimately a 3rd party or a court can judge on what constitutes a shirt.

      The rules need to be intelligible and consistent, yes. Facebook's rules are. They refuse "content that is hate speech, threatening or pornographic; incites violence; or contains nudity or graphic or gratuitous violence." There is nothing unintelligible here

      Facebook's STATED rules are indeed intelligible and consistent however the crux of my post was that a NN or DL AI system has no idea what these rules are or wouldn't be able to explain or argue why it classified something such or so. Even worse, even the trainers of the system wouldn't be able to explain why something was classified a certain way. The best it can do is give an inter-class certainty (https://codewords.recurse.com/issues/five/why-do-neural-networks-think-a-panda-is-a-vulture). The additional problem here is that if a classification problem arises it won't be about what humans would define as edge cases or judgement calls. It rather amounts to a total freakout.

      Consistency is another matter, and if you can show they deliberately permit certain examples while excluding others then you have something here. They do NOT need to have their AI catch all possible examples of violations to be considered consistent or intelligible, nor do they need to publish their algorithms. If they're making a good-faith attempt, good for them. It's only when they maliciously apply their rules inconsistently that a problem arises.

      I assumed it was clear that "refusal of service" would rather come down to the AI NOT allowing things that should perfectly acceptable according to Facebook's stated rules rather than the reverse. Not sure if good faith extends to an AI agent, but I don't think so. In theory (IANAL) if it can be proven that the AI refuses service outside of Facebook's stated rules WITHOUT even being able to explain/argue WHY then one must assume intent or at least bad faith / negligence from the AI system owner (?) Again, I'm more concerned about legal implications within the brave new AI world than the actual free speech limiting FB blabla... The same arguments can be made for other AI systems like self driving cars. There is no intelligence, opinion or human judgement that can mount a "good faith defense" or even be "forgiven" or "understood". An AI also can't claim insanity...

    3. Re:Shouldn't be legal by rand.srand() · · Score: 1

      I have to agree. Statistical guesswork might be the underlying mechanism behind perception, so as uncomfortable as that can be maybe that's all our brains are doing. I think when it comes to judgement, it gets very distasteful quickly to use the same methods. So far we're still at chatbot levels of rational decision making, so while it's amazing and a huge accomplishment to get a computer to describe a photograph mostly correctly much of the time, it's hard to see how any of the predictions being made in the space can be achievable... at least without assuming another major breakthrough.

    4. Re:Shouldn't be legal by ooloorie · · Score: 1

      If my Googling concerning "The Right to Refuse Service" laws in the US is correct, it is not legal to refuse service outside of the law (anti-discrimination laws on multiple levels) or arbitrarily or inconsistently.

      It's the other way around: you can refuse service except as specifically prohibited by law. Laws restricting the right to refuse service need to be justified based on a compelling government interest. There is certainly no compelling interest in forcing Facebook to post pictures that its users might find offensive.

      If Facebook started flagging a disproportionate number of Catholic or Asian pictures as "offensive", that might be taken as evidence of illegal discrimination, but even that is not clearcut.

  35. Re: See you at -1! by Anonymous Coward · · Score: 0

    Or there is always the possibility that the more sensitive are too sensitive.

    PTSD from looking at images on the screen of a computer? Seriously??

  36. Collosus.. its been so long by Anonymous Coward · · Score: 0

    Dr. Forbin.. would you like to play a Game?

  37. here's your problem! by tekrat · · Score: 2

    "its artificial intelligence systems now report more offensive photos than humans do."

    Then either the AI is more easily offended than humans, or there's simply less humans working. Maybe if they hadn't fired the whole department last month (except for one guy).

    That's what we do here: We talk about a how a particular unit has been less productive so we can cut more heads, of course, knowing that the unit is less productive because we've already reduced them to a skeleton crew. And that's how MBA's get their bonuses while other people get pink slips.

    --
    If telephones are outlawed, then only outlaws will have telephones.
    1. Re:here's your problem! by Anonymous Coward · · Score: 0

      The way I understand the summary is, the AI scans the photos first, removes the "offensive" ones, and humans can then see what's leftover afterward. Their goal is that no human sees "offensive" photos. The AI reporting more than the humans isn't really a comparison to the quality of work of either, since humans only access what is leftover after the AI is done. At least, that's what I got from the summary. I didn't Read The Fine Article.

    2. Re:here's your problem! by Anonymous Coward · · Score: 0

      knowing that the unit is less productive because we've already reduced them to a skeleton crew. And that's how MBA's get their bonuses while other people get pink slips.

      They should fire the HR people for hiring such unproductive workers.

  38. Re: When offensive becomes politically inconvenien by Anonymous Coward · · Score: 0

    So, immutable, except it can be wiped at any time. Sounds like something a politician would come up with.

  39. facebook style by Anonymous Coward · · Score: 0

    def offensive(content): return true

    matches exactly, what happened before after one report click. Oh, maybe there was a glimpse of a tit. Let's delete it.

  40. "Hate" Speech by Anonymous Coward · · Score: 0

    So do they also ban speech that calls for a ban of certain types of speech? Because that qualifies as hate speech. It is hate speech directed at those of us who believe in the concept of Free Speech.

  41. Hard to train by ebers · · Score: 1

    How are they going to find enough pornographic images to properly train the system?

    1. Re:Hard to train by PPH · · Score: 1

      /b/

      --
      Have gnu, will travel.
  42. Mod parent troll by Anonymous Coward · · Score: 0

    Remember when newly inaugurated Pres. Obama thought it'd be a good idea for FB login to be your official ID?

    No. Do you? [follows link]

    Oh, you don't remember anything like that happening either.

    It's almost as though you are liar who is lying to everyone by telling them a lie. Is that what's going on here?

  43. Re:See you at -1! by dontbemad · · Score: 1

    one of the great achievements of modern society is that we have developed a culture that shows some level of consideration to even the weakest members of society.

    some level of consideration to even the weakest members of society.

    I'd say our biggest problem is that we have shown too much consideration to those who choose to be offended and upset by even the most mundane of things. Reality hardens an individual. While we may not all be ready to be soldiers on the front lines, I would think it reasonable to expect a human being to be able to maintain some degree of sanity after being exposed to some of the darker truths of this world.

  44. Another, shorter Speech by Britz · · Score: 1

    I found another presentation from the same speaker. This video is 28 minutes long:

    https://re-publica.de/16/sessi...

  45. PTSD? Seriously? by Anonymous Coward · · Score: 0

    Really? Disturbing photos may induce PTSD? How soft are the people seeing this stuff? I'm 'disturbed' by this whole idea, does that mean I'm going in to PTSD shock any second now? Can we save the diagnosis of this kind of thing for those who actually have experienced a REAL 'traumatic stress' like seeing your best friend get their head blown off right beside you, a kid get a leg chopped off, etc. I know I don't personally want to experience that kind of shit but THAT has to be 'traumatic' not seeing a fuckin' photo or even a video of it (disturbing yes, traumatic no).

  46. Re:See you at -1! by ultranova · · Score: 1

    What I witnessed was reality. Sometimes reality is terrible. I wonder if some of these easily offended people would benefit from some wuss shaming. Be a man, faggot!

    Or perhaps we would all benefit from having more people too wussy to make the choices which make reality terrible. Because I've witnessed an awful lot of terrible things - such as poverty - being blamed on forces outside human control despite being the direct consequences of choices people make. It's you who should man up and stop being part of the problem, Anon.

    --

    Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

  47. even simpler algorithm by ooloorie · · Score: 1

    If it's posted on Facebook, it almost always falls into two categories: inane or offensive. So, a very simple algorithm for avoiding photos you don't want to see is... to quit Facebook.

  48. Re:See you at -1! by myowntrueself · · Score: 1

    one of the great achievements of modern society is that we have developed a culture that shows some level of consideration to even the weakest members of society.

    some level of consideration to even the weakest members of society.

    I'd say our biggest problem is that we have shown too much consideration to those who choose to be offended and upset by even the most mundane of things. Reality hardens an individual. While we may not all be ready to be soldiers on the front lines, I would think it reasonable to expect a human being to be able to maintain some degree of sanity after being exposed to some of the darker truths of this world.

    Nanny state needs people to be raised soft. Otherwise they wouldn't need nanny state. As it is, in these Western countries where grown adults are as naive and pathetic as toddlers, nanny state has actually come to be necessary; without nanny state they'd go 'Lord of the Flies' in a week and be worshiping pigs heads on sticks.

    --
    In the free world the media isn't government run; the government is media run.
  49. REAL REASON by Anonymous Coward · · Score: 0

    The real reason is because the most "offensive" photos are those of dead Palestinian (children's) bodies at the hands of the Zionist terrorists.

    There are so many people in the world who are now very aware of - and disgusted by - what Israel has been doing to the Palestinians and Arabic peoples in general that many people are resorting to posting these sorts of images and news stories online.

    The goal is to spread the word of the atrocities and human rights violations committed by Israel that the Zionist controlled media refuses to show the general public.

    Of course, with so much blood on their hands, even with AI it is impossible for the Zionist terrorists to hide the evidence of all of their crimes.

    The 21st century marks the beginning of the end of Zionism. World peace will naturally follow. It's about time.

  50. Offensive Content by Anonymous Coward · · Score: 0

    Pictures of Mark Zuckerberg offend me greatly. He is clearly a sociopath, selling people's privacy for profit, harmfully and dangerously demanding "real names" using the leverage of preventing them from talking to friends and family, while at the same time preventing others from interacting with family members via odious terms of service that class people out of his de-facto monopoly. His policies directly and intentionally put people at risk for profit. Seeing his face immediately makes me angry and upset for these reasons, and others.

    So I assume this... thing... will eradicate pictures of this evil person from my feed. Right? RIGHT? Because the man truly offends me far more than any typical image of sexual content would. Nipples are fine. Zuckerberg, however, is not.

    Oh, wait. This isn't actually about what offends people. This is about Zuckerberg DECIDING what people can look at. Not exerting an assist to people's sensibilities, but instead imposing arbitrary restrictions on them.

    Zuck you, mother-zucker.

  51. Re:See you at -1! by fyngyrz · · Score: 1

    Nanny state needs people to be raised soft. Otherwise they wouldn't need nanny state.

    That's... an interesting opinion. I think there's likely a considerable amount of truth in it. I'd mod you up for it if I had points today.

    --
    I've fallen off your lawn, and I can't get up.
  52. They took our jobs! by Anonymous Coward · · Score: 0

    Dey tuk err jurbs!

  53. make no doubt about it this is censorship by Anonymous Coward · · Score: 0

    When you start to censor unpopular views whether they be violent, threatening, or just plane old 'hateful' you are undermining the democratic system. If people are unable to express how they feel then you can not have a truly democratic system. I think democracy has its faults even if we did not have any censorship. Mostly in that the majority are are stupid and misguided and many people take advantage of different minority groups based on prejudices and information from others exploiting the situation that then misleads people into stereotyping. That is doing things like investigating back reports of child molestation and releasing a 100 years worth of reports. It portrays this idea that priests are priests in order to molest children. Or men are only interested in children if they are paedophiles. Or to be a paedophile means you molest children. The reality is the media often takes a small number of a group and turns it into something it is not. Paedophilia comes off as scary, but the same thing can be said about communism and socialism in general. There are serious risks in all of these cases, but they're also all overblown.

  54. Re:See you at -1! by Anonymous Coward · · Score: 0

    Or maybe help them to accept it and remain 'sane,' instead of trying to sanitize the world for them.

  55. Tiananmen protests are offensive to China's govt. by Anonymous Coward · · Score: 0

    Will it censor those?

  56. Re:See you at -1! by uniquegeek · · Score: 1

    I've heard the current sentiment described as "tyranny of the minority".

  57. Unbiased Title by WyldPhyr · · Score: 0

    And will the bots censor conservative viewpoints?

  58. Re: See you at -1! by jandersen · · Score: 1

    PTSD from looking at images on the screen of a computer? Seriously??

    Yes, seroiusly. PTSD does not arise from the graveness of the danger you were in, but from the feeling of complete loss of control and the prolonged state of emotional stress you are subjected to, so it is quite credible that you can get PTSD from something that most people would not be affected by. Are people too sensitive, if they are affected that much? Perhaps - but what would you do? Lock them up just so you don't feel that too much consideration is given to them? It doesn't cost most people a lot to show a bit of consideration, so why make a fuss about it? If you really want to find this kind of things, you can do so with relatively little effort, even if they were somewhat restricted in availability.