Facebook Uses Machine Learning To Remove 8.7 Million Child Exploitation Posts (techcrunch.com)

Facebook announced today in a blog post that it has removed 8.7 million posts last quarter that violated its rules against child exploitation. The company said it used new AI and machine learning technology to remove 99 percent of those posts before anyone reported them. TechCrunch reports: The new technology examines posts for child nudity and other exploitative content when they are uploaded and, if necessary, photos and accounts are reported to the National Center for Missing and Exploited Children. Facebook had already been using photo-matching technology to compare newly uploaded photos with known images of child exploitation and revenge porn, but the new tools are meant to prevent previously unidentified content from being disseminated through its platform. The technology isn't perfect, with many parents complaining that innocuous photos of their kids have been removed. Davis addressed this in her post, writing that in order to "avoid even the potential for abuse, we take action on nonsexual content as well, like seemingly benign photos of children in the bath" and that this "comprehensive approach" is one reason Facebook removed as much content as it did last quarter. The tech isn't always right though. In 2016, it was criticized for removing content like the iconic 1972 photo of Phan Thi Kim Phuc, known as the "Napalm Girl," fleeing naked after suffering third-degree burns in a South Vietnamese napalm attack on her village. COO Sheryl Sandberg apologized for it at the time.

Comments

Re:False positives?

[nctritech]

The definitive Facebook nudity policy mistake: Napalm Girl from the Vietnam War. The moral terror that photo inspires must never be forgotten...but hey, we gotta ban it because prepubescent genitals! Not the destruction, violence, pain, and mortal horror, mind you. Just the naked kid with third-degree burns on her back and arm. Someone might mistake it for pornography, you know.

If you want to know what happened to the girl after that photo, I encourage you to read this. It's definitely worth it.

Re:The saddest neural network of all.

[Sique]

Emotions are part of the inner rewarding system of the body. There are positive emotions you want to repeat, and there are negative emotions you want to avoid. They are coupled to complex situations you are in, you have been in, or you could get into. Emotions are a shortcut to a decision where the rational approach might take too long and be erroneous because it has to factor in too many details, or where good information is not easily to come by. Any system that has to make decisions in real time has to resort to that type of shortcuts, even a machine based on a collection of algorithms, because there are situations where any decision is better than none, and the time frame for a decision is short.

You can call those shortcuts "emotions". If you implement them into algorithms, you have emotional algorithms.

Re: False positives?

[Anonymous Coward]

I know you dont care but you could google for: Antifa Portland, Antifa Berkeley, Antifa violence and find plenty of well documented real world examples of these mindless pro-fascist thugs beating people for thought crimes.

And if you want to go broader, google for: Scalise shot. That was one of your peace loving Bernie supporters attacking unarmed men at a softball practice.

You will not find conservatives rioting and starting shit. The best you will get is Antifa (again) crashing a pathetic nazi/kkk rally and the guy in the guy running over a woman in panic when the Antifa mobs surround him.