Slashdot Mirror


UK Police's Porn-Spotting AI Keeps Mistaking Desert Pics for Nudes (gizmodo.com)

An anonymous reader quotes Gizmodo: London's Metropolitan Police believes that its artificial intelligence software will be up to the task of detecting images of child abuse in the next "two to three years." But, in its current state, the system can't tell the difference between a photo of a desert and a photo of a naked body... "Sometimes it comes up with a desert and it thinks its an indecent image or pornography," Mark Stokes, the department's head of digital and electronics forensics, recently told The Telegraph. "For some reason, lots of people have screen-savers of deserts and it picks it up thinking it is skin colour."
The article concludes that the London police software "has yet to prove that it can successfully differentiate the human body from arid landscapes."

75 of 144 comments (clear)

  1. I guess it's down to camels now: by fyngyrz · · Score: 4, Funny

    One hump, or two?

    --
    I've fallen off your lawn, and I can't get up.
    1. Re:I guess it's down to camels now: by Anonymous Coward · · Score: 3, Funny

      Pregnant!

    2. Re:I guess it's down to camels now: by HornWumpus · · Score: 2

      Beavis: That chick has three boobies!

      Butthead: That's her belly fartknocker.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    3. Re:I guess it's down to camels now: by Chris+Mattern · · Score: 1

      Beavis: That chick has three boobies!

      Butthead: That's her belly fartknocker.

      You mean they weren't watching Total Recall?

    4. Re:I guess it's down to camels now: by TeknoHog · · Score: 1

      And how many toes?

      --
      Escher was the first MC and Giger invented the HR department.
    5. Re:I guess it's down to camels now: by Bite+The+Pillow · · Score: 1

      All the humps. I love fucking sand!! It got in my wife's Yahoo one summer and now I can't stay erect without it. We are divorced, but nothing sends me over the moon like sand dunes. In the shape of tits. Or hyperbolae. Or straight lines. Or curved straight lines. Or sandboxes.

      Hmmmm sand box.

    6. Re:I guess it's down to camels now: by quenda · · Score: 1

      Camels? ... Oh!
        I was thinking of cherries on ice-cream scoops.

    7. Re:I guess it's down to camels now: by RockDoctor · · Score: 1
      Ah. An arenophile. How ... quaint.

      I didn't think there were many people left who were willing to admit to being a sand-botherer in public. Not since the convictions of the pavement-masturbator.

      Not one of the above concepts is invented - all real "kinks".

      --
      Birds are not dinosaur descendants;birds are dinosaurs, for all useful meanings of "birds", "are" and "dinosaurs"
  2. Eeeeeh?! by Anonymous Coward · · Score: 5, Insightful

    ""For some reason, lots of people have screen-savers of desert"

    Are they really openly admitting to RAT-surveilling everyone?! What am I missing?

    1. Re:Eeeeeh?! by AmiMoJo · · Score: 1

      This seems to be an automated porn scanner that they can throw on a PC they collected as evidence. I guess the idea is to save them some time looking for porn manually.

      I seem to recall that deserts were one of the Windows 7 wallpaper packs. Windows 8 had them too and included by default, and Windows 10 displays a random landscape from Bing on the login screen.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  3. UK police scanning your screen saver images! by HornWumpus · · Score: 5, Insightful

    WTF are police doing scanning the images used for screen savers? Those aren't, generally, on a public server.

    It the UK cops have a trojan on UK computers, I think the rest of the world should get to work burying their servers in noise. Antivirus definitions need updating ASAP.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    1. Re:UK police scanning your screen saver images! by PPH · · Score: 3, Funny

      Who is General Failure and what is he doing reading my hard drive?

      --
      Have gnu, will travel.
    2. Re:UK police scanning your screen saver images! by mikael · · Score: 1

      Most Windows distributions come with Remote Administration enabled. That allows for remote monitoring. A relative had a problem with her PC, called up technical support and got a technician to fix her PC remotely. She saw the cursor whizzing around, windows opening and closing, text being typed in. She thought it was marvelous. Didn't quite understand that meant anyone could be monitoring what she typed. Then some applications seem to stream telemetry via Amazon Web Services (AWS). Even a web browser has access to the root window.

      It's easy enough for the police to scan through the various websites that allow free downloading of screen backgrounds. In the past, even those websites has problems trying to implement porn filters that would allow basketball teams to be permitted, but not porn.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    3. Re:UK police scanning your screen saver images! by Anonymous Coward · · Score: 1

      He is the superior of Major Malfunction, and he is looking for Private Pictures.

    4. Re:UK police scanning your screen saver images! by Sesostris+III · · Score: 2

      Reading the articles it seems that the police are using the AI to search through the machines of _suspects_. This implies that they have custody of the suspect's physical machines.

      --
      You never know what is enough unless you know what is more than enough. - Blake
    5. Re:UK police scanning your screen saver images! by QRDeNameland · · Score: 3, Funny

      Just hope they don't call in Colonel Panic.

      --
      Momentarily, the need for the construction of new light will no longer exist.
    6. Re:UK police scanning your screen saver images! by HornWumpus · · Score: 1

      Reading the articles

      GET OUT!

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    7. Re:UK police scanning your screen saver images! by MichaelSmith · · Score: 1

      Okay how's this for an idea: FUSE python and PIL to generate an infinite directory tree containing random image data which matches the skin filter without being actually pornographic...

    8. Re: UK police scanning your screen saver images! by guruevi · · Score: 1

      This is the UK, they correctly pronounce.

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
    9. Re:UK police scanning your screen saver images! by ShanghaiBill · · Score: 1

      Okay so there are some false positives.

      The reason for the false positives is almost certainly a dearth of desert pictures in the NN training set. So download 10,000 desert images, and retrain.

      Does this really mean they need more people to sort the results because there is no way the algorithm alone will be enough for a conviction.

      Umm. The purpose of the program is to flag suspicious images for human review. There is no fricken way that the program's output is going to be directly admissible in court.

    10. Re:UK police scanning your screen saver images! by esperto · · Score: 1

      At least they definetly should call Private Browsing, his already seem too much heavy stuff.

    11. Re:UK police scanning your screen saver images! by AmiMoJo · · Score: 1

      In this case it sounds like they need to call on Private Browsing.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  4. BARE NAKED DUNES WAITING FOR YOU! by SeaFox · · Score: 5, Interesting

    African, Asian, European desert lands all uncovered and untouched by man. Clean shaven of all foliage. Aching for a BBC (big black camera) to shoot all over their majestic vistas. They want long lenses and offer roads for deep penetrations into their wildest areas. Only $9.95/mo gets you all access to hours of video and thousands of pictures. Round, brown mounds of dirt, golden, flowing sands, fiery red sunsets are all waiting for you!

    1. Re:BARE NAKED DUNES WAITING FOR YOU! by nospam007 · · Score: 1

      "Round, brown mounds of dirt, golden, flowing sands, fiery red sunsets are all waiting for you!"

      Don't forget the snake holes.

    2. Re:BARE NAKED DUNES WAITING FOR YOU! by Waccoon · · Score: 1

      To each their own, but you can keep your strip malls. It's only bush country for me.

  5. A naked person in a desert kills the system ... by brainchill · · Score: 1

    A picture of a nude person in a desert must render this thing catatonic ;)

    1. Re:A naked person in a desert kills the system ... by HornWumpus · · Score: 1

      Nobody likes a sandy vagina.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    2. Re:A naked person in a desert kills the system ... by quenda · · Score: 1

      Nobody likes a sandy vagina.

      Africans do, apparently.

      http://www.dailymail.co.uk/hea...
      https://www.vice.com/en_au/art...

  6. Re:So-called 'AI's are GARBAGE by hackwrench · · Score: 1

    Zo thinks about as well as Helen Keller did.

  7. The big question by Teun · · Score: 4, Interesting

    The big question is why the hell do they bother to detect nudes?
    I would even ask why the hell do they want to spot pornography?

    Both are very common human expressions and they should not be a reason for police investigation.

    --
    "The likes of Facebook and WhatsApp are free to those whose privacy is of zero value."
    1. Re:The big question by Sesostris+III · · Score: 1

      I think what they are looking for specifically are images of Child Sexual Abuse. (Which is not pornography, it is abuse, which is why the police are involved).

      --
      You never know what is enough unless you know what is more than enough. - Blake
    2. Re:The big question by Aighearach · · Score: 1

      Considering that they're specifically examining the computers of people suspected of harming children, it would make a lot of sense that it would be done with the goal of protecting those children.

      It is one thing if what they're doing has nothing to do with children, and they use it as an excuse anyways. But if it does involve children, and you're saying that anyways, it makes me wonder if they should be looking at your computer, too!

    3. Re:The big question by Anonymous Coward · · Score: 1

      Indeed, I imagine the ultimate goal of this software is to automatically detect childhood abuse pictures on seized computers. This way they don't have to traumatize and burn out human staff on visually checking the images on a computer. It also saves them the time of having to look through the millions of pictures (mostly cats) possibly hosted on the average computer.

    4. Re:The big question by Chris+Mattern · · Score: 3, Insightful

      I think what they are looking for specifically are images of Child Sexual Abuse.

      Well, if they're doing it by looking for a superabundance of Caucasian skin tones, they're doing a fucking horrible job of it. And apparently black kids don't count.

    5. Re:The big question by Anonymous Coward · · Score: 1

      I think what they are looking for specifically are images of Child Sexual Abuse. (Which is not pornography, it is abuse, which is why the police are involved).

      And yet in no other case in our entire legal code is mere possession of photographic or video evidence of a crime itself a crime. Pictures of ISIS beheading people in Syria? Totally legal. Picture of dead body at scene of drive by shooting? Totally legal. Why should this one crime be carved out from among all of the others as a special case? Perhaps you would argue that victims of abuse suffer knowing that images of that abuse are still out there but then do the victims of other crimes suffer less? Is one form of suffering more privileged than another? Does the fact that people suffer trump free speech? These are legitimate questions that have not to my knowledge been adequately answered by our legal system, mostly because we as a society don't want to talk about it. The justice system is no better than we are collectively and yet people place it on a high pedestal of logic and reason.

    6. Re:The big question by Kjella · · Score: 1

      The big question is why the hell do they bother to detect nudes? I would even ask why the hell do they want to spot pornography? Both are very common human expressions and they should not be a reason for police investigation.

      Limited time and resources? Here's a suspect's computer, it has 10k images on it. Run it through the system and rank the photos most likely to contain illegal pornography. I'd be surprised if they didn't try to make some kind of automated ranking. Narrowing it down to porn would be a start. That said, if they're triggering on deserts they must be doing something really stupidly like training it exclusively on porn - which would have a lot of those colors - and then trying to apply that to general images. That sounds more like a stupid porn filter from the 90s than an AI project from 2017. My guess is that someone slapped AI on it and got funding....

      --
      Live today, because you never know what tomorrow brings
    7. Re:The big question by Waccoon · · Score: 1

      They say they're scouting for child porn. How can their software tell the difference between an adult body and a child body if it can't differentiate a nude from a dune?

    8. Re:The big question by Agret · · Score: 1

      Indeed, I imagine the ultimate goal of this software is to automatically detect childhood abuse pictures on seized computers. This way they don't have to traumatize and burn out human staff on visually checking the images on a computer. It also saves them the time of having to look through the millions of pictures (mostly cats) possibly hosted on the average computer.

      Yes it would save them time of having to look through millions of pictures but the software cannot alone be used to form a conviction. At some point a real person is going to have to review the images to confirm their contents as flagged by the computer. This won't prevent trauma and burn out on human staff but will speed up investigations greatly.

      --
      Have you metaroderated recently?
    9. Re:The big question by fafalone · · Score: 1

      Looking for CP is just the excuse, since we're nowhere near an AI that could distinguish between a naked child and naked adult, especially since we insist on calling teenager sexts CP. Consider where this is-- the UK, where they have a long standing history of trying to restrict adult porn too.

  8. Legit usage by Ecuador · · Score: 4, Funny

    There is legit usage cases for this software. I, for one, would not trust people who jack off to images of deserts. They should be put on some police list of some sort, so that I know to avoid them.

    --
    Violence is the last refuge of the incompetent. Polar Scope Align for iOS
  9. I played San Andreas.... by The123king · · Score: 1
    --
    If you gave me a choice between a printer and a giraffe with explosive diarrhoea, i'll get my ladder and my raincoat
  10. Would that be "white" sand? by blindseer · · Score: 1

    Racists!

    --
    I am armed because I am free. I am free because I am armed.
  11. It's a simple coding error by bobstreo · · Score: 5, Funny

    DUNE is a misspelling of NUDE.

    1. Re:It's a simple coding error by Calydor · · Score: 1

      Nude.
      Nude Messiah.
      Children of Nude.
      God Emperor of Nude.
      Heretics of Nude.
      Chapterhouse: Nude.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    2. Re:It's a simple coding error by Aighearach · · Score: 1

      Funny coincidence, I read the Dune series when I was 14, too!

      I think my reading went about the same way. Never figured out what the boring parts were supposed to be.

    3. Re:It's a simple coding error by Calydor · · Score: 2

      Oh, it gets better.

      The series was translated into my native language. The titles as well.

      Do you know what a dune is called in Danish?

      Klit.

      I'm not joking.

      --
      -=This sig has nothing to do with my comment. Move along now=-
  12. Obesity by pubwvj · · Score: 1

    Perhaps this says something about the obesity epidemic...

  13. Is there something left unsaid here? by zuki · · Score: 1

    I mean, correct me if I am wrong but doesn't the only way to see what images people have on their desktops mean that the Metropolitan Police are poking around and doing some sort of unauthorized remote access into peoples' machines?

    How else would they become aware of the types of screensavers people are using? Not sure but I find this more than slightly creepy.

    Is this more of that famous Nanny State® at work again? "Think Of The Children" gone wrong...

    1. Re:Is there something left unsaid here? by Aighearach · · Score: 1

      I mean, correct me if I am wrong but doesn't the only way to see what images people have on their desktops mean that the Metropolitan Police are poking around and doing some sort of unauthorized remote access into peoples' machines?

      Where did you dredge up the word "unauthorized?" Why do you just presume that? Did you even know that child sex abuse is illegal, and that a warrant granted to search for evidence of the crime would be a legit authorization? Surely this is a tool to help the Metropolitan police poke around during authorized access.

    2. Re:Is there something left unsaid here? by Altrag · · Score: 1

      He gets it from the TFS being kind of misleading and making it sound like the police are scanning everyone's computers.

      Which may of course be authorized if the government is shitty enough.. and not implausible in the UK these days as there's been a push there for full-on surveillance state for 5 or so years now.

    3. Re:Is there something left unsaid here? by angel'o'sphere · · Score: 1

      I'm uncertain what is more creepy, the police remotely accessing your computer to check your screen saver, or people having child porn pictures as screen saver.

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    4. Re:Is there something left unsaid here? by Aighearach · · Score: 1

      When you're not presented with a boundary, don't assume an absolute is implied.

    5. Re:Is there something left unsaid here? by Altrag · · Score: 1

      And with the way governments around the world have been going in the past few years with regard to mass surveillance, failing to at least consider the absolute would be naive.. sometimes even when you are presented with a boundary.

    6. Re:Is there something left unsaid here? by Aighearach · · Score: 1

      No, extremist hyperbole does not actually change the logical value of fake absolutes at all.

      It is only the shape your stupidity takes, it is not any sort of excuse.

  14. Spotted Dick by WhoBeDaPlaya · · Score: 1

    is delicious! :)

  15. Re:In other words by Aighearach · · Score: 1

    Once you've fed "Paradise (1982)" into the AI, all arid scenes will trigger that response. It doesn't matter the age. Same as humans.

  16. Re:AI? by Aighearach · · Score: 1

    No, they're not trying to get the computer to do all the police work, they're just trying to use it to narrow it down to nude images so that the amount of work they have to do is much smaller. This is for searching people who are already suspects.

  17. Skin detection algorithm by thygate · · Score: 1

    I came across an extremely simple skin detection algorithm some time ago and made a GLSL implementation. Check here for a demo and explanation (click about). http://labs.thygate.com/amazin... It is actually quite robust if the lighting conditions of the scene don't change too much.

    1. Re:Skin detection algorithm by thygate · · Score: 1

      which was all explained in the about text if you had cared to read it.

    2. Re:Skin detection algorithm by sheramil · · Score: 1

      I came across an extremely simple skin detection algorithm some time ago and made a GLSL implementation... It is actually quite robust if the lighting conditions of the scene don't change too much.

      How robust is it if the subject is clad from head to toe in black latex?

      As for deserts, google image search "sexy iceberg".

  18. Re:AI? by Altrag · · Score: 1

    Generally speaking they're not going to be trying to distinguish a 17 year old from an 18 year old. They're going to be trying to distinguish a 10 year old from an 18 year old. And there's definitely some obvious physiological differences there (in most instances.)

  19. Yeah, mistaking a desert for porn. by ArsenneLupin · · Score: 1

    What are they thinking?
    banana split

  20. Two reasons by rsilvergun · · Score: 1

    first, Christians. There's a concept I call "Aggregate Sin" because I can't think of a better name for it. Christians (the ones who take the Bible literally) believe that if there's too much sin in the world God will punish us. e.g. God punishes the Faithful for the sins of the heretic. Therefore sin, any sin, is an existent threat to them. If you extrapolate from the tales of Sodom & Gomorrah & Noah's Ark this makes sense. You see this most commonly when a natural disaster strikes and a bunch of them come out of the wood work to claim it's the Lord punishing us for sinning. The important thing here is to understand that the Lord isn't very picky about who he punishes. This incentivizes Christians to control non Christian behavior; up to and including converting them. It's a big part of why Christianity spreads the way it does.

    As for the other reason, well the entire system is designed to keep the working class' attention somewhere else while the Aristocracy pockets all the money. It's a classic technique (along with Balkanization, usually along racial or caste divides but sometimes along ideological, e.g. wedge issues). Basically, if 1% of the populace is going to take 50-90% of the wealth for themselves they have to create all sorts of crazy systems to make that work.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Two reasons by Zontar+The+Mindless · · Score: 1

      Haven't they heard the good news about Sithrak?

      --
      Il n'y a pas de Planet B.
  21. 50 R - G 250 by thygate · · Score: 1

    Allow me to further elaborate as to WHY i found this algorithm so interesting, because it's so ridiculously simple. It considers a pixel is skin if 50 R - G 250, where R and G are the red and green channels from a 8-bit RGB pixel representation. Sure it's not meant for the prime-time, it's just a very interesting curiosity, and easy to perform in parallel.

  22. Re: 50 < R - G < 250 by thygate · · Score: 1

    darn html got filtered of < symbols.

  23. Deserts and Virgins by wolfheart111 · · Score: 1

    Damb there in there somewhere... all 70 of em.

    --
    [($)]
  24. This is a tremendous advance! by RhettLivingston · · Score: 1

    It has gone beyond dreaming and is seeing mirages!

  25. Deserts in Nevada are legal... by burhop · · Score: 1

    ...in you are into that.

    1. Re:Deserts in Nevada are legal... by iggymanz · · Score: 1

      Oh no, Mojave desert is very young compared to most, only 10,000 years ago there were lakes and marshes there. Only the millions of years old deserts should be attractive to you, you pedo!

  26. Re:AI? by fluffernutter · · Score: 1

    You just think it's easy because you're human and take for granted how very subtle the visual cues are.

    --
    Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
  27. Maybe it's dyslexic by eric_harris_76 · · Score: 1

    Maybe it's dyslexic, and can't tell the difference between small nudes and small dunes.

    --
    There's no time like the present. Well, the past used to be.
  28. Legs or Hot Dogs? by rHBa · · Score: 1
  29. ooh by BrandonGinn · · Score: 1

    hot sandy mounds

  30. Re:AI? by Altrag · · Score: 1

    That's kind of my point. Its not easy, even for a human, to distinguish a 17 year old from an 18 year old based on pure visual clues. But other than extreme cases of precocious puberty its usually pretty easy for a human to tell a 10 year old from an 18 year old. Meaning that at least in principle, the latter should be doable by a smart enough AI (which is not saying such an AI is necessarily easy to build of course. Just that it should be possible based on how easy it is for us humans to do the job.)