Slashdot Mirror


When It Comes to Gorillas, Google Photos Remains Blind (wired.com)

Tom Simonite, writing for Wired: In 2015, a black software developer embarrassed Google by tweeting that the company's Photos service had labeled photos of him with a black friend as "gorillas." Google declared itself "appalled and genuinely sorry." An engineer who became the public face of the clean-up operation said the label gorilla would no longer be applied to groups of images, and that Google was "working on longer-term fixes." More than two years later, one of those fixes is erasing gorillas, and some other primates, from the service's lexicon. The awkward workaround illustrates the difficulties Google and other tech companies face in advancing image-recognition technology, which the companies hope to use in self-driving cars, personal assistants, and other products. WIRED tested Google Photos using a collection of 40,000 images well-stocked with animals. It performed impressively at finding many creatures, including pandas and poodles. But the service reported "no results" for the search terms "gorilla," "chimp," "chimpanzee," and "monkey."

18 of 306 comments (clear)

  1. How does that work in practice? by TimothyHollins · · Score: 5, Funny

    More than two years later, one of those fixes is erasing gorillas, and some other primates, from the service's lexicon. The awkward workaround illustrates the difficulties Google and other tech companies face in advancing image-recognition technology, which the companies hope to use in self-driving cars, personal assistants, and other products.

    So what do their cars do now when they spot a gorilla crossing the road?

    1. Re:How does that work in practice? by Anonymous Coward · · Score: 3, Funny

      They pretend that the gorilla is a large rabbit. This usually keeps the car from hitting the gorilla.

    2. Re:How does that work in practice? by Solandri · · Score: 5, Informative

      You're trying to be funny, but I think this highlights part of the problem. It's not necessarily Google's image recognition software, it's also poor photographs. A self-driving car (if it needed to distinguish between gorillas and black people) wouldn't have as much problem because it can adjust the camera's exposure to where it can see enough detail to distinguish the two. But a lot of photos of black people are taken with the wrong exposure, and the black skin tones end up crushed down into just a few discrete color values near black, or clipped to 0. The AI then ends up trying to distinguish one black humanoid-shaped blob from another.

      When I shot weddings on film, I had to use special low contrast film (had a larger dynamic range). That was the only way to retain detail in both the bride's white dress and the groom's black tuxedo. And even then, if the wedding was held in sunlight a lot of the detail might still be unrecoverable. Modern cameras are getting around the problem with automatic HDR photo mode (takes two photos at different exposures to preserve detail in both the highlights and shadows, then combines them nonlinearly). But there's still a huge library of badly-exposed photos out there (from the pre-HDR days and being added to by current photographers taking simple snapshots without really caring about exposure), just waiting to trip up any image recognition AI.

      White skin tends to be slightly brighter than the average background, while black skin tends to be much darker. So to properly expose a portrait of a black person, you have to either make sure their skin dominates the camera's auto-exposure algorithm, and not the background or their clothing. Or put additional light specifically on their face (e.g. fill flash) so it's not so dark relative to the background. A professional photographer knows this. The average person taking a snapshot, and the auto-exposure algorithm in their camera, does not.

    3. Re:How does that work in practice? by Anonymous Coward · · Score: 3, Interesting

      A self-driving car (if it needed to distinguish between gorillas and black people) wouldn't have as much problem because it can adjust the camera's exposure to where it can see enough detail to distinguish the two. ...

      A professional photographer knows this. The average person taking a snapshot, and the auto-exposure algorithm in their camera, does not.

      There is a a fascinating contradiction here that reveals why "self driving cars" are not anywhere close to being a reality.

      In order for the car to adjust the camera exposure to see enough detail to distinguish between a black person and a gorilla, it needs to somehow "know" that there is a problem with what it "thinks" it sees. Of course a professional photographer has the skill to do this, because they are considered to be intelligent. If the car is able to do this, then it, too, will be considered intelligent - but that puts us in the uncomfortable position of needing a self-driving car to be intelligent in order for it to operate safely, such that it can identify the situation where it "knows" there is a problem with what it "thinks" it is seeing.

      Who is working on this problem? The AI researchers have their hands full with getting their programs to identify street signs, but now the code needs to have some common sense, an ability to reflect on its own conclusions. "I see two gorillas crossing the street... oh, wait, that doesn't make any sense, let me adjust the camera exposure... Ah, whereas before I saw two gorillas crossing the street, I now see one gorilla and one dark skinned individual."

      And even if the "one gorilla and one dark skinned individual" conclusion is silly and contrived, at some point the self-driving car has to make a decision, it has to *do something* in response to the situation. If it spends .5 seconds adjusting the camera exposure and analyzing the scene over and over, all it has done is distracted itself - just like a real driver.

  2. In defense of Google by Baron_Yam · · Score: 4, Insightful

    Have you ever gone to the zoo and looked at the larger primates? They're fascinating because they're so much like us; I defy you to look a silverback in the eyes and not see a near-human intelligence looking back at you.

    To a human, they're obviously not human... but to an algorithm checking out just the facial features? I'm surprised this didn't happen sooner.

    1. Re:In defense of Google by Anonymous Coward · · Score: 3, Funny

      As the silverback looks back thinking "That's what you get for not nominating Bernie".

    2. Re:In defense of Google by Anonymous Coward · · Score: 5, Funny

      As someone 5 standard deviations above average...

      IQ, or pants size?

  3. People look like apes, black people more so by swb · · Score: 4, Insightful

    Why is this so hard to accept as not only true, but also a giant image recognition/computer vision challenge?

    You go to nearly any zoo with large primates and you're bound to hear someone say "They look so human!" Well of course they do, humans are primates.

    Which means that it works in reverse, too, primates look like humans. And it's not surprising that blacks look more like gorillas. I mean, there is the whole black coloration to begin with, but also the flatter nose and other facial features of gorillas which are shared with black more than Caucasians.

    Of course no reasonable human would think that a black *is* a gorilla or vice versa. But computer vision? It's like version 0.01 alpha and the similarities are strong enough that it's not surprising at all that it would misidentify blacks as gorillas or vice versa.

    1. Re:People look like apes, black people more so by Baron_Yam · · Score: 5, Insightful

      It's like that recent H&M ad scandal with the little kid wearing a "Coolest monkey in the jungle" shirt. Kids get called monkeys all the time... when they're playing (especially climbing trees!) there's not a hell of a lot of difference between them and other young primates playing.

      Because of (primarily) American racism issues, everyone assumes if you're calling a dark-skinned kid a 'monkey' you're trying to chain him and put him to work picking cotton. Same thing here - it's an understandable situation that gets people all bent out of shape because of shit that SHOULD be nothing but embarrassing history that died with our grandparents' generation.

    2. Re:People look like apes, black people more so by lgw · · Score: 4, Insightful

      And yet, if you said what swb said inside Google, you'd be blacklisted by managers, targeted by Googles peer-pressure diversity acceptance program, and possibly threatened with violence (according to the screenshots presented as evidence in the lawsuit).

      None of this should be controversial, none of this should be interesting, and yet there's a whole political group in the US (well, more than one) who exist only to benefit from identity politics, so everything is offensive.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    3. Re:People look like apes, black people more so by danbert8 · · Score: 5, Interesting

      Considering the equivalent intelligence of a computer, mis-identifying a gorilla and a black person based on facial features alone isn't half bad... It's exactly something you'd expect from a low intelligence entity with little experience and limited comprehension of the ramifications of the identification. Similar to a toddler, don't be surprised when computers start thinking all fat people are going to have a baby just because they have been told that there is a baby inside a big belly.

      It's pattern recognition. The computers are seeing a pattern, but it's incomplete and thus wrong. It's not like the computer was programmed to be offensive...

      --
      Yes it's an anecdote! Were you expecting original research in a Slashdot comment?
    4. Re: People look like apes, black people more so by sheramil · · Score: 5, Funny

      Google, American. 'Porch monkey', American racial term. This story is all about American race relations.

      Haven't you heard? We're taking it back!

  4. Why is his skin color even relevant? by SirJorgelOfBorgel · · Score: 5, Insightful

    I'm as white as they come and Google Photos has tagged several monkeys in my pictures as me. Nobody is writing news stories about that (as well they shouldn't!), but because this guy is black the world ended ?

  5. Few offended - many faked outrage by FeelGood314 · · Score: 5, Insightful

    You do not have the right not to be offended. Generally I shouldn't go out of my way to do something just to offend you but that's not even close to the case here. I seriously doubt many people were offended. I do however think a certain group of people used this as an opportunity to criticize google. This group of people care less about difficulties black people face than they do care about being seen about caring about black issues. There is a reason SJW is a derogatory term.

    There are so many actual issues that black or native North Americans face where the solutions are actually hindered by SJWs. It is quite frustrating.

  6. Re:It's not a "vision problem" - it's genetic real by Baron_Yam · · Score: 5, Insightful

    1) IQ tests are extremely culturally biased. There may be average intelligence differences you could correlate with skin colour, but none we can currently measure, and certainly none significant enough to use to prejudge individual ability.

    2) Koko is a fraud that has been debunked several times. Koko is amazing, but nowhere near the level of amazing that the involved researchers proclaim.

    3) Reality isn't nice, but you're racist.

  7. Re:Black Panthers was perfectly acceptable by rahvin112 · · Score: 3, Informative

    Either you are being deliberately obtuse or you're an idiot.

    Gorilla is offensive for the same reason other terms used derogatorily are. It was frequently used as a term of offense during the slave trade and jim crow. There are references going back to the 1600's when the slave trade started referring to humans with dark skin as gorilla's or apes.

    But go ahead and think it's not a big deal because you're an idiot, you'd think differently if someone had used the term to refer to you as sub-human.

  8. Re:It's not a "vision problem" - it's genetic real by itsdapead · · Score: 3, Insightful

    Well, when we have a universally agreed definition of what "intelligence" is, and have shown how it can be accurately and usefully quantified as a single number (a rather extraordinary claim in itself), then maybe someone could start to design an unbiassed test for it. Wake me up when that happens. The HHGTTG joke about the ultimate answer being 42 had it right: there's no point looking for an answer until you have properly defined and understood the question.

    I mean, the person at Google who thought "lets automatically, and without consent, tag the public's photos with names as identified by an untested algorithm without any checks on identifying people as animals, celebrities, famous criminals, other people's partners etc. - what could possibly go wrong?" probably aced a shitload of intelligence tests.

    --
    In a survey of 100 programmers, 111111 thought that duck-typing was a good idea.
  9. Re:Black Panthers was perfectly acceptable by asdfman2000 · · Score: 4, Interesting

    It was frequently used as a term of offense during the slave trade...

    While Gorilla has been used as offensive term for blacks, you shouldn't make up facts. Just stick to the truth - it's bad enough as it is.

    Gorillas weren't even known in the Western world until 1847. There's only a 14-year overlap with American Slavery (trans-atlantic slave trade having been abolished almost a half century before the discovery), and it's not like the American South was tapped into the latest ecology news out of Africa.