Slashdot Mirror


When It Comes to Gorillas, Google Photos Remains Blind (wired.com)

Tom Simonite, writing for Wired: In 2015, a black software developer embarrassed Google by tweeting that the company's Photos service had labeled photos of him with a black friend as "gorillas." Google declared itself "appalled and genuinely sorry." An engineer who became the public face of the clean-up operation said the label gorilla would no longer be applied to groups of images, and that Google was "working on longer-term fixes." More than two years later, one of those fixes is erasing gorillas, and some other primates, from the service's lexicon. The awkward workaround illustrates the difficulties Google and other tech companies face in advancing image-recognition technology, which the companies hope to use in self-driving cars, personal assistants, and other products. WIRED tested Google Photos using a collection of 40,000 images well-stocked with animals. It performed impressively at finding many creatures, including pandas and poodles. But the service reported "no results" for the search terms "gorilla," "chimp," "chimpanzee," and "monkey."

31 of 306 comments (clear)

  1. How does that work in practice? by TimothyHollins · · Score: 5, Funny

    More than two years later, one of those fixes is erasing gorillas, and some other primates, from the service's lexicon. The awkward workaround illustrates the difficulties Google and other tech companies face in advancing image-recognition technology, which the companies hope to use in self-driving cars, personal assistants, and other products.

    So what do their cars do now when they spot a gorilla crossing the road?

    1. Re:How does that work in practice? by Anonymous Coward · · Score: 3, Funny

      They pretend that the gorilla is a large rabbit. This usually keeps the car from hitting the gorilla.

    2. Re:How does that work in practice? by j2.718ff · · Score: 2

      So what do their cars do now when they spot a gorilla crossing the road?

      It's not about crossing the road. It's about hailing a ride from a self-driving taxi. Until google solves this problem, gorillas will be able go wherever they want by car, which will cause the other animals to get mad.

    3. Re:How does that work in practice? by Solandri · · Score: 5, Informative

      You're trying to be funny, but I think this highlights part of the problem. It's not necessarily Google's image recognition software, it's also poor photographs. A self-driving car (if it needed to distinguish between gorillas and black people) wouldn't have as much problem because it can adjust the camera's exposure to where it can see enough detail to distinguish the two. But a lot of photos of black people are taken with the wrong exposure, and the black skin tones end up crushed down into just a few discrete color values near black, or clipped to 0. The AI then ends up trying to distinguish one black humanoid-shaped blob from another.

      When I shot weddings on film, I had to use special low contrast film (had a larger dynamic range). That was the only way to retain detail in both the bride's white dress and the groom's black tuxedo. And even then, if the wedding was held in sunlight a lot of the detail might still be unrecoverable. Modern cameras are getting around the problem with automatic HDR photo mode (takes two photos at different exposures to preserve detail in both the highlights and shadows, then combines them nonlinearly). But there's still a huge library of badly-exposed photos out there (from the pre-HDR days and being added to by current photographers taking simple snapshots without really caring about exposure), just waiting to trip up any image recognition AI.

      White skin tends to be slightly brighter than the average background, while black skin tends to be much darker. So to properly expose a portrait of a black person, you have to either make sure their skin dominates the camera's auto-exposure algorithm, and not the background or their clothing. Or put additional light specifically on their face (e.g. fill flash) so it's not so dark relative to the background. A professional photographer knows this. The average person taking a snapshot, and the auto-exposure algorithm in their camera, does not.

    4. Re:How does that work in practice? by michelcolman · · Score: 2

      Nah, since they removed the gorilla label, the AI probably labels all gorillas as "black person" now,

    5. Re:How does that work in practice? by Anonymous Coward · · Score: 3, Interesting

      A self-driving car (if it needed to distinguish between gorillas and black people) wouldn't have as much problem because it can adjust the camera's exposure to where it can see enough detail to distinguish the two. ...

      A professional photographer knows this. The average person taking a snapshot, and the auto-exposure algorithm in their camera, does not.

      There is a a fascinating contradiction here that reveals why "self driving cars" are not anywhere close to being a reality.

      In order for the car to adjust the camera exposure to see enough detail to distinguish between a black person and a gorilla, it needs to somehow "know" that there is a problem with what it "thinks" it sees. Of course a professional photographer has the skill to do this, because they are considered to be intelligent. If the car is able to do this, then it, too, will be considered intelligent - but that puts us in the uncomfortable position of needing a self-driving car to be intelligent in order for it to operate safely, such that it can identify the situation where it "knows" there is a problem with what it "thinks" it is seeing.

      Who is working on this problem? The AI researchers have their hands full with getting their programs to identify street signs, but now the code needs to have some common sense, an ability to reflect on its own conclusions. "I see two gorillas crossing the street... oh, wait, that doesn't make any sense, let me adjust the camera exposure... Ah, whereas before I saw two gorillas crossing the street, I now see one gorilla and one dark skinned individual."

      And even if the "one gorilla and one dark skinned individual" conclusion is silly and contrived, at some point the self-driving car has to make a decision, it has to *do something* in response to the situation. If it spends .5 seconds adjusting the camera exposure and analyzing the scene over and over, all it has done is distracted itself - just like a real driver.

    6. Re:How does that work in practice? by h33t+l4x0r · · Score: 2

      I once ran one over in my pajamas. How he got into my pajamas I'll never know.

    7. Re:How does that work in practice? by AmiMoJo · · Score: 2

      It's a weakness of the AI too. Humans know how other humans act. They stand upright, they sit in chairs, they eat with cutlery, they tend to look at the camera, they smile, they have patches of skin not covered by hair... Even with a bad photo, a human can tell it's not a primate from other clues.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  2. In defense of Google by Baron_Yam · · Score: 4, Insightful

    Have you ever gone to the zoo and looked at the larger primates? They're fascinating because they're so much like us; I defy you to look a silverback in the eyes and not see a near-human intelligence looking back at you.

    To a human, they're obviously not human... but to an algorithm checking out just the facial features? I'm surprised this didn't happen sooner.

    1. Re:In defense of Google by Anonymous Coward · · Score: 3, Funny

      As the silverback looks back thinking "That's what you get for not nominating Bernie".

    2. Re:In defense of Google by Anonymous Coward · · Score: 5, Funny

      As someone 5 standard deviations above average...

      IQ, or pants size?

  3. People look like apes, black people more so by swb · · Score: 4, Insightful

    Why is this so hard to accept as not only true, but also a giant image recognition/computer vision challenge?

    You go to nearly any zoo with large primates and you're bound to hear someone say "They look so human!" Well of course they do, humans are primates.

    Which means that it works in reverse, too, primates look like humans. And it's not surprising that blacks look more like gorillas. I mean, there is the whole black coloration to begin with, but also the flatter nose and other facial features of gorillas which are shared with black more than Caucasians.

    Of course no reasonable human would think that a black *is* a gorilla or vice versa. But computer vision? It's like version 0.01 alpha and the similarities are strong enough that it's not surprising at all that it would misidentify blacks as gorillas or vice versa.

    1. Re:People look like apes, black people more so by Baron_Yam · · Score: 5, Insightful

      It's like that recent H&M ad scandal with the little kid wearing a "Coolest monkey in the jungle" shirt. Kids get called monkeys all the time... when they're playing (especially climbing trees!) there's not a hell of a lot of difference between them and other young primates playing.

      Because of (primarily) American racism issues, everyone assumes if you're calling a dark-skinned kid a 'monkey' you're trying to chain him and put him to work picking cotton. Same thing here - it's an understandable situation that gets people all bent out of shape because of shit that SHOULD be nothing but embarrassing history that died with our grandparents' generation.

    2. Re:People look like apes, black people more so by lgw · · Score: 4, Insightful

      And yet, if you said what swb said inside Google, you'd be blacklisted by managers, targeted by Googles peer-pressure diversity acceptance program, and possibly threatened with violence (according to the screenshots presented as evidence in the lawsuit).

      None of this should be controversial, none of this should be interesting, and yet there's a whole political group in the US (well, more than one) who exist only to benefit from identity politics, so everything is offensive.

      --
      Socialism: a lie told by totalitarians and believed by fools.
    3. Re:People look like apes, black people more so by danbert8 · · Score: 5, Interesting

      Considering the equivalent intelligence of a computer, mis-identifying a gorilla and a black person based on facial features alone isn't half bad... It's exactly something you'd expect from a low intelligence entity with little experience and limited comprehension of the ramifications of the identification. Similar to a toddler, don't be surprised when computers start thinking all fat people are going to have a baby just because they have been told that there is a baby inside a big belly.

      It's pattern recognition. The computers are seeing a pattern, but it's incomplete and thus wrong. It's not like the computer was programmed to be offensive...

      --
      Yes it's an anecdote! Were you expecting original research in a Slashdot comment?
    4. Re:People look like apes, black people more so by Baron_Yam · · Score: 2

      Your certainty is based in ignorance.

      Humans and gorillas are remarkably similar unless you're blessed with a brain that has a highly evolved 'us and them' image recognition capability.

      In fact, we're all in the same family - Hominidae. Out of billions of years of evolution on this planet, our ancestors only split from those of gorillas a mere 8-10 million years ago.

    5. Re: People look like apes, black people more so by sheramil · · Score: 5, Funny

      Google, American. 'Porch monkey', American racial term. This story is all about American race relations.

      Haven't you heard? We're taking it back!

    6. Re:People look like apes, black people more so by MBGMorden · · Score: 2

      Yeah - my brother's nickname for his daughter is "Baby monkey" (which he often sings as "I love baby monkeys" to the tune of "I love beach music", but I digress).

      Point is its very common for kids to be referred to as monkeys. Now, given the past situation I certainly think it would be wise to pull the ad once it was brought to their attention, but realistically there's almost zero chance that any racism or offense was intended. As a matter of fact to a large degree I think it's a sign of how far we've come that for the ad team that didn't even make the association of it being offensive when they put it together.

      As a matter of fact at some point I think it becomes far more harmful to keep reminding people about all these historical things that were once considered derogatory rather than letting those notions die.

      --
      "People who think they know everything are very annoying to those of us who do."-Mark Twain
    7. Re:People look like apes, black people more so by lgw · · Score: 2

      There's plenty of evidence this is true: evidence in a court case, in the form of screen shits of Google communications. Could be faked, of course, but presented under oath.

      No one was fired, of course, because no one said what swb said.

      --
      Socialism: a lie told by totalitarians and believed by fools.
  4. Telling them apart by doconnor · · Score: 2

    I expect a lot of humans wouldn't get 100% accuracy at telling species from the same order apart either. We have certain hardcoded advantages when it comes to our own species.

  5. Why is his skin color even relevant? by SirJorgelOfBorgel · · Score: 5, Insightful

    I'm as white as they come and Google Photos has tagged several monkeys in my pictures as me. Nobody is writing news stories about that (as well they shouldn't!), but because this guy is black the world ended ?

  6. Few offended - many faked outrage by FeelGood314 · · Score: 5, Insightful

    You do not have the right not to be offended. Generally I shouldn't go out of my way to do something just to offend you but that's not even close to the case here. I seriously doubt many people were offended. I do however think a certain group of people used this as an opportunity to criticize google. This group of people care less about difficulties black people face than they do care about being seen about caring about black issues. There is a reason SJW is a derogatory term.

    There are so many actual issues that black or native North Americans face where the solutions are actually hindered by SJWs. It is quite frustrating.

    1. Re:Few offended - many faked outrage by Baron_Yam · · Score: 2

      >There are so many actual issues that black or native North Americans face

      When I was a kid, dark-skinned people didn't show up well in photos... primarily because white people chose the film chemistry to make the faces they were familiar with (pale ones!) look good in pictures.

      I think THAT was probably deserving of some indignant complaining. THIS is a quick laugh and a "Well, let's try and figure out how to make the algorithm better". Anything more tells you a lot more about the person complaining than it does about the coders.

  7. But what... by TimMD909 · · Score: 2

    ... since some black dudes were tagged as "gorillas", does that mean that some gorillas will be now detected as "black men"?

    Because if not, I'll need to hurry up and find something else to be outraged about.

  8. Re:It's not a "vision problem" - it's genetic real by Baron_Yam · · Score: 5, Insightful

    1) IQ tests are extremely culturally biased. There may be average intelligence differences you could correlate with skin colour, but none we can currently measure, and certainly none significant enough to use to prejudge individual ability.

    2) Koko is a fraud that has been debunked several times. Koko is amazing, but nowhere near the level of amazing that the involved researchers proclaim.

    3) Reality isn't nice, but you're racist.

  9. Re:Black Panthers was perfectly acceptable by rahvin112 · · Score: 3, Informative

    Either you are being deliberately obtuse or you're an idiot.

    Gorilla is offensive for the same reason other terms used derogatorily are. It was frequently used as a term of offense during the slave trade and jim crow. There are references going back to the 1600's when the slave trade started referring to humans with dark skin as gorilla's or apes.

    But go ahead and think it's not a big deal because you're an idiot, you'd think differently if someone had used the term to refer to you as sub-human.

  10. Re:It's not a "vision problem" - it's genetic real by itsdapead · · Score: 3, Insightful

    Well, when we have a universally agreed definition of what "intelligence" is, and have shown how it can be accurately and usefully quantified as a single number (a rather extraordinary claim in itself), then maybe someone could start to design an unbiassed test for it. Wake me up when that happens. The HHGTTG joke about the ultimate answer being 42 had it right: there's no point looking for an answer until you have properly defined and understood the question.

    I mean, the person at Google who thought "lets automatically, and without consent, tag the public's photos with names as identified by an untested algorithm without any checks on identifying people as animals, celebrities, famous criminals, other people's partners etc. - what could possibly go wrong?" probably aced a shitload of intelligence tests.

    --
    In a survey of 100 programmers, 111111 thought that duck-typing was a good idea.
  11. Re:Self driving car ethics by iggymanz · · Score: 2

    A human who steps out within 60 feet of a car going 40MPH that has no alternate path available to it will get hit, brakes or no brakes. There will come situations where any alternate paths will also have humans. Self driving cars will sometimes be killing humans, that is a certainty.

  12. Re:Black Panthers was perfectly acceptable by rahvin112 · · Score: 2, Informative

    That don't apply anymore? Don't be a fucking idiot. Gorilla is a term as frequently used as any other racial slur. It's used just as often today as all the other terms as it was when it first started to be used.

  13. Re:Black Panthers was perfectly acceptable by asdfman2000 · · Score: 4, Interesting

    It was frequently used as a term of offense during the slave trade...

    While Gorilla has been used as offensive term for blacks, you shouldn't make up facts. Just stick to the truth - it's bad enough as it is.

    Gorillas weren't even known in the Western world until 1847. There's only a 14-year overlap with American Slavery (trans-atlantic slave trade having been abolished almost a half century before the discovery), and it's not like the American South was tapped into the latest ecology news out of Africa.

  14. Re:Black Panthers was perfectly acceptable by pnutjam · · Score: 2

    A relative gave us some old cartoons when my daughters were younger. My wife said she was watching a "Betty Boop" cartoon and couldn't figure out why there was a gorilla in the audience, until it started to spit watermelon and she realized it was a derogatory caricature. We removed those from our cartoon lineup.

    I know some of the early Tom and Jerry cartoons I saw as a kid had similarly insensitive inclusions. It's actually pretty shocking to run across these sorts of things. It's easy to forgot how hurtful previous generations were.
    I'm often reminded of this when I hear young people talking about civil rights. They aren't cognizant of the sorts of things that really happened. They can't fathom the idea of living every day afraid of rape or murder without any authority to turn to for protection.