Slashdot Mirror


Google's Sentiment Analyzer Thinks Being Gay Is Bad (vice.com)

gooddogsgotoheaven shares a report from Motherboard: In July 2016, Google announced the public beta launch of a new machine learning application program interface (API), called the Cloud Natural Language API. It allows developers to incorporate Google's deep learning models into their own applications. As the company said in its announcement of the API, it lets you "easily reveal the structure and meaning of your text in a variety of languages." In addition to entity recognition (deciphering what's being talked about in a text) and syntax analysis (parsing the structure of that text), the API included a sentiment analyzer to allow programs to determine the degree to which sentences expressed a negative or positive sentiment, on a scale of -1 to 1. The problem is the API labels sentences about religious and ethnic minorities as negative -- indicating it's inherently biased. For example, it labels both being a Jew and being a homosexual as negative. A Google spokesperson issued the following statement in response to Motherboard's request for comment: "We dedicate a lot of efforts to making sure the NLP API avoids bias, but we don't always get it right. This is an example of one of those times, and we are sorry. We take this seriously and are working on improving our models. We will correct this specific case, and, more broadly, building more inclusive algorithms is crucial to bringing the benefits of machine learning to everyone."

6 of 453 comments (clear)

  1. Re:See below by TWX · · Score: 5, Insightful

    If the algorithms that have come to these conclusions are based on analyzing public data from the Internet, then if an AI decides that any particular characteristic is negative, it's because it reflects the sentiments of those who bother to post opinions.

    Most people that do not themselves exhibit the trait that's being argued-against by the noisy minority don't usually express opinions on it, so they're a hole in the data that needs to be accounted for. Unfortunately it's a lot easier to interpret based on what has been said than what has not been said.

    --
    Do not look into laser with remaining eye.
  2. Re:Comments by stephanruby · · Score: 5, Insightful

    Their api is trying to be too universal and monolithic.

    Gay is neither good or bad. Gay is just a label. Google should be able to recognize that 'gay' means one thing when a bigot uses it, but it should also recognize that 'gay' means something else when others use it.

    In other words, the meaning of words should be heavily weighed on the training data of the individual listening/reading and on the training data of the individual speaking/writing.

  3. Look in the mirror by JOstrow · · Score: 5, Informative

    So many of us already use "gay" and "jew" as derogatory terms. Is it any wonder that Google's NLP picked up on that? What source do you think it learned from?

  4. Re:That's because... by Jeremi · · Score: 5, Insightful

    Biologically speaking homosexuality is bad for the replication of any species in it's most basic form

    Well, no.

    Being homosexual might be bad for the replication of the individual (since it reduces the individual's chances of having offspring), but it doesn't necessarily follow that it's therefore also bad for the species.

    Consider that childless homosexuals, not being burdened by the task of having to care for children of their own, will likely therefore have extra time and resources available to help protect and care for the children of child-bearing couples in their family or community, thus improving the children's (and therefore the species') chances of surviving. Given the huge time investment that human children require, increasing a child's odds of survival to adulthood is a huge win.

    And if you think that sort of dynamic is uncommon in nature, consider that fact that 99% of bees are sterile and play no role in the reproduction of their hive, except to gather food and protect the queen and the drones who do handle the reproduction.

    Specialization and division of labor is one of the things human civilization is based on; there's no reason it can't be applied to reproduction as well.

    --


    I don't care if it's 90,000 hectares. That lake was not my doing.
  5. Re:Comments by ShanghaiBill · · Score: 5, Interesting

    I'm gay and I think being gay is "bad".

    I am straight and I think gays are "good". Gay tend to be DINKs (double income no kids), so they have high household incomes and can afford nice houses. They pay property taxes to support the schools, but don't have kids, leading to higher per student educational spending. They contribute to a thriving urban culture and nightlife.

    I live in the SF Bay Area, and gays are a big part of the reason this is a nice place to live, with great schools, creative jobs, safe neighborhoods, and interesting culture. Thank you for being gay.

  6. Re:Comments by war4peace · · Score: 5, Insightful

    Being bisexual myself, obviously I have nothing against fellow gay people. Quite the contrary. However, I think Google's API is spot-on. Even in TFS they say "The problem is the API labels sentences about religious and ethnic minorities as negative" - well thanks, Captain Obvious, the majority will always see the minority in negative ways - because they're different.

    What we need to focus on is what the cause for negative perception is and fix things there, not replacing a correct algorithm with a lying one.

    --
    ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)