Slashdot Mirror
Google Executive Warns of Face ID Bias (bbc.com)
Facial recognition technology does not yet have "the diversity it needs" and has "inherent biases," a top Google executive has warned. From a report: The remarks, from the firm's director of cloud computing, Diane Greene, came after rival Amazon's software wrongly identified 28 members of Congress, disproportionately people of colour, as police suspects. Google, which has not opened its facial recognition technology to public use, was working on gathering vast sums of data to improve reliability, Ms Greene said. However, she refused to discuss the company's controversial work with the military. "Bad things happen when I talk about Maven," Ms Greene said, referring to a soon-to-be abandoned project with the US military to develop artificial intelligence technology for drones. After considerable employee pressure, including resignations, Google said it would not renew its contract with the Pentagon after it lapses some time in 2019. The firm has not commented on the deal since, only to release a set of "AI principles" that stated it would not use artificial intelligence or machine learning to create weapons.
The technology behind FaceID has no bias. It works really well - if given the right training data. Now it could easily be that the training data you are feeding it is biased in some way, but that is why extensive testing of the resulting recognition engine you have built is key, so you can go back and correct training data...
Because training neural networks is kind of a blackbox, it's sometimes hard to say what kind of bias you may have built in. the Amazon system recognizing a set of politicians as criminal might be down to the lighting used in the picture being a lot like mug shot lighting!
Or who knows, maybe it's latched onto specific micro-expressions of criminals and the politicians it identified really are criminals, we just don't know it yet... :-)
"There is more worth loving than we have strength to love." - Brian Jay Stanley
That's really broken. It missed at least 500 more...
The problem is the amount of light the camera sensors receive. Darker faces reflect less light, and thus the camera sensor gets less data to work with making algorithms based on that data less accurate at identifying darker faces.
This presents an obvious solution. To further the goal of eliminating racial bias, we need to turn off all the lights. That means all light bulbs need to be banned, and existing ones destroyed. NASA should launch a huge unfurling disk to block out the sun and leave the planet in perpetual darkness. Newborns should have their eyes surgically removed upon birth (they won't suffer because they won't know what they're missing). Only then can we be free of the evil racial bias being promulgated by light.
The technology reflects the biases of its inventors
The "technology" behind this is neural networks. How do they reflect bias at al?
They are nothing more than the ultimately transparent black box, reflecting whatever you choose to put into it...
They are so non-biases in fact, the same technology is used to detect if something is a cat or a slice of pizza, or even if tumors are cancerous or not. Yet you could claim racial bias (you did not state that but it was implied).
Like I said, care needs to be taken both in training and in testing, that is where bias may be introduced. But the technology itself is inherently unbiased and a great tool, if used correctly.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
the two most straightforward are Bad training data
Which is not inherent in the technology as I've pointed out in every post.
and Bugs. Bugs are an issue in ANY software and neural networks are no different and bugs can result in biases.
That reflects a lack of understanding of how neural networks work. They actually are not buggy themselves as they are very simple; all bugs are entirely represented in training data and testing, not in the software itself. You put something in the black box and it classifies it in some desired way, the way the box works is all about the training data.
Furthermore it's a bit odd to claim bugs are a kind of "bias" as usually they are more about failure than bias...
"There is more worth loving than we have strength to love." - Brian Jay Stanley
It's harder to see the contours of a dark-colored shape (ie a face) than a white one.
Seriously, people, how are we going to get around that?
-Styopa