Slashdot Mirror
Google Executive Warns of Face ID Bias (bbc.com)
Facial recognition technology does not yet have "the diversity it needs" and has "inherent biases," a top Google executive has warned. From a report: The remarks, from the firm's director of cloud computing, Diane Greene, came after rival Amazon's software wrongly identified 28 members of Congress, disproportionately people of colour, as police suspects. Google, which has not opened its facial recognition technology to public use, was working on gathering vast sums of data to improve reliability, Ms Greene said. However, she refused to discuss the company's controversial work with the military. "Bad things happen when I talk about Maven," Ms Greene said, referring to a soon-to-be abandoned project with the US military to develop artificial intelligence technology for drones. After considerable employee pressure, including resignations, Google said it would not renew its contract with the Pentagon after it lapses some time in 2019. The firm has not commented on the deal since, only to release a set of "AI principles" that stated it would not use artificial intelligence or machine learning to create weapons.
"There is no native criminal class except Congress." -- Mark Twain
But they'll happily allow it to be used to subjugate and oppress civilians.
If those employees were so concerned about rights and liberties they'd have blocked the tech altogether.
The technology behind FaceID has no bias. It works really well - if given the right training data. Now it could easily be that the training data you are feeding it is biased in some way, but that is why extensive testing of the resulting recognition engine you have built is key, so you can go back and correct training data...
Because training neural networks is kind of a blackbox, it's sometimes hard to say what kind of bias you may have built in. the Amazon system recognizing a set of politicians as criminal might be down to the lighting used in the picture being a lot like mug shot lighting!
Or who knows, maybe it's latched onto specific micro-expressions of criminals and the politicians it identified really are criminals, we just don't know it yet... :-)
"There is more worth loving than we have strength to love." - Brian Jay Stanley
The problem is the amount of light the camera sensors receive. Darker faces reflect less light, and thus the camera sensor gets less data to work with making algorithms based on that data less accurate at identifying darker faces.
This presents an obvious solution. To further the goal of eliminating racial bias, we need to turn off all the lights. That means all light bulbs need to be banned, and existing ones destroyed. NASA should launch a huge unfurling disk to block out the sun and leave the planet in perpetual darkness. Newborns should have their eyes surgically removed upon birth (they won't suffer because they won't know what they're missing). Only then can we be free of the evil racial bias being promulgated by light.
The technology reflects the biases of its inventors
The "technology" behind this is neural networks. How do they reflect bias at al?
They are nothing more than the ultimately transparent black box, reflecting whatever you choose to put into it...
They are so non-biases in fact, the same technology is used to detect if something is a cat or a slice of pizza, or even if tumors are cancerous or not. Yet you could claim racial bias (you did not state that but it was implied).
Like I said, care needs to be taken both in training and in testing, that is where bias may be introduced. But the technology itself is inherently unbiased and a great tool, if used correctly.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
duh... that's why you never do it in the first place!
Just don't go there.
For an executive to make a warning like this but not change her course personally (whether she's even going to stay with Google for pursuing such tech) shows that she really does *not* understand technology in the most fundamental sense and that lack of understanding will probably never change unless it's reflected in personal action on her part to abandon the technology and all ties to it personally.
That applies to *any* Silicon Valley executive, perhaps with rare, Steve-Job-esque exception.
Race ID Bias more like, hate facts be damned!
Let's play a little game. Pick a news show, any news show that has a local crime section. When it's a violent crime like robbery, murder, rape, etc, BEFORE they show a pic of the suspect, guess what the race is. Yeah that's right, it'll be black almost all of the time. FACT.
The technology behind FaceID has no bias. It works really well - if given the right training data.
Given that clearly there isn't a set of "right training data" available that sounds like a hasty conclusion without evidence. Your argument is circular. You say the technology has no bias but proving that it has no bias requires feeding it an unbiased data set which hasn't happened. So neither of us knows if there is an inherent bias built into the system or not. Maybe there is and maybe there isn't but you don't have the data to say either way.
Furthermore it's more complicated than just the training data set. There is code that determines the logic used to analyze the data and that code is subject to biases from the person programming it. They do not have to be conscious biases either. That's not to say it is an irreducible problem but it has to be considered.
Now it could easily be that the training data you are feeding it is biased in some way, but that is why extensive testing of the resulting recognition engine you have built is key, so you can go back and correct training data...
Who is watching the watchmen? The ones checking the data, providing the data, and analyzing the data, and revising the data are people and people have biases. Guarding against and when necessary removing those biases can prove rather tricky especially when the training data sets used are by and large positively loaded with biased data.
Race ID Bias more like, hate facts be damned!
Let's play a little game. Pick a news show, any news show that has a local crime section. When it's a violent crime like robbery, murder, rape, etc, BEFORE they show a pic of the suspect, guess what the race is. Yeah that's right, it'll be black almost all of the time. FACT.
I have a slightly different game. Pick the same news stories and when they don't mention the race of the suspect, then you can assume that it'll be a victim class (as defined by Progressives) almost all the time.
The "technology" behind this is neural networks. How do they reflect bias at al?
Several ways but the two most straightforward are Bad training data and Bugs. Bugs are an issue in ANY software and neural networks are no different and bugs can result in biases. And of course train it with bad data and you'll get biased results. We've seen examples of both cases.
>The technology reflects the biases of its inventors and the society it was invented in.
You think so? I wonder how accurate a facial recognition program developed by a software development company located in a predominately black African populated country like Nigeria would compare to Amazon's. Would it have the same biases of its inventors and the society it was invented in? Would it be more accurate in detecting and distinguishing between black people's visages since the software was developed by African blacks? Or do you think it would produce about the same results that Amazon's version did? I think it would be the latter.
Our species has not evolved past bullshit like racial bias therefore the shitty excuse for AI we have, that has zero capability to think for itself, only reflects who we are like a perfect mirror: humans are racist, therefore the shitty AI is racist, too, and there's no fixing it, any attempt to make it unbiased will just be scoffed at and devalued by the assholes among our species that has embraced racism; they'll dismiss it as 'liberal bias'.
Another step toward a tyrannical, Big Brother-like society, and all preceded, as usual, with the excuse of fighting crime. Google, please stick your Face ID system you know where.
Crime statistics such as black people being falsely arrested at SIGNIFICANTLY higher rates than white people for the same crimes, those statistics?
the two most straightforward are Bad training data
Which is not inherent in the technology as I've pointed out in every post.
and Bugs. Bugs are an issue in ANY software and neural networks are no different and bugs can result in biases.
That reflects a lack of understanding of how neural networks work. They actually are not buggy themselves as they are very simple; all bugs are entirely represented in training data and testing, not in the software itself. You put something in the black box and it classifies it in some desired way, the way the box works is all about the training data.
Furthermore it's a bit odd to claim bugs are a kind of "bias" as usually they are more about failure than bias...
"There is more worth loving than we have strength to love." - Brian Jay Stanley
It's harder to see the contours of a dark-colored shape (ie a face) than a white one.
Seriously, people, how are we going to get around that?
-Styopa
Which is not inherent in the technology as I've pointed out in every post.
It most certainly is. Go ahead and try to make a useful neural network without any data to train it on. What you'll have without the training data is a good approximation of a boat anchor. And making sure you have an unbiased data set is FAR from trivial.
They actually are not buggy themselves as they are very simple;
Being simple does not equal being bug free. Even simple devices and simple programs can and do have bugs.
You put something in the black box and it classifies it in some desired way, the way the box works is all about the training data.
That is only true if there are no flaws in the design and implementation of the box.
Furthermore it's a bit odd to claim bugs are a kind of "bias" as usually they are more about failure than bias...
Bias is favoritism against one thing, person, or group compared with another. It does not have to be intentional nor does it have to reflect any negative attitudes. You can introduce a bias into a device (including a neural network) or a bit of software via a bug. This is not a question.
Literal non issue, coding takes far more effort than that which can be supplied by the race at the left end of the IQ bell curve.
Given that clearly there isn't a set of "right training data" available>
Apple got this right, but you are right that generally there is not a "right training set" for facial recognition.
There cannot be though because it all depends on what you are trying to do. What is right for one purpose would be wrong for another.
Your argument is circular. You say the technology has no bias but proving that it has no bias requires feeding it an unbiased data set
That reflects a total lack of understanding of neural networks and facial recognition. It provably has no bias because it can and is applied to anything, it's simply to general in nature to have any bias. It's like claiming electrons have a bias as to the humans they prefer... it makes no sense.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
yeah, yeah race realist, but I'm talking about a thought experiment that would show that the problem with the software doesn't have anything to do with racial bias, but everything to do with the physics of light, shadow, color and shape.
They are reporting this as if the false positives are either matches or not match. In reality, there are associated levels of confidence, and a match is likely anything more than 95% confidence. Less light means there is more similar data in a photo. What they really need to do is run a different confidence level on faces that reflect less light. Maybe even run a completely separate facial recognition algorithm so the accuracy of the better data is not muddying the confidence levels of the worse data.
If you look at crime statistics, blacks account for a proportion of crime that is far in excess of their proportion of the general population.
Maybe if they start behaving more like whites and asians then they'd start getting ahead more.
Also interesting to note that black migrants from Africa are far and away outperforming "native" blacks.
Star you ID card. The number of the beast at least now there is no doubt who the beast is.
It will never be fool-proof enough to be autonomous, neither will any other form of 'AI'. The sooner engineers accept this reality, the sooner tools could actually be tailored to be useful.
I heard there is this new search engine called google. Give it a shot. Or, you know, step outside your bubble, the. You would realize cops have been beating and arresting black people for no reason since the 60s.
That'd be a big fat NO then...
I looked, I couldn't find any actual data corroborating the claim.
The actual FBI crime stats are easy to get to.
is a "people of colour"