Slashdot Mirror
Amazon Is Pushing Facial Recognition Tech That a Study Says Could Be Biased (nytimes.com)
An anonymous reader quotes a report from The New York Times: Over the last two years, Amazon has aggressively marketed its facial recognition technology to police departments and federal agencies as a service to help law enforcement identify suspects more quickly. Now a new study from researchers at the M.I.T. Media Lab has found that Amazon's system, Rekognition, had much more difficulty in telling the gender of female faces and of darker-skinned faces in photos than similar services from IBM and Microsoft. The results raise questions about potential bias that could hamper Amazon's drive to popularize the technology.
In the study, published Thursday, Rekognition made no errors in recognizing the gender of lighter-skinned men. But it misclassified women as men 19 percent of the time, the researchers said, and mistook darker-skinned women for men 31 percent of the time. Microsoft's technology mistook darker-skinned women for men just 1.5 percent of the time. For the latest study, [co-author of the study, Ms. Buolamwini, said] she sent a letter with some preliminary results to Amazon seven months ago. But she said that she hadn't heard back from Amazon, and that when she and a co-author retested the company's product a couple of months later, it had not improved. "It's not possible to draw a conclusion on the accuracy of facial recognition for any use case -- including law enforcement -- based on results obtained using facial analysis," Matt Wood, general manager of AI at Amazon Web Services, said. He added that the researchers had not tested the latest version of Rekognition, which was updated in November.
"Amazon said that in recent internal tests using an updated version of its service, the company found no difference in accuracy in classifying gender across all ethnicities," the NYT reports. The new study is scheduled to be presented Monday at an artificial intelligence and ethics conference in Honolulu.
In the study, published Thursday, Rekognition made no errors in recognizing the gender of lighter-skinned men. But it misclassified women as men 19 percent of the time, the researchers said, and mistook darker-skinned women for men 31 percent of the time. Microsoft's technology mistook darker-skinned women for men just 1.5 percent of the time. For the latest study, [co-author of the study, Ms. Buolamwini, said] she sent a letter with some preliminary results to Amazon seven months ago. But she said that she hadn't heard back from Amazon, and that when she and a co-author retested the company's product a couple of months later, it had not improved. "It's not possible to draw a conclusion on the accuracy of facial recognition for any use case -- including law enforcement -- based on results obtained using facial analysis," Matt Wood, general manager of AI at Amazon Web Services, said. He added that the researchers had not tested the latest version of Rekognition, which was updated in November.
"Amazon said that in recent internal tests using an updated version of its service, the company found no difference in accuracy in classifying gender across all ethnicities," the NYT reports. The new study is scheduled to be presented Monday at an artificial intelligence and ethics conference in Honolulu.
Prejudice in favor of or against one thing, person, or group compared with another, usually in a way considered to be unfair.
If it were equally inaccurate across racial and gender lines, you'd be right. The algorithm has more false positives among dark skinned and female people (because it depends on shadows and lighting, so makeup and dark skin naturally present difficulties.) Also, beards.
With lidar and better color ranges in the data, the technology would lack bias. Unfortunately, it favors beardless bald white men, so it is, by definition, biased against women and minorities.
And bearded men.
Oh, and glasses. Or hats. Long hair. Really, the people with the lowest level of bias are bald white men with no facial hair, like Howie Mandel or Joe Rogan. If you're a bearded black woman wearing a hat, the algorithm wouldn't have a clue.
The algorithms are interesting technically, and I'm sure there are genuinely well intentioned cops trying to use this for good, but society needs to rein in the surveillance state and big tech before people start getting hurt.
work by recording the light reflected from objects.
Darker-toned faces reflect less visible-wavelength light.
That's just physics, not racism.
So the amount of light, and ability to resolve contrasts, edges etc, would be less.
So the image classification task might be subject to more error.
Perhaps a different spectral range would work better?
Where are we going and why are we in a handbasket?
Why the hell would you WANT some fucked up bezos computer to identify you as you walk down the street?
I would say it is biased against bald beardless white men. Black women get misidentified at such a high rate the tech is worthless to identify them. That is a GOOD THING FOR BLACK WOMEN!!!
Iâ(TM)m not bald and now I am definitely keeping my beard. For once, a benefit to being a black woman: you dont get tracked and stored by bezos and his evil minions.
And any amazon engineers reading this who worked on the tech, SHAME ON YOU! You could have earned just as much working on tech that is not evil and not putting it straight into the hands of evil people and everyone with a dollar.