Slashdot Mirror


Microsoft Turned Down Facial-Recognition Sales On Human Rights Concerns (reuters.com)

An anonymous reader quotes a report from Reuters: Microsoft recently rejected a California law enforcement agency's request to install facial recognition technology in officers' cars and body cameras due to human rights concerns, company President Brad Smith said on Tuesday. Microsoft concluded it would lead to innocent women and minorities being disproportionately held for questioning because the artificial intelligence has been trained on mostly white and male pictures. AI has more cases of mistaken identity with women and minorities, multiple research projects have found.

On the other hand, Microsoft did agree to provide the technology to an American prison, after the company concluded that the environment would be limited and that it would improve safety inside the unnamed institution. Smith explained the decisions as part of a commitment to human rights that he said was increasingly critical as rapid technological advances empower governments to conduct blanket surveillance, deploy autonomous weapons and take other steps that might prove impossible to reverse.
Smith also said at a Stanford University conference that Microsoft had declined a deal to install facial recognition on cameras blanketing the capital city of an unnamed country that the nonprofit Freedom House had deemed not free. Smith said it would have suppressed freedom of assembly there.

46 comments

  1. important considerations for all skin tones by Anonymous Coward · · Score: 2, Informative

    "Smith explained the decisions as part of a commitment to human rights that he said was increasingly critical as rapid technological advances empower governments to conduct blanket surveillance, deploy autonomous weapons and take other steps that might prove impossible to reverse."

    1. Re:important considerations for all skin tones by Anonymous Coward · · Score: 0

      They are full of shit. If they really cared then they wouldn't package spyware or a forced malware delivery system in with Windows 10.

  2. Yet again, Windbourne is retarded AF by Anonymous Coward · · Score: 1

    NOBODY is concerned about there being freedoms in China, BECAUSE THERE AREN'T. Protecting the US public from these things is all this does, and you think Microsoft is helping the Chinese military prepare to fight a war, lol?

    You are retarded.

    1. Re:Yet again, Windbourne is retarded AF by NicknameUnavailable · · Score: 1

      NOBODY is concerned about there being freedoms in China, BECAUSE THERE AREN'T.

      Irrelevant. It's software, once it's developed it can be copied, pasted, and have some strings changed to make it work anywhere.

  3. Good. by Gravis+Zero · · Score: 2

    I don't have a lot of positive things to say about Microsoft but this is something they correctly evaluated. It may have been purely because they foresaw the awful PR they would get as a result in the future but it was still a good call.

    --
    Anons need not reply. Questions end with a question mark.
    1. Re:Good. by aaronb1138 · · Score: 1

      I don't see what's wrong. It's a similar scenario as the prison -- limited scope and the not bringing unintended harm.

    2. Re:Good. by Obfuscant · · Score: 0
      The cops already rely a lot on facial recognition -- the "we've seen this guy before" kind.

      There are four cases.

      1. Facial recognition correctly identifies person as non-criminal. End of problem.

      2. Facial recognition correctly identifies person as criminal. End of problem.

      3. Facial recognition INcorrectly identifies person as criminal. Person uses normal identification on the spot to correct problem. Again, end of problem.

      4. Facial recognition INcorrectly identifies person as criminal but they have no identification on them. This is the alleged problem, right? BUT -- the cop has already used wetware recognition to create suspicion as to the person's identity. If the person cannot correct the identification on the spot they may be detained. Which is exactly the same outcome as when computerized FR fails. No difference.

    3. Re: Good. by Anonymous Coward · · Score: 0

      Bollox. I've already had this problem with a plate reader where the back end system had my license incorrectly flagged as suspended.

      You're totally ignoring the implications of incorrect data and the security of that data and the constitutional impacts such as the right to travel.

    4. Re: Good. by Obfuscant · · Score: 1

      Bollox. I've already had this problem with a plate reader where the back end system had my license incorrectly flagged as suspended.

      You showed the current registration and the problem was solved, yes? Your problem is different than a human calling in your plate and being told your plate was suspended exactly how?

      You're totally ignoring the implications of incorrect data and the security of that data and the constitutional impacts such as the right to travel.

      I covered the implication of an incorrect false positive, which is no different than a current false positive.

      This has nothing to do with the "right to travel".

  4. Microsoft Turned Down Facial-Recognition Sales by rsilvergun · · Score: 2, Insightful

    On PR Concerns.

    FTFY.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re:Microsoft Turned Down Facial-Recognition Sales by Anonymous Coward · · Score: 0

      ...or the human rights of the execs weren't honoured with quite enough dollars/golf/hookers etc ;-)

  5. Re:yet, they work for China by Freischutz · · Score: 2

    Seriously, this is funny. MS and Google pretend to care about human rights here, but then in China, they will happily help Chinese gov murder their own.../quote> How, where and when?

  6. Not human rights by Excelcia · · Score: 1

    Turning down a sale because they are concerned about the technology's accuracy is not turning it down based on a human rights concern. If it was a human rights concern, they'd have turned down the sale because they were concerned it would be misused by law enforcement.

    1. Re:Not human rights by Anonymous Coward · · Score: 0

      Would a sale of smart doors that require the user to kneel down and bow to the door for the door to open be a rights issue if the door would only require the bow from certain kinds of people? Reactive and increasingly proactive technology is becoming a part of the public environment, so if a government is to actively protect the rights of the people, it will have to focus on the environment it defines and builds for those citizens even more in the future. Political stability and minimization of crime is at stake here as well, depending of the country.

    2. Re:Not human rights by Excelcia · · Score: 0

      I'm not arguing that this technology is not rife with the possibility of easily doing something heinous with it. I'm totally on board with that. I'm arguing that, in this case, Microsoft refusing to sell it because it didn't work properly is not a rights issue. It's a functional issue. I'd be impressed if they refused to sell it to law enforcement, not because it didn't work, but because it lowers the activation energy required for abuse so much that it essentially is a catalyst for it. Microsoft should have refused to even consider it. Not consider it, then say sorry, it's not really working all that well so we better not.

    3. Re:Not human rights by Anonymous Coward · · Score: 0

      That of course tells us something about the attitudes of the law enforcement that they would want to acquire a functionally deficient product that not only may cause property and pr- damages, but also may systematically violate the rights of the citizens.

  7. So they admit they are racist misogynists by SuperKendall · · Score: 0

    Microsoft concluded it would lead to innocent women and minorities being disproportionately held for questioning because the artificial intelligence has been trained on mostly white and male pictures.

    So that naturally leads to the question, why the heck are they training these things with mostly white and male pictures? Couldn't find any pictures of women on the internet?

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re:So they admit they are racist misogynists by rmdingler · · Score: 1

      Microsoft concluded it would lead to innocent women and minorities being disproportionately held for questioning because the artificial intelligence has been trained on mostly white and male pictures.

      So that naturally leads to the question, why the heck are they training these things with mostly white and male pictures? Couldn't find any pictures of women on the internet?

      Well, it's a California law enforcement contract, and, ahem, clearly, those damn white males are the target market in a round up the usual suspects.

      --
      Happiness in intelligent people is the rarest thing I know.

      Ernest Hemingway

    2. Re:So they admit they are racist misogynists by Anonymous Coward · · Score: 0

      They aren't. But if the algorithm authors are white males you get a potential natural bias in the algorithms and training programs themselves. It is a problem with most AI not just facial recognition, the AI inherent many of the assumptions and bias of the author. It is a difficult problem to overcome beyond having highly diverse people and cultures at every step of the way.

  8. also bugs by Anonymous Coward · · Score: 0

    Because their software couldn't recognize trump in photos where trump wasn't being spitroasted by putin and kim jong un.

  9. Bullshit, did you RTFA? by Actually,+I+do+RTFA · · Score: 2

    MS and Google pretend to care about human rights here, but then in China...

    You are 100% correct, except for MS. FTFA:

    Microsoft had also declined a deal to install facial recognition on cameras blanketing the capital city of an unnamed country that the nonprofit Freedom House had deemed not free. .

    I mean, Cuba, Iran and NK aren't even options due to sanctions, so that pretty much means China.

    --
    Your ad here. Ask me how!
    1. Re:Bullshit, did you RTFA? by Anonymous Coward · · Score: 0

      Or Thailand, or Cambodia, or Vietnam, or like half of Africa. Trust me -- China would not have asked MS for this.

    2. Re: Bullshit, did you RTFA? by Anonymous Coward · · Score: 0

      What about London, in the country with the highest density of street cams in the western world?

  10. I bet Facebook didn't say no by WCMI92 · · Score: 1

    Zuck will do anything to make a buck. Especially if it involves exploiting others.

    --
    Corporatism != Free Market
  11. You're the one pretending WindBourne by Anonymous Coward · · Score: 0

    Pretending to care about human rights. Have you ever made a single post about human rights anywhere but China?
    Nope, this is just your usual anti-China BS.

  12. Not everyone in prison has been convicted by WillAffleckUW · · Score: 1

    This is still a violation of human rights and privacy rights.

    --
    -- Tigger warning: This post may contain tiggers! --
  13. Train them on Women and people of color. by gurps_npc · · Score: 1

    Look, when you identify the source of a problem, you don't ignore it, you don't cease using the technology, you FIX IT.

    This is not a new issue. Ten years ago, this issue was so widely known, a TV show made fun of it ( Better Off Ted,Season 1, episode 4, Racial Sensitivity,).

    So if we have not sufficiently trained AI to detect people of color and women, then start TRAINING them to do it.

    Or you could just stop trying to track everyone without a warrant.

    --
    excitingthingstodo.blogspot.com
  14. This is America remember by Anonymous Coward · · Score: 0

    3a The cops retrieve the Id from the corpse and realise the error.

  15. But UBER tho... by Anonymous Coward · · Score: 0

    M$ plenty happy to provide facial recognition for constant scans of Uber drivers faces however...

  16. BAD!!! by Anonymous Coward · · Score: 0

    "it would lead to innocent women and minorities being disproportionately held for questioning"

    Is MS have any real proof/evidence for this would happen???
    Are the police blindly arrest & question anybody selected by the Facial Recognition system w/o any further verification/confirmation???
    Is the Police incapable of evaluating the effectiveness/correctness of the system???
    & if any issues found, would it be impossible to fix them for MS???

    Is MS really a US company, that cares for US law enforcement (who are trying to protect & serve common good of general public & need best tech)???

    1. Re:BAD!!! by flippy · · Score: 1

      1. According to the original article, "AI has more cases of mistaken identity with women and minorities, multiple research projects have found." So yes, they do have some evidence for it.

      2. The Officers in the field would be likely to arrest and/or detain and/or question anyone that the system flagged, yes.

      3. It is highly probable that the users (read: Police Officers) would be incapable of evaluating the effectiveness/correctness of the system. The agency involved was asking for installation in the real world, not in evaluation considerations. They'd already made up their mind that they wanted it and wanted to use it.

      4. Fixing the system after abuses caused by blindly taking actions based on the flawed output of the system is too late. Those abuses would have already happened.

      MS is, for a rare time in their history, taking the appropriate course here. They're saying, "we choose not to take this contract because we are aware the system, in its current form, has flaws, and flaws that can lead to abuse. We don't want a part of that."

  17. How to make great facial recognition technology by AHuxley · · Score: 1

    1. Get funds. A lot of money.
    2. Talk to police, mil, property owners, and governments in Africa, Asia, South America about the advanced tech they can get for "free".
    3. Install the hardware like with the Domain Awareness System in Lower Manhattan. https://en.wikipedia.org/wiki/...
    4. Work as a private, public, gov partnership in Africa, Asia, South America.
    5. Gather the global math needed to detect all the variation in the human face globally.
    6. At an airport, port, bus station, rail and on every car driver and passenger. Do passports match the face? Did the person return to their own nation after a set time?
    7. Return to the USA with the wisdom and advance math to do really great facial recognition on all sections of the US community.
    8 Support police in inner city areas with the new advanced math that now works perfectly.
    9. Reduce crime and find illegal migrants all over the USA.
    10. Gentrification slowly sets in as crime and illegal immigration is reduced.

    --
    Domestic spying is now "Benign Information Gathering"
    1. Re:How to make great facial recognition technology by Anonymous Coward · · Score: 0

      1. You're using "gentrification" wrong.
      2. The US is still having the medieval death penalty, and more than 0.6% of the American people is incarcerated which is absurd. It is safe to say, the cause of crime is the US is not that you're failing to capture criminals or that you're not punishing them hard enough. The problem is a huge portion of your population is miserable enough to have to resort to crime. BUT OH NO, SOCIALISM etc.

  18. We really need penis-recognition software. by h33t+l4x0r · · Score: 1

    I understand Bezos and Amazon are hard at work.

    1. Re:We really need penis-recognition software. by Anonymous Coward · · Score: 0

      404 not found.

    2. Re:We really need penis-recognition software. by Anonymous Coward · · Score: 0

      404 not found.

      "Look at my DICK SHAPED ROCKET you swine." -- Jeff "Dick Pic" Bezos

      Use Amazon code FREERIDE2019 to get a free ride on Jeff's dick.

  19. if this is left to the good will of companies... by Anonymous Coward · · Score: 0

    if this is left only to the good will of companies, these kind of concerns are not going to be long lived.
    The women and minorities part of this is of course a separate issue that shouldn't have been mixed in.
    If there is a bug in the way they train their algorithms, they should train their algorithms better, so that they work better for all people.

  20. This kind of hurts... by EndlessNameless · · Score: 1

    When a major corporation cares more about civil rights than law enforcement, that points to serious problems.

    I tend to assume that "bad cops" are just isolated incidents that get a lot of attention, but this may force me to reconsider my assumptions.

    --

    ---
    According to the latest ruleset, this post should be modded as Vorpal Flamebait +5.
  21. Accuracy vs Prejudice by Anonymous Coward · · Score: 0

    Just because it's less accurate for women and minorities doesn't mean that it would err on the side of misidentifying them as a criminal. It could just as easily misidentify a criminal as a law-abiding citizen. Though in this environment, you'd never hear about the latter, while the former could easily make national news. This is just Microsoft not wanting to touch the issue, but frankly, who can blame them?

  22. Re:yet, they work for China by Anonymous Coward · · Score: 0

    I'd thought you'd want them to murder Chinese. It would reduce the CO2.
    Not as much as murdering an American though.

  23. Bake the cake! by rdg55 · · Score: 1

    Bake the cake. There's no lawful reason, I am ASSURED by progressives, to refuse to bake the cake based on what the customer intends to do with it. And in this case the product is not even custom-made. The AI is the AI is the AI. The fact that the customer intends to use it as designed to be used, but which would bring to light a defect in the product, is double plus good hypocrisy. If the product is for sale, and a non-prohibited buyer (munitions, etc) is lining up to purchase it, you must sell it to them. Bake. The. Cake.