Slashdot Mirror


Microsoft's New AI Mistakenly Identifies Photos, Ignores Hitler (mashable.com)

An anonymous reader writes: Microsoft's newest online AI, CaptionBot, tries to identify what's in an uploaded photo, using two recognition APIs recently released by Microsoft Cognitive Services for app developers-- "Computer Vision" and "Emotion". But while Microsoft brags that their AI "can understand thousands of objects, as well as the relationships between them," bloggers are also sharing funny examples of CaptionBot's many mistakes. While it correctly identified Bea Arthur, Ozzy Osbourne and Joan Jett, and a movie poster with Arnold Schwarzenegger, it mistakenly identified Gene Simmons of KISS as "a woman in a red jacket...sitting on a motorcycle," described a wedding dress as "a cat wearing a tie," mistook Michelle Obama for a cellphone, and described one man's Twitter avatar as "a close up of two giraffes near a tree."

But CNNMoney reports that the AI is apparently programmed to ignore all images of Hitler and other Nazi symbolism (as well as Osama bin Laden), reporting that Microsoft's AI "often came back with 'I really can't describe the picture' and a confused emoji. It did, however, identify other Nazi leaders like Joseph Mengele and Joseph Goebbels."

22 of 214 comments (clear)

  1. I'd say by bferrell · · Score: 4, Funny

    They don't want another nazi-bot

    1. Re:I'd say by Anonymous Coward · · Score: 5, Funny

      Computers are inherently racist because they don't understand what it's like being black.

    2. Re:I'd say by KGIII · · Score: 2

      I did Nazi that coming...

      *is not proud of his behavior*

      --
      "So long and thanks for all the fish."
    3. Re:I'd say by Lumpy · · Score: 2

      But my computer is black. Black case, Black edition motherboard and black edition processor.

      I even installed http://www.blacklablinux.org/ to be sure it was completely black.

      --
      Do not look at laser with remaining good eye.
    4. Re:I'd say by ultranova · · Score: 4, Insightful

      Sorry dude, it's the law. A white guy must be racist and any guy must be misogynist.

      And yet I'm a white guy who doesn't seem to run into accusations of either racism or chauvinism. It makes me wonder if all the people who complain about being harassed by the politically correct hordes are, in fact, the innocent victims they try to present themselves as.

      Took me a while to get used to it but once you're accustomed to being a racist woman hater it's not that bad. I can't shave with a straight razor anymore 'cause I fear I might off that asshole, but that's a small price to pay to fit into the politically correct paradigm again.

      Your bravery is an inspiration to us all.

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    5. Re:I'd say by ultranova · · Score: 2

      Maybe you didn't get the memo, but according to the new wave of feminists, ALL men are chauvinistic pigs and ALL men are teh evilz who have nothing other to do than keep the females of the species down.

      And yet it seems only SOME men are actually accused of such things.

      You play video games? You watch movies? All of them chauvinistic and misogynist, so you are one of us.

      I play video games and occasionally watch movies. So there must be some other variable to account for these differences in our experiences. I wonder what it could possibly be?

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    6. Re:I'd say by ultranova · · Score: 2

      You cannot mention any "racist" facts without threatening your livelihood and worse.

      Anon, I think you nailed the issue. Having to keep your racist, sexist bullshit to yourself because people call you out if you try to spread it is what all this whining is ultimately about. My heart bleeds for your plight.

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

  2. Re:Cellphones were notably offended by JustOK · · Score: 2

    But then the FBI came along, and then all the smart phones were like, "we were totally wrong. everything is fine. we're sorry. government is good."

    --
    rewriting history since 2109
  3. PhB.B.B.B.B.B by Tablizer · · Score: 4, Insightful

    Microsoft's AI keeps embarrassing them. It's like they thought their corporate image problem from being a ham-handed OS monopoly wasn't big enough: they needed to automate gaffes.

    1. Re:PhB.B.B.B.B.B by dbIII · · Score: 3, Insightful

      Microsoft's AI keeps embarrassing them

      That's what an "A.I." made of lookup tables or pattern matching a pile of data does. I really cannot understand why they are putting this stuff forward as if it is ready to be more than just a more complicated "Eliza" toy.
      Use it to look stuff up ot have simple questions and answers - fine. Use it to have a conversation and expect perfect results - not a chance.

  4. Re:Digital unintelligence by arth1 · · Score: 3, Insightful

    Both Microsoft and Google's varieties are rather fun.

    The key to CaptionBot is to feed it lots of images, and always give 1 star when it's spot on and 5 when it's most ridiculously wrong. Over time, it "improves".

  5. AI is just not ready. by Iamthecheese · · Score: 2

    I think the most important piece of information here is that AI just isn't ready for the big time yet. People are going to do and say all kinds of fucked up and bizarre things. People will try to have sex with anything. They'll try to convince their AI assistant to support genocide. They'll demand that it pretend to agree with them about things like that. They'll ask for information that's not available, they'll cuss and scream, they'll talk about things that seem completely off-topic. People will use puns, innuendo, and vague references. They'll yell insults, start stupid arguments, and lie through their teeth even when it only hurts themselves. And yes they will talk about Hitler. An AI that can properly handle all of this and not go off the deep end is a full-fledged strong AI.

    We're not there yet but this effort by Microsoft is, IMHO, as smart as a mouse. And with geometric progress that means the real thing won't be long now.

    --
    If video games influenced behavior the Pac Man generation would be eating pills and running away from their problems.
    1. Re:AI is just not ready. by ByteSlicer · · Score: 3, Interesting

      We're not there yet but this effort by Microsoft is, IMHO, as smart as a mouse.

      Mice are pretty smart, I'd argue that the current AIs are at insect level of "intelligence".

      What's obvious from these results is that the AI has no idea what it's looking at. This is typical for a trained neural net: it finds the best matching pattern in an image, and maps that to one of its output categories. It makes no difference between a random black and white blob, and a penguin, so long as they match the pattern.

      A mouse, and true AI, will have spatial understanding. It will (intuitively) know that the images represent objects in space, and will be able to recreate a coarse 3D model of what they see. Then they will break down the scene in basic features, and identify it based on those features. It might say: hey, these blobs remind me of a penguin, but will never say that they *are* a penguin, because the blob will miss the beak and eyes and flippers and feet.

      Basically, what we have now are the neural nets we already had 50 years ago, only on much faster hardware, combined with a bot and a web search engine. It's basically ELIZA on steroids, but still a long long way from actual intelligence.

  6. 1/2 of /. readers say AI will take their job by raymorris · · Score: 4, Funny

    I'm reminded that about half of Slashdotters are afraid that AI like this will put them out of a job soon. The other half of Slashdotters can tell the difference between a cell phone and the first lady, so they won't be replaced by Microsoft software.

    On the other hand, 15% of Slashdot readers can't tell the difference between Obama and Hitler, with this AI can do so.

    1. Re:1/2 of /. readers say AI will take their job by 93+Escort+Wagon · · Score: 2

      I'm reminded that about half of Slashdotters are afraid that AI like this will put them out of a job soon. The other half of Slashdotters can tell the difference between a cell phone and the first lady, so they won't be replaced by Microsoft software.

      When it comes to replacing human workers with an AI, the opinions of the technically literate are irrelevant. All that matters is whether the maker of the AI can convince a company's leadership that employing the AI will save them money.

      If competence were really the determining factor in deciding whether to replace human workers with automated systems, do you really think most companies would've replaced their human telephone operators with the now-ubiquitous automated phone tree software?

      --
      #DeleteChrome
  7. Put up or shut up. by westlake · · Score: 4, Interesting

    Microsoft's AI keeps embarrassing them. It's like they thought their corporate image problem from being a ham-handed OS monopoly wasn't big enough: they needed to automate gaffes.

    It is trivially easy to get a instant mod-up on Slashdot by pointing to the Microsoft's AI's occasional mistakes and not its successes. But most of the time Microsoft's AI seems to be getting it right. If you have something better, put it up where we can see it.

    1. Re:Put up or shut up. by phantomfive · · Score: 4, Interesting

      IBM - Watson, a computer that can win at Jeopardy
      Google - AlphaGo, a computer that wins at Go
      Microsoft - Tay, a racist chatbot

      Is there really a comparison? Even if Microsoft has some decent technology, they're definitely losing on the marketing front, they are making themselves look like dancing monkey cousins.

      --
      "First they came for the slanderers and i said nothing."
  8. All for legal reasons by gnasher719 · · Score: 4, Insightful

    They don't have any problem identifying photos of Hitler as Hitler. The problem is false positives: If the software mistook the photo of some living person as Hitler, and that was somehow published, that person would not be happy, and might start a lawsuit.

    Problem is easily solved by telling the software "if you think it is Hitler, you say you don't recognise it". There was a case a while ago where some photo analysis software mistook a woman for a gorilla. Highly embarrassing for everyone involved.

    I would think that software makers would nowadays add precautions to make particularly embarrassing mistakes less likely. (Mistaking a gorilla for a woman is no big deal, the other way round it's very bad).

  9. Re:Let's end this right here and now by phantomfive · · Score: 2

    As an online discussion grows longer, doesn't the probability of every topic coming up approach 1? This isn't systemd or anything.

    --
    "First they came for the slanderers and i said nothing."
  10. Only Hitler? by jandersen · · Score: 2

    One wonders which caption it would put on goatse?

    1. Re:Only Hitler? by Anonymous Coward · · Score: 2, Informative

      Just tested: "I am not really confident, but I think it's a man holding a cat."

  11. Greyscale = giraffes by AAWood · · Score: 2

    As soon as I heard that someone's avatar was described as being two giraffes, I knew it was going to be in black and white. As far as I can tell, their algorithm thinks that any greyscale image includes two giraffes. A rorschach test image, an art piece with a stylised tree, a black and white MS Paint picture of a stick-man Dumbledore, everything I could find got described as two giraffes (often in a "fenced-off area").