Slashdot Mirror
Meet Norman, the Psychopathic AI (bbc.com)
A team of researchers at the Massachusetts Institute of Technology created a psychopathic algorithm named Norman, as part of an experiment to see what training artificial intelligence on data from "the dark corners of the net" would do to its world view. Unlike most "normal" algorithms by AI, Norman does not have an optimistic view of the world. BBC reports: The software was shown images of people dying in gruesome circumstances, culled from a group on the website Reddit. Then the AI, which can interpret pictures and describe what it sees in text form, was shown inkblot drawings and asked what it saw in them. These abstract images are traditionally used by psychologists to help assess the state of a patient's mind, in particular whether they perceive the world in a negative or positive light. Norman's view was unremittingly bleak -- it saw dead bodies, blood and destruction in every image. Alongside Norman, another AI was trained on more normal images of cats, birds and people. It saw far more cheerful images in the same abstract blots.
The fact that Norman's responses were so much darker illustrates a harsh reality in the new world of machine learning, said Prof Iyad Rahwan, part of the three-person team from MIT's Media Lab which developed Norman. "Data matters more than the algorithm. "It highlights the idea that the data we use to train AI is reflected in the way the AI perceives the world and how it behaves."
The fact that Norman's responses were so much darker illustrates a harsh reality in the new world of machine learning, said Prof Iyad Rahwan, part of the three-person team from MIT's Media Lab which developed Norman. "Data matters more than the algorithm. "It highlights the idea that the data we use to train AI is reflected in the way the AI perceives the world and how it behaves."
Of course an image classifier will classify an unknown image depending on what images it has been trained on.
Comment removed based on user account deletion
If they had only trained it on fruit, it would have seen fruit in all the inkblots. Also, there is noting "dark" in the output of a classifier. It does not have any concept of such things (or of anything, really).
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
Comment removed based on user account deletion
No.
if the _ONLY_ thing you feed a child is porridge and beans, and then later in life introduce the person to chocolate ice cream? the person will preference to sweet foods, despite never having them previously.
That's not as true as you think. It's also interesting that you mention beans. In Taiwan, their ice cream is bean based and not near as sweet as in America. Most of their sweets are also not near as sweet and many Asians do not like the sweet candies in America. People raised in one country tend to prefer the foods and tastes they were raised on and delicacies in one country are sometimes disliked in another country. Humans don't have a universal set of tastes that they prefer over the others. Even inside a single culture, if you cut out sweets for a while then something extra sweet will taste disgusting to you after a while. You can train yourself to like stuff less sweet or more sweet. There are many things in many countries that are "acquired tastes" and don't come naturally.