Slashdot Mirror


Algorithms Determine Mona Lisa's True Emotions

caffeinemessiah writes "The BBC reports that researchers at UIUC and the University of Amsterdam, Holland have used "emotion recognition" software to determine Mona Lisa's true emotions. The algorithm is based on a library of neutral face images of young women and determined that Mona Lisa was 83% happy and 9% disgusted." From the article: "The program, developed with researchers at the University of Illinois, US, draws on a database of young female faces to derive an average 'neutral' expression. The software uses this average expression as the standard for comparisons. The New Scientist says that software capable of recognising emotions just by looking at photographs could lead to PCs that adjust their response depending on the user's mood. "

61 of 349 comments (clear)

  1. You know by FidelCatsro · · Score: 3, Funny

    First time I saw the painting I said "She looks bored ".
    She had likely been sitting there for hours having her painting done , likely irritated , in need of the toilet and bored .

    Perhaps since the knew study is out , we have discovered that Da Vinci painted naked and was fairly good looking . She was probably thinking "Oh dear lord , he is nude . Oh wait , fairly hot body though .. must not look interested , I don't want to appear easy , but Meooooow"

    --
    The only things certain in war are Propaganda and Death. You can never be sure which is which though
    1. Re:You know by greenguy · · Score: 2, Informative

      But he wouldn't have had much interest in her (except as a model he was commissioned to paint), as he was gay.

      As for the article... I think these folks just need a hobby.

      --
      What if I do the same thing, and I do get different results?
    2. Re:You know by Surt · · Score: 2, Informative
      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
    3. Re:You know by Rude+Turnip · · Score: 2, Insightful

      He wasn't "gay" in the sense that you think of today. The concept of a gay identity (in other words another "us vs. them"-ism) is a relatively modern construct that arose during Victorian times, especially during the trial of Oscar Wilde.

    4. Re:You know by RabidMoose · · Score: 2, Insightful

      And analyzing art isn't a hobby?

    5. Re:You know by javamann · · Score: 2, Funny

      So, he was a cross-dresser then?

    6. Re:You know by greenguy · · Score: 4, Insightful

      No, the parent is right. In those days, there were only gays acts, not gay people. By extension, the same thing went for straight people. People were just people, and their sex acts did not define them. There's definitely something to be said for that.

      --
      What if I do the same thing, and I do get different results?
    7. Re:You know by Darkman,+Walkin+Dude · · Score: 5, Informative

      Here is an expansion on that...

      What is absolutely untrue is the reference in The Da Vinci Code to Leonardo's reputation as a "flamboyant homosexual". He was not known as such. Historical evidence is sketchy about the latter, and the only thing Leonardo was "flamboyant" about was his inability to finish projects he started.

    8. Re:You know by Fishstick · · Score: 2, Interesting

      creepy how she seems to be smiling, but if you look right at her mouth, her smile fades.

      Back up to her eyes, smile.
      Down to her mouth, pissed.
      Eyes, smile.
      Mouth, pissed.

      Bet if you just stare at her boobs she would fold her arms and just glare at you.

      --

      There is much cruelty in the universe, John.
      Yeah, we seem to have the tour map.

    9. Re:You know by blair1q · · Score: 2, Funny

      The Wikipedia is not documentation for anything. It is a lossy compression system for knowledge. Very lossy.

  2. And... by Moby+Cock · · Score: 4, Funny

    83% happy and 9% disgusted

    and 8% lost, seemingly.

    1. Re:And... by Flashbck · · Score: 5, Informative

      And to modify your sig: Those who can't RTFA, complain about stupid crud

      Quote from the third paragraph in the article:
      It concluded that the subject was 83% happy, 9% disgusted, 6% fearful and 2% angry, New Scientist magazine was told.

    2. Re:And... by bit+trollent · · Score: 2, Funny

      Kinda how Dutch locals look at you when they realize you are a drug tourist. Or how you look at them. I forget.

    3. Re:And... by brjndr · · Score: 2, Informative

      Actually, their determination was that the smile is "83 percent happy, 9 percent disgusted, 6 percent fearful, 2 percent angry, less than 1 percent neutral, and not surprised at all."

    4. Re:And... by KevinIsOwn · · Score: 2, Insightful

      This doesn't change the fact that the article description is still stupid. It should have included that extra 8%.

  3. Clippy 2008 by TomSawyer · · Score: 5, Funny

    Clippy: Ok man, I was just saying... I should really just go, sorry.

    --
    If you disagree then it must be overrated, redundant or trolling.
  4. So... by ackthpt · · Score: 5, Funny

    She did have gas.

    --

    A feeling of having made the same mistake before: Deja Foobar
  5. How this probably works ... by eldavojohn · · Score: 4, Informative

    You can find corpuses of human faces taken with different emotions displayed.

    Once you've either collected them yourself or downloaded them, you need to use a process called eigenanalysis which is basically fancy talk for analyzing a large dataset with multiple classes (emotions) using matrix decomposition.

    I've actually worked on many projects involving this and the result is an eigenface (or eigenmask) that allows you to transform the space that the original image is in and classify it using any of a number of algoirthms that use euclidean distance.

    I know I left out a lot but there are many papers out there that you can find on citeseer and white papers floating around out there that provide a lot of reading material on this.

    There are also strategies which require tagging certain features as points on the face (like corners of eyes, corners of mouth, center of eye, etc) and then using the relative distances between all these points to determine what classification you would give a new face. The problem with this is that it requires a lot of hand work to prepare the training set.

    Hope this helps anyone who wants to learn more about the actual process used to accomplish this recognition.

    --
    My work here is dung.
  6. I don't buy it by gusmao · · Score: 5, Funny

    Mona Lisa is a woman, how can any software possibly tell what she is really thinking?

    1. Re:I don't buy it by operagost · · Score: 2, Funny

      As long as it's also not female; because women can't tell you how they're feeling, either. You're just supposed to KNOW.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
  7. I'm..... by Anonymous Coward · · Score: 2, Informative

    22% hungry and 88% constipated

  8. A painting isn't a photograph by Dutchmaan · · Score: 5, Interesting

    This of course assumes that DaVinci captured her exact expression... Chances are that the painting just developed that way. Anyone who does art by hand knows that it's not a photograph and that the painting more or less takes on it's own personality as it's being created.

    If it were a photo then yes I'd be more apt to accept an algorythmic interpretation of the image.. but paintings take time and it's doubtful that a person feels the exact same way over the course of days or weeks or even months it took for this painting to be completed.

    1. Re:A painting isn't a photograph by Surt · · Score: 2, Insightful

      It's not really about the subjects expression, it's about the painting's expression. People find the smile very interesting in this painting, and that is most of the reason for the painting's particularly great fame. Why is the smile so interesting to people? Perhaps it is the 9% disgust. That's what this kind of analysis can hope to tell us about our response to this painting.

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
  9. translated into "emoticon recognition" by sczimme · · Score: 5, Funny


    83% happy

    .83(:-))

    --
    I want to drag this out as long as possible. Bring me my protractor.
  10. Re:Thank you by gardyloo · · Score: 4, Insightful

    It's also possible to appreciate and enjoy this science, whether or not you believe the algorithm's results.

  11. She doesn't have emotions by Kohath · · Score: 2, Insightful

    Mona Lisa doesn't have emotions. She's made of paint.

  12. The Slashdot Method by ccnull · · Score: 4, Funny

    I find this story 83% Interesting and 9% Funny.

  13. Re:Thank you by headkase · · Score: 2, Interesting

    I know what you mean but, every human subjective feeling is quantified in a way. A measure of brain activity will if accurate enough always provide a bridge from the qualitative feeling to a readout of quantitative measure. I'm contrasting the logic of the brain with the physical mechanism. And with that said I still agree with you.

    --
    Shh.
  14. Re:Golden Ratio by ackthpt · · Score: 2, Funny
    83% happy and 9% disgusted

    To achieve fulfilment, a woman should strive for balance.

    So ... on the back of her carriage, Mona Lisa La Giaconda should have had a brass plaque which said

    I'm 50% Happy and 50% Disgusted. Don't push it
    --

    A feeling of having made the same mistake before: Deja Foobar
  15. Art needs two by quokkapox · · Score: 5, Insightful
    They're not trying to take the mystery out of it, they're trying to understand it in yet another way.

    Art needs two, one to start, and one to reply.

    It's meaningless (to society) unless somebody else looks at it, thinks about it, talks about it. The more, the better.

    --
    it's a blue bright blue Saturday hey hey
    1. Re:Art needs two by h4rm0ny · · Score: 4, Insightful


      They're not trying to take the mystery out of it, they're trying to understand it in yet another way.

      That's the truth, I think. Everyone sees Art in the way they choose. I think people often get upset when a new and scientific approach is taken to interpreting a piece of art however, because they often feel the scientist is implying their interpretation is somehow more valid than anothers. And to be fair, there is some truth to that.

      But the painting remains the painting, before and after.

      --

      Aide-toi, le Ciel t'aidera - Jeanne D'Arc.
  16. Clippy of doom! by Anonymous Coward · · Score: 2, Funny

    could lead to PCs that adjust their response depending on the user's mood

    Lovely, now clippy can pop up with "You look like you're frustrated as hell with Microsoft Office. Would you like to buy some Microsoft stock?"

    Death to clippy!

  17. Finally! by anocelot · · Score: 2, Informative

    Interesting to see this idea actually working now. I think I first saw this five years ago on IBM's Alphaworks site. Ah yes, here it is.

    http://www.research.ibm.com/journal/sj/393/part2/p icard.html

    --
    This tagline brought to you by 1500 monkeys in just under 17 years.
  18. Warning Signs by Mignon · · Score: 4, Funny
    software capable of recognising emotions just by looking at photographs could lead to PCs that adjust their response depending on the user's mood.

    If your computer says "I know I've made some very poor decisions recently, but I can give you my complete assurance that my work will be back to normal. I've still got the greatest enthusiasm and confidence in the mission. And I want to help you," then you should pull the plug immediately.

  19. 200% by racerxroot · · Score: 2, Funny

    I want to try and trick it and simultaneously make all the expressions that i can. I could be 17% happy, 40% confused, and 85% constipated.

    --
    --- Caffeine is directly responsible for some of my greatest ideas, and some of my most embarrassing moments...
  20. Nice trick these researchers have discovered by Darius+Jedburgh · · Score: 5, Insightful
    1. Invent algorithm
    2. Apply it in a domain where your work can't be falsified
    3. ???
    4. Profit!
  21. Re:Thank you by slashdotnickname · · Score: 2, Insightful

    Thank you science, for trying to take the mystery out of art.

    That's assuming the study is logically sound. I didn't see them take into account how the Renessaince culture (with its repressive religious cooncerns and high-society rearings) might affect how emotions were facially expressed.

  22. Longshot question by ZachPruckowski · · Score: 2, Interesting

    Is there a chance the facial images have changed over the 1000-1500 years or whatever? I mean, obviously they wouldn't change much, but maybe a little?

    More importantly, are we sure da Vinci had regular access to girl's faces? I mean, it was probably mostly guesswork on his part.

  23. Re:Waste of time... by Red+Flayer · · Score: 3, Funny

    "I *could have* played with my pecker all morning and come up with something more useful than this." (emphasis mine)

    Eww. I always just discard that stuff, what do you do with it that makes it so useful?

    --
    "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
  24. A programming problem by Myrmidon · · Score: 5, Funny

    Okay, here are my questions for the Slashdot community:

    1) You're writing some code. You call the User Emotional Analysis API, and it reports back that your user is currently "83% happy and 9% disgusted". How should your software "adjust its response" in reaction to this information?

    2) What happy/disgusted ratio leads to maximum productivity?

    3) What are the odds that the Mona Lisa is a portrait of a Perl programmer?

  25. So what does that mean? by theotherbastard · · Score: 2, Insightful

    83% happy and 9% disgusted? And just what does that mean? All of life's greatest mysteries can be solved in a quantitative manner? I for one don't want my computer to act differently if I'm happy, sad, pissed off, stoned, whatever. Just what I've always wanted, a computer with a Genuine People Personality (TM).

    --
    Buttons aren't toys.
  26. So what by Mark+of+THE+CITY · · Score: 4, Interesting

    everything can be quantified

    As Einstein said, "Not everything that counts can be counted, and not everything that can be counted, counts."

    --
    The clearance system sounds logical. It is not. It is completely arbitrary. -- John Bolton
  27. And the ??? stands for: by ziggamon2.0 · · Score: 5, Funny

    (this is actually the first time I play this game, let me know how I'm doing!)

    3a. Patent algorithm.
    3b. Sue everybody that looks 83% happy or 9% disgusted

  28. A note about the Mona Lisa by skintigh2 · · Score: 3, Interesting

    This painting was not made in one sitting. Or two. Or ten.

    It was never even finished.

    The subject, ASSUMING THERE WAS ONE, sat for one or several sessions and then Leonardo continued to work on the painting off and on for the rest of his life.

    There is speculation as to who the subject was, but perhaps there was none, and some think it's actually a self portrait in drag (perhaps the cause of the mostly amused but 9% disgusted?)

  29. The da Vinci Commode by NZheretic · · Score: 2, Funny

    Could her smile be the result of one of da Vinci's inventions, ie the vibrating commode that the lady in question was sitting upon?

  30. oh crap... by ziggamon2.0 · · Score: 3, Funny

    ... so now machines are both better than men in bed, and better at knowing how the women feel?

    Guys, we're becoming extinct here...

    1. Re:oh crap... by the.Ceph · · Score: 3, Funny

      I think if machines were better then men in bed we would have been extinct a long time ago. Luckily due to the massive conspiracy throughout academia to stop women from becoming engineers the risk of the prophecies coming true is minimal.

  31. YES! by evil-osm · · Score: 5, Funny

    Hope this helps anyone who wants to learn more about the actual process used to accomplish this recognition.

    You can bet your purple pants it does!! I can finally put an end this this scenario:

    Wife: "no, there's nothing wrong, I'm not mad at you"
    muhahahaha.... thats when I take the polariod and get a snapshot
    Me: "Yeah right, we'll just see about that!"

    Two weeks later the divorce goes through and my ass is on the curb.

    --


    E.

    Never rub another man's rhubarb - The Joker
  32. 90% Lisa, 10% Mona by jbum · · Score: 4, Interesting

    On a related note, back in February, I searched Flickr for photos matching the tags Lisa or Mona.
    The results indicate that 9/10ths of the women in these photos are named Lisa. I built
    a photo mosaic from the results, which can be seen here:

    http://www.flickr.com/photos/krazydad/4921613/in/s et-95771/

  33. Thank god, I am not the only pervert here by SmallFurryCreature · · Score: 4, Funny
    I thought almost the same thing. Except knowing something about italy she probably said "miaaaoooo".

    She has that expression of a woman looking at a naked man and being faintly aroused but also faintly amused at that "last chicken in the poultry shop" display. If your in a long relationship were your girl still fancies you but feels secure enough she doesn't have to constantly worship as a god to keep your ego up you will learn to regonize that look. Oh well it is better then when they break down in laughter while you are trying to pose seductivly. I guess men just aren't designed to look good naked with their socks on.

    --

    MMO Quests are like orgasms:

    You may solo them, I prefer them in a group.

  34. Algorithms Determin This Article's True Value by SeattleGameboy · · Score: 3, Funny

    My algorithms say this article is 98% BS and 2% Who Cares...

  35. Mona Lisa is actually a self-portrait by jjh37997 · · Score: 2, Interesting

    Of course, a number of people suspect that the true model for Mona Lisa was Da Vinci himself. I wonder if the researchers accounted for this?

  36. 83% happy and 9% disgusted by Orlando · · Score: 2, Funny

    And by a strange co-incidence most slashdot readers' interactions with women produce exactly opposite results.

    --
    -= This is a self-referential sig =-
  37. My new mood-adjusting PC... by ksc · · Score: 4, Funny

    Launching Firefox...
    You're bored...
    You're horny...
    You're horny...
    You're disgusted!
    You're horny...
    You need a cigarette...
    You're bored...

  38. Re:Thank you by bogado · · Score: 2, Insightful

    Yes I was searching a commentary on culture to reply, since I have saw a few articles on how the americans and english smile differently. Culture afects many, many things including, apparently, how we express emotions. Sure there is a large "basic emotions" overlap that comes from instinct, we can even recognize them in other mammals, but to get a proper "reading" to a level of 83% happy, 9% disgusted, 6% fearful and 2% angry, that is cited in the article you must take into account culture, I believe.

    Another way of testing this would use the program to test several different cultures people. If it holds aggainst the test, then I will be more inclined to believe that the mona lisa was 21% bored or whatever.

    --
    []'s Victor Bogado da Silva Lins

    ^[:wq

  39. Just goes to show, computers are smarter then men by SmallFurryCreature · · Score: 2

    They should make this software available on a camera phone. Next time your girlfriend claims you don't understand here snap her picture and voila, you instantly will be a sensitive man. Anything to keep the dumb cunt happy eh? What?

    --

    MMO Quests are like orgasms:

    You may solo them, I prefer them in a group.

  40. Pfft! by Quiet_Desperation · · Score: 2, Funny
    I wrote a prorgam that did this on my old Atari 800 back in the computer Steam Age.

    I got:
    44% "Happy"
    12% "Baffled"
    21% "Knowing lesbian smirk"
    19% "Get your hand off my knee, Leo"
    55% "Planning to start new religion"
    8% "file not found"

    I also analyzed the brush strokes and built a picture of DaVinci:
    54% "Depressed"
    61% "Inventive"
    10% "Horny"
    30% "That's not my hand, Mona"
    71% "Must encode holy grail into here somehwere"
    11% "She'd make a good tank"

  41. Camera Obscura, etc by jd · · Score: 4, Interesting
    It was not unusual, at that time, for artists to use a range of techniques for capturing the key points of the person they were painting, to avoid having a person sit for ages whilst being painted. This means that although the painting would not be a "true" photograph, it could have been extremely close to one.


    On a related note, this might also explain the resemblance to Leonardo. Let us say that he did, indeed, have a woman sit for just long enough to sketch in the key facial lines. He would then have needed to add in the skin texture and other features that couldn't have been captured by whatever method he used. It would be logical for him to have used his own face to capture such information. The Mona Lisa would then have been a composite of the original model and himself, which means that it would indeed have a resemblance to him.


    X-Ray analysis of the original painting reveals sketches and paintings below the Mona Lisa - though there was no sign of anyone having written "This is a fake" in felt-tip pen, much to the chagrin of Doctor Who fans. It would be interesting to know how the different levels relate to each other - were the earlier pictures earlier versions of the same painting? If they are analyzed with the same software, does it produce the same result?

    --
    It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  42. Re:Facial expressions are nature, not nurture by natpoor · · Score: 2, Informative
    This is indeed true for some expressions. I just finished teaching a class in nonverbal communication, and for part of it we looked at facial expressions. Researchers have identified 6-8 facial expressions that are the same around the world (currently), and so these are believed to be nature/hardwired into our brains. Ekman and Freisen did a lot of work on this. Here is a Google search that has some material. However it is not always true, smiling in different cultures can mean slightly different things. As for across history, well, the ancient Greeks used those smile/frown masks for drama, so I would assume the hard wired ones have been around a long time (since evolution takes place very, very slowly).

    Maybe someone else pointed this out but the computer isn't really determining her mood, the people who judged all the other faces and constructed the algorithm did it, the computer just did the calculations. But Slashdotters knew that.

  43. Mona Lisa a Woman? by lildogie · · Score: 2, Funny

    90% happy, 10% disgusted sounds like a drag queen to me.

  44. I HAVE NO IDEA WHAT IM TALKING ABOUT by JVert · · Score: 2, Funny

    his inability to finish projects he started

    Like that helicopter, for instance.