Slashdot Mirror


Scientists Decipher the Neural Code For Faces (scientificamerican.com)

New submitter akakaak writes: In a new paper published in Cell, researchers Le Chang and Doris Tsao claim to have uncovered "The Code for Facial Identity in the Primate Brain." They develop a model representing each face as a vector in a 50-dimensional "face-space," and show that the firing rate for each face-sensitive neuron represents the location along a single axis through this space. This allows them to accurately predict the appearance of a viewed face from the collective recorded activity of the neurons. This work is a major advance in the decoding of complex neural representations, and refutes exemplar-based models of face recognition. Further reading: Scientific American

35 comments

  1. first post by Anonymous Coward · · Score: -1

    "You're telling me, that a supermodel hit on you?" said George, shaking his head in disbelief,"How do you do that?"

    "I didn't say she was a supermodel," said Jerry, he was holding a rolled up newspaper"But the option was certainly available to her."

    "You're telling me that you were hit on by a woman who is so beautiful, she can choose whether or not she wants to be a supermodel or not!" cried out George,"Great, just great - why I can't have such luck is beyond me."

    "Just listen," cried Jerry,"Is that so much to ask that you listen?"

    "Oh, I can listen pal - I'm the king of the listeners. If they held a competition for best listener I wouldn't even enter - because I'm so assured of victory, it would ruin it for everyone else."

    "You can sure talk for a listener."

    "Haha, wiseguy."

    The buzzer went of, Jerry walked over to it and held down the button,"Yeah?"

    "It's me," came Elaine's voice.

    "Come on up," he buzzed her in and opened the door.

    "So anyway," he continued,"She walks up to me on the street and says to me 'Could you do me a favor and hold this paper for just a second, I'd be really grateful."

    "Hang on," interrupted George,"How did she say 'really grateful'?"

    "It was kind of a deep throaty 'promise of things to come' 'really grateful'"

    "You're sure, she didn't have the flu?"

    "No she didn't have the flu, now listen."

    "I'm listening!"

    "So I say 'no problem' and she walks inside the building, and I'm waiting, thinking about the great sex I could possibly be having......."

    "Now see, I never do that, thinking about get's you all hyped up and you're bound to be disappointed in the end."

    "What are you talking about? Fantasy doesn't build you up."

    "It build's you up!"

    "Just shut up and listen!" Jerry cried out.

    "I'm listening!"

    "So I'm waiting like five minutes......"

    "Five minutes?"

    "Five minutes, how long would you wait?"

    "Well it depends on the person, but a woman as beautiful as that......at least till Christmas."

    "Christmas?"

    "Hey, for sex with a beautiful woman I think she at least deserves until Christmas."

    "You're pathetic."

    "Finish your story," said George,"I do have a date tonight you know."

    "You love telling people that don't you?"

    "You wanna tell the story or not?"

    "Okay then, so I'm getting impatient and I look through the glass, and I see her hugging this guy!"

    "What? she asked you to hold her paper, told you she'd be grateful and now she's hugging another guy?"

    "Exactly, she's a temptress!" exclaimed Jerry,"I think she does it for thrills, leaves guy's hanging around outside in the cold for hours on end....."

    "Five minutes."

    "Okay, five minutes - hours on end, what's the difference?"

    "I said that to my first girlfriend, believe me, it makes a difference."

    "But can you believe it? She's in there hugging another guy."

    "So what did you do?"

    "I left."

    "And the paper?"

    Jerry smiled and held up the paper in his hand, "She'll have to buy a new paper for holding me up, my time is money!"

    "What, a nickel a minute?"

    "You're a real understanding guy you know that?"

    Elaine stepped into the apartment, she slammed the door shut and stared at George and Jerry fiercely.

    "Wow, aren't you a little Xena Warrior Princess here?" joked Jerry.

    "You know, that Lucy Lawless is really attractive, I would like to go out with her," mused George.

    "Are you kidding, you couldn't get Lucy Lawless," said Jerry.

    "Why couldn't I get Lucy Lawless?"

    "She's way too tall for you."

    "You think?"

    "I know."

    Elaine shook her head and cried out,"Shut up, I have something to say here!"

    "Tell George," said Jerry with a smile,"He's a great listener."

    George smiled,"At least I don't steal papers from supermodels."

    "

    1. Re:first post by Anonymous Coward · · Score: -1

      Well me n my boyfriend had been together for 6 months. He wasn’t a virgin but I was. We had phone sex before and I knew he was gonna be my first. One day we were in school n I had on a skirt( I never wore shorts under my skirts) my first class was in an old building that had no cameras or other classes. He was texting me and asked if I had shorts under and I told him no. A few minutes later he told me to come outside so I told my teacher that I had to go to my locker. When I got out there we started walking down an empty hall n went into a doorway. We started kissing and with his strong hands he started to grab n rub on my breats. That was makeing me soooo wet. Then he slowly slid his hand down my skirt( yeah he went in from the top) n he started to finger me. Slowly at first n then harder. I couldn’t take it no more I started saying ayyye papi yes go harder faster omg omg. I was gettin to loud so he stopped. We kissed for a little longer. Then he said let’s go to my house. When the bell rang we got in his car n went to his house. At first we were in the kitchen. We kissed some more n he picked me up n put me on the counter. He took my shirt off n kissed n sucked all over me. Then we couldn’t take no more n we went to his room he threw me on the bed n took off the rest of my clothes. I roiled him over n got on top I took of his shirt n kissed his neck n chest. Then he took of his pant n boxers. He looked me in my eyes n said i love you. Then he slowly slid his big strong dick inside my tight wet pussy. All I said was ohh. He began to stroke me. At first it was slowly but I couldn’t take it. Harder papi deport more more!!!!! N he gave it to me. I could feel allof his 9 inches inside of me. My legs started shaking my eyes rolled to the back oft head. My breathin got faster n his did to he started saying my name. N we both came
       
      me and my girlfriend to my parents we were going somewhere and we left the same time but we went up town came back to the house went up to my room and we started making out and we got naked and i got a condom on and then fingered her she said i want u in me so i pushed in she moan the i started moving faster she moan louder we came together the my dogs went nuts my brother came home we got dressed quick and took off to the football game i wont ever forget that night
       
      Im sitting at school doing my exams and i cheated a girl named maddison saw me cheating at the end of the test maddison said in the hallway: greg i know u cheated and your going to be my sex slave. I had no choise i knew if she told the teacher i wud flunk so i said ok. Later that day she told me to suck her tits and call her master so i sucked then she teased me bye sucking my dick and told me not to cum but i culdent hold it in! So i came all over her and she punised me. She made me lick her pussy while she was doing her home work and told me to fuck her in her tight ass so i did and came inside her and im still her slave now at 15.

  2. "pictures of Halle Berry by turkeydance · · Score: 1

    members of The Beatles or characters from The Simpsons activated separate neurons". i bet they did.

    1. Re:"pictures of Halle Berry by __aanljs7351 · · Score: 1

      Here's a photo of my football player body. That do anything for ya?
      http://g01.a.alicdn.com/kf/HTB...

    2. Re:"pictures of Halle Berry by Anonymous Coward · · Score: 0

      Roid head.

  3. They can start with Rod Stewart by Anonymous Coward · · Score: 0

    That is one weird face.

  4. Tyvek suits? by Frosty+Piss · · Score: 1

    I'll bet this was some very smelly research!

    --
    If you want news from today, you have to come back tomorrow.
  5. This is ground breaking. by PerlPunk · · Score: 4, Interesting

    Basically, the result from the paper show that from the data recorded from the primates' neurons, it is possible to recreate with high accuracy the image the monkeys saw.

    The potential technology developed from this finding would astounding. For example, a scanner could be developed that could allow police to ask a victim to remember what the criminal looked like and produce a near photographic image of him.

    1. Re: This is ground breaking. by Anonymous Coward · · Score: 1

      Or of anyone else the "victim" wants to incriminate

    2. Re:This is ground breaking. by Anonymous Coward · · Score: 0

      Haha, the police will be astounded seeing a silverback instead of a grey or whiteback :D

    3. Re: This is ground breaking. by Anonymous Coward · · Score: 0

      That's not a problem with the technology, smartass. EVERY form of testimony is only as reliable as the witness giving it.

    4. Re:This is ground breaking. by Anonymous Coward · · Score: 0

      Suddenly all criminal descriptions are of Donald Trump!

    5. Re: This is ground breaking. by Anonymous Coward · · Score: 0

      Yep.

    6. Re:This is ground breaking. by bbelt16ag · · Score: 2

      or they could use it as another tool to steal our passwords or invade our memories.

      --
      NEVER NEVER NEVER NEVER NEVER NEVER NEVER NEVER GIVE UP! "No limitations, no boundaries, there is no reason for them."
    7. Re:This is ground breaking. by Anonymous Coward · · Score: 0

      However, it requires the police inserting electrodes into the victims brain.

    8. Re:This is ground breaking. by religionofpeas · · Score: 1

      For example, a scanner could be developed that could allow police to ask a victim to remember what the criminal looked like and produce a near photographic image of him.

      That's assuming that the neural patterns are still present in the brain, which is a big assumption

    9. Re: This is ground breaking. by Anonymous Coward · · Score: 0

      Except when I recall what someone looks like the imagine in my mind's eye is a closer resemblance to a cartoon squirrel than the actual person.

    10. Re:This is ground breaking. by Anonymous Coward · · Score: 0

      I don't know that it implies reproduction from memories.
      I think they would have to be looking at the actual face in real time to produce the correct stream.
      Correct me if I'm wrong.

      It is my understanding that the process of recalling memories uses other distinct pathways.

    11. Re:This is ground breaking. by Anonymous Coward · · Score: 0

      That's called one-way interrogation. Deconstructive interrogation is the next step after that.

  6. nobel prize material by Anonymous Coward · · Score: 0

    if confirmed, this is the stuff nobel prize winners are made of

    1. Re: nobel prize material by PoopJuggler · · Score: 3, Insightful

      And it's still the fucking Kardashians who make all the headlines.

    2. Re: nobel prize material by Captain+Splendid · · Score: 1

      If you think the Kardashians make all the headlines, that says more about you and the websites you visit than society in general.

      --
      Linux, you magnificent bastard, I read the fucking manual!
  7. Face blindness by Anonymous Coward · · Score: 3, Interesting

    I wonder what the output looks like for those of us with face blindness? Do I have an accurate representation in my head and just fail to load it, or am I not saving them properly?

    1. Re: Face blindness by Anonymous Coward · · Score: 0

      I would also like to know what they see when I look at code. Because I read code as fluently as others read faces.

    2. Re: Face blindness by Anonymous Coward · · Score: 0

      a question that could be answered eventually -or sooner if you consent to have some electrodes inserted.
      i too wonder where my facial agnosia originates - there might be multiple possible causes, but we are getting to a point where retraining might be possible in our lifetimes.

  8. Test object by nospam007 · · Score: 1

    They should test it on the orange sphincter, he can't control his face at all, that's why he looks so stupid on all the photos.

  9. Still not clear by Artem+S.+Tashkinov · · Score: 1

    OK they found like 100 neurons which encode faces. That doesn't make it clear at all how and where individual neuron states are stored in your (long term) memory. These neurons themselves obviously cannot do that.

    1. Re:Still not clear by Anonymous Coward · · Score: 0

      The point is that it takes 50 vectors. if, for sake of argument, 256 values to store, then 400 bits of storage are required. Fewer if Fred jr. is stored as 'fred but with a bigger nose). The use of 100 neurons is likely related to the type of neural network used, and how it encodes the values (256, 311, 9993, whatever are effectively required for each vector)

      You can get good results with fewer vectors in practice, but this research shows how many primates use. PCA to determine which vectors are important based on a sufficiently diverse set of training data (some initial attempts using students as subjects weresnt so diverse).

      Long term storage in the brain is another matter.

    2. Re: Still not clear by Anonymous Coward · · Score: 0

      So dsoe tihs wrok lkie wrdos? Can you just use the 50 points and rearrange everything else and it looks the same (ish) to our brain ?

  10. Error by Anonymous Coward · · Score: 0

    Join facespace to view this comment.

  11. Facefarm would love this by TheOuterLinux · · Score: 1

    "What you type is nonsense. What you read is nonsense. Yet, the most purest and honest data we can mine is biometrics." Not an actual quote, but it sounds like something Mark Z thinks in the back of his mind, all 200 neurons.

  12. perceptual representation by epine · · Score: 1

    This appears to be a highly evolved perceptual representation of a core social competence. Even if it doesn't generalize, it's the biggest science result since the second LIGO detection.

    It's already enough to further manipulate the masses, once exploited by the ad men, the plastic surgeons, and the mayfly scions of social media.

    As a reliable bijection, research can already begin correlating the genomic racial space with 50-dimensional face space, no electrodes required. I'm betting Africa and Australia get all the love.

    One caveat: how many more dimensions are required to represent male facial hair? Or is the beard recognizer a different neural subsystem altogether, half a neural highway closer to God?

  13. Good for them by Sqreater · · Score: 1

    This looks exactly like my n-dimensional "behavior-space" and the motivation vector that must be zeroed by a behavior or behaviors. This is the way to go.

    --
    E Proelio Veritas.
  14. Minority Report For Chimps by Anonymous Coward · · Score: 0

    The last thing we need is something that can read your mind and steal your thoughts.