Slashdot Mirror


System Recognizes Emotions In People's Voices

cylonlover writes "Automated telephone services may get slightly less annoying thanks to research being carried out at Spain's Universidad Carlos III de Madrid and Universidad de Granada. A team of scientists from those institutions has created a computer system that is able to recognize the emotional state of a person speaking to it, so that it can alter its behavior to make things less stressful."

47 of 127 comments (clear)

  1. Trolling by Anonymous Coward · · Score: 4, Informative

    That could become the ultimate trolling device!

    1. Re:Trolling by ae1294 · · Score: 4, Funny

      Do you understand the motherfucking words that are coming out of my motherfucking mouth bitch?

      emotional state: JOY +3

  2. Or you could lower the stress from the start by Anonymous Coward · · Score: 3, Insightful

    Why not start out with the less stressful option, just saying...

    1. Re:Or you could lower the stress from the start by leaen · · Score: 2

      We should write speech recognition software to deal with those IVR

  3. Or not... by NoobixCube · · Score: 5, Funny

    Caller: Oh it's another damn machine.
    IVR: Do not take that tone, please, sir or madam.
    Caller: WHAT tone?
    IVR: Please remain calm, and speak clearly.
    Caller: I AM CALM, DAMN IT!!!

    --
    Admit it. You post strawman arguments as AC so you get modded Insightful for refuting them, rather than Troll
    1. Re:Or not... by plover · · Score: 4, Funny

      My favorite:

      "For a list of all the ways technology has failed to improve your life, please press 3."

      --
      John
  4. even easier by erase · · Score: 5, Insightful

    just have the system scan for curse words. easier than detecting emotion, and probably more accurate to determine when people are hating the IVR.

    1. Re:even easier by mooingyak · · Score: 2

      For some people. On the other hand, my brother-in-law uses the word 'fucking' the same way most people use the word 'um'.

      --
      William of Ockham had no beard. The most likely explanation is that it was chewed off by squirrels every morning.
    2. Re:even easier by dissy · · Score: 4, Interesting

      just have the system scan for curse words. easier than detecting emotion, and probably more accurate to determine when people are hating the IVR.

      You would be shocked at the number of IVR systems that currently do this.
      "Fuck" is the new "mash zero"

      At least the ones I am forced to use on a regular basis most seem to support swear words as valid options. Or at least "fuck" and "shit", haven't tried any others.
      On the non-regular calls I only try this trick when my intent is to trigger "Press zero to speak with a representative", seems to be roughly 50% success rate in my semi-limited experiences.

      The only system I can think of that did not support it was my last bank. However their system couldn't be interrupted with menu presses, so you had to wait until it was finished speaking or it would ignore touch tones. Also hitting zero did not take you to a human, but back to the main menu to start over.
      I'm pretty sure they purposely designed it to make you scream "fuck!" a lot and that was listed in the design requirements specified by the customer :P

      In closing, hey Huntington if you're listening, you suck balls.
      For everyone else, give it a try next you need to press zero anyway. If nothing else, it's pretty amusing.

  5. Dave... by headkase · · Score: 3, Funny

    Source: HAL: Look Dave, I can see you're really upset about this. I honestly think you ought to sit down calmly, take a stress pill, and think things over.

    --
    Shh.
    1. Re:Dave... by ysth · · Score: 4, Funny

      I know I've made some very poor decisions recently, but I can give you my complete assurance that my work will be back to normal. I've still got the greatest enthusiasm and confidence in the mission. And I want to help you.

  6. Another fine product... by Macgrrl · · Score: 4, Funny

    ... from the Sirius Cybernetics Corporation.

    --
    Sara
    Designer, Gamer, Macgrrl in an XP World
  7. My superior algorithm: by Zero__Kelvin · · Score: 4, Insightful

    If (person_calling)
    connect_to(actual_human);

    --
    Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
    1. Re:My superior algorithm: by markdavis · · Score: 3, Insightful

      Not on many of the systems I encounter. It is so typical to have a poorly designed menu that does NOT offer choices that match why I am calling. When no choice is valid and I resort to "0":

      "Sorry, that is not a valid option"

      And then it repeats the 30 seconds worth of choices yet again. I have also had systems hang up on me after not answering the way they want.

      And of course the wonderful systems that ask for all kinds of information and then you FINALLY get a human and they ask for all the same damn information AGAIN.

    2. Re:My superior algorithm: by sconeu · · Score: 2

      And of course the wonderful systems that ask for all kinds of information and then you FINALLY get a human and they ask for all the same damn information AGAIN.

      Yeah, I've tried saying that I just entered the info, and they say, "sorry".

      There's a special place in Hell reserved for the guy who invented IVR menus.

      --
      General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
    3. Re:My superior algorithm: by tisepti · · Score: 5, Informative

      Try gethuman.com. It doesn't always have the company you need to call listed but has helped me deal with companies that ... forget to make sure yo have an easy way to get though the menu.

    4. Re:My superior algorithm: by mcavic · · Score: 2

      My favorite was the IVR at a certain cable ISP:

      IVR: "First, let's see if we can diagnose your Internet connection".
      Me: "Representative".
      IVR: "Okay, I can definitely get someone on the line for you, but first..."
      Me: "Representative".
      IVR: (in a slightly defeated tone) "Alright, please hold while I get someone on the line for you".

    5. Re:My superior algorithm: by Anonymous Coward · · Score: 3, Informative

      Sounds like Charter. I made the mistake of following their troubleshooting robot because I figured that the tech would be aware that I had done the necessary. When I got on the phone with a live human, they proceeded to run me through the exact same script as the robot so it was a complete waste of 20 minutes.

    6. Re:My superior algorithm: by Paul+Slocum · · Score: 4, Insightful

      I think it's more like:

      if( person_calling_wants_to_pay_more )
      connect_to( actual_human );
      else
      connect_to( cheap_automated_call_system )

    7. Re:My superior algorithm: by TapeCutter · · Score: 2

      Just press the button that's for buying something and a real person will appear almost instantaneously.

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  8. best way to reduce stress by Ralph+Spoilsport · · Score: 4, Insightful

    have a competent human answer the fucking phone.

    --
    Shoes for Industry. Shoes for the Dead.
    1. Re:best way to reduce stress by _merlin · · Score: 2

      Trouble is, competence is not as common as you might like, and a competent person would probably get bored being a phone monkey, and move on to bigger, better things. The pay and work of answering support calls means less competent people will accumulate there.

    2. Re:best way to reduce stress by Ralph+Spoilsport · · Score: 2

      they merely need to be competent enough. behind them are other competent people looking for a job. They move on, they get replaced. by other competent people. And they don't have to be geniuses - they only have to be competent enough to answer your questions.

      --
      Shoes for Industry. Shoes for the Dead.
  9. Old news by jtownatpunk.net · · Score: 4, Interesting

    Is this one of those "On this day in history..." stories? Because analyzing caller voice patterns for stress has been SOP for the big boys for years. A pretty common way to get out of the voice prompts and to a person who will likely be competent enough to help you is to swear profusely at the voice recognition system. You'll then often be passed to a senior CSR who can get shit done. The catch is that they're authorized to hang up on you more quickly than a regular rep if you continue to swear once they're on the line.

    I guess the news here is that the existing technology is being used to present automated scripts tailored to the individual caller.

    1. Re:Old news by blunttrauma · · Score: 5, Funny

      I was trying to call Comcast once because the evidently cancelled my automatic billing and were now going to disconnect my internet service. When I called and the automated menu hell prompts started, I said "billing" The system replied "Sorry, I didn't get that" I let out an exasperated "Fuck". The system responded "I understand you want to talk to Billing, if this is correct, press 1" Pretty damn cool.

    2. Re:Old news by JohnSearle · · Score: 2

      I'm awaiting the day that they turn these devices towards the reps themselves.

      Big brother could be monitoring every call and alerting supervisors real-time when the reps step out of line. Could make the job that much better.

      Man, I really miss working for Satan- *cough* I mean Sprint

    3. Re:Old news by anglico · · Score: 4, Interesting

      I agree, the first time I used Fed Ex's menu for a sample return I got frustrated and 'growled' in frustration and it automatically connected me to someone who could understand why I didn't have an account number and what I needed. Of course the next few times I called I waited (just in case they added that option) and when I didn't get that option, I did the same thing, and luckily it worked.

  10. Easier solution by Anonymous Coward · · Score: 4, Insightful

    How about just using the low-stress behavior ALL the time?

    1. Re:Easier solution by migla · · Score: 3, Insightful

      There was some similar story a while back about how technology like this could be used at 911, to assert whether the person calling was in an emergency.

      I would hate that, since I've noticed that while I'm a bit of a nervous person generally, when I've been in serious situations, like cutting myself badly and blood starting to gush out or being held at knife point, an unusual calm has descended upon me.

      --
      Some of my favourite people are from th US; Vonnegut, Chomsky, Bill Hicks.
  11. Adjusts its behaviour to be less stressful by Sgs-Cruz · · Score: 2

    Why not, I don't know, just run the "don't stress out the human" program from the beginning? Why wait until they're already pissed off?

    --

    Karma: pi (Mostly due to circular reasoning in posts).

    1. Re:Adjusts its behaviour to be less stressful by ysth · · Score: 3, Insightful

      Because "don't stress out the human" might be actually really unhelpful stuff like slowing down speech, presenting fewer options at a time, or even fewer options at all.

  12. Don't they already have this? by Anonymous Coward · · Score: 2, Interesting

    Every time i call Charter Communications to talk about bogus charges that have been added to my bill, it's like they know automatically how pissed off i am.
    The past couple times i hardly have to say anything other than "fuck" and they immediately transfer me over.

    "Press 0 if it's relating to a new plan. Press 1 if it's..."

    Fuck!

    "We'll transfer you over to a representative."

  13. This took research? by jmaddington · · Score: 2

    Talking to the disembodied voice: Not happy. Talking to a person who can help me: Happy.

  14. Might come in handy... by Fished · · Score: 3, Funny

    Computer: "Sears tool desk, can I HELP you?"
    Me: "Operator."
    Computer: "I'm sorry, I didn't understand that. Did you say, screwdrivers?"
    Me: "Salesman"
    Computer: "I'm sorry, I didn't understand that. Did you say, salepaper?"
    Me: "Cashier."
    Computer: "I'm sorry, I didn't understand that. Did you say, chainsaw?"
    Me: "NOW I want a chainsaw! I'm coming down there and #!*(%$!*%^(!"
    Computer: "I understood that! Calling 911."

    --
    "He who would learn astronomy, and other recondite arts, let him go elsewhere. " -- John Calvin, commenting on Genesis 1
  15. Re:Don't force us to use the phone in the first pl by kelemvor4 · · Score: 5, Insightful

    Given the widespread availability of the Internet, the telephone is really quite a useless device now, especially for business purposes.

    When dealing with any business or institution, it is often much easier and much more effective to use a web app of some sort. These kind of apps work perfectly fine for most people, and they avoid a lot of the confusion and annoyance that can happen when having to use a telephone-based system. In the remote chance that the user needs to deal with a live person in realtime, there are many chat systems available that work just fine.

    Spoken communication is a relic of the past. It is usually no faster than using a web app or other written communication, and most of the time is much slower and much more prone to inaccuracies creeping in. In the vast majority of cases, the phone shouldn't even be an option. If it is, it should merely be the last resort.

    If that were accurate, those giant call centers that companies employ in addition to their websites would go largely unused. Turns out, lots of folks prefer to talk to someone. Just because you don't does not mean that it's a "relic of the past". While I like to do business on the web, I will most definitely avoid shopping with a company if I can't find telephone contact information easily. Web stuff works great when things are going smoothly, but typically the moment you have a hiccup in the standard process, you need to get someone on the phone to fix it. IVRU's are just a way to waste your time while waiting to be helped, so I see this effort as a mostly empty gesture. As GP said, why not start out with the less stressful option in the first place.

  16. Alter its behavior? by mrquagmire · · Score: 4, Insightful

    Unless someone can make voice recognition actually works no amount of behavior altering is going to help. Maybe it's just me, but it doesn't seem like voice recognition software has come a whole lot farther than where it was when I first started playing with it over a decade ago.

    --
    giggity
    1. Re:Alter its behavior? by hawk · · Score: 2

      Well, then.

      *You* obviously didn't buy a 4s.

      I'm just plain stunned by how it consistently get almost everything correct (even if Siri can't parse it)

      hawk

    2. Re:Alter its behavior? by mrquagmire · · Score: 2

      No I didn't. But I do have to listen to a guy who sits by me at work talk to his 4S over and over while getting increasingly frustrated. And no, he doesn't have an accent.

      --
      giggity
  17. Re:Don't force us to use the phone in the first pl by mug+funky · · Score: 3, Insightful

    yes, because all official websites are well designed, and provide many options outside the normal list that can tailor to the needs of every single user.

    sometimes a second brain is needed in a transaction.

  18. Mandatory recognition by hawk · · Score: 2

    Simply by recognizing a few words, this can be improved.

    In particular "damnit" should be recognized.

    "I said" is another tipoff.

    but damnit is the biggie . . .
    hawk

  19. Re:Don't force us to use the phone in the first pl by Anonymous Coward · · Score: 5, Insightful

    I intentionally do business with companies that don't employ long, painful, circular IVR. I simply won't do business with a site that doesn't have a phone number.

    As you said, the web is great if you're trying to buy something. Beyond that, web interaction is mostly garbage. Many companies don't provide direct email support anymore. If they do, it usually takes 3 days to hear back because email is a nice... leisurely... game... of... ping... pong... that... they... answer... when... it's... convenient... for... them.

    Those horrible IVR's are used to deflect you back to the web. Not because their web resources are better than their people, but because humans on the phone are an expensive and time consuming resource they don't want you to use.

    So it really is a place to separate yourself from the rest. If I call your number and actually get a person that can fix problems, you're head and shoulders above your competition.

  20. Old news by t00le · · Score: 3, Interesting

    Real time speech analytics for call centers has existed for seven years. The better products came out of Israel, at least the first and second generation IP Telephony capable systems. Inflection based triggers have existed in traditional TDM systems for over twelve years, so not real sure why this specific article is so intriguing. Just about any high end inbound call center will use some form of inflection and emotion algorithmic processing, more so once you get into the arm pit of finance, collections.

    The systems I manage process over 500 million calls per month, across multiple industries and pbx vendors. The majority of the volume is processed using Cisco and Interactive Intelligence products, with an assortment of one off custom solutions. Of that 500 million calls per month, over 30% of the calls have used some form of inflection and emotional detection within the last eight years.

    *yawn* another slow news day?

    --
    When the only tool you have is a hammer, every problem looks like a nail
  21. Electronic Sociopath by Jeremiah+Cornelius · · Score: 3, Funny

    Mimicking the response of understanding, to manipulate other's behavior.

    You are in a twisty little maze of voice options, all alike.

    --
    "Flyin' in just a sweet place,
    Never been known to fail..."
  22. Someday by NicknamesAreStupid · · Score: 2

    They will be better than humans. They will know more, speak many languages, understand a huge range of contextual references, always be current, never act in a way that makes them seem rude, and even be charming. Most real humans will greatly prefer talking to them than to other humans. I'm not sure when, but some of us will live long enough to see it.

  23. Re:I see you are feeling stressed... by MrKaos · · Score: 2

    Your call is important to us!

    Please wait while we ignore it!...

    --
    My ism, it's full of beliefs.
  24. Re:Don't force us to use the phone in the first pl by somersault · · Score: 2

    Morse code rubbing on another person's body will always be superior simply because there is no unfeeling air between you and your communication of your problem. I pity you, who would rather talk to people than risk sexual harassment lawsuits in the pursuit of more personal communication.

    --
    which is totally what she said
  25. Re:It took longer than 2 years, apparently by RivenAleem · · Score: 2

    Tourettes, finally useful!