Slashdot Mirror


Google Assistant Will Call Businesses For You Via 'Duplex' (qz.com)

At its I/O developer conference today, Google debuted "Duplex," an AI system for accomplishing real world tasks over the phone. "To show off its capabilities, CEO Sundar Pichai played two recordings of Google Assistant running Duplex, scheduling a hair appointment and a dinner reservation," reports Quartz. "In each, the person picking up the phone didn't seem to realize they were talking to a computer. The conversations proceed back-and-forth to find the right time, and confirm what the customer wanted. Even when conversations didn't go as expected, the assistant understood the context, responded appropriately, and carried on the task. (You can listen to the recordings here.)" From the report: It's a far more natural conversation than consumers may be used to with digital assistants. The AI's voice lacks a stilted cadence and comes complete with "ums" and natural pauses (which also helps cover up the fact that it is still processing). It uses the phone's on-board processing, as well as the cloud, to deliver the right response with just the right amount of pause.

Google is taking advantage of its primary asset: data. It trained Duplex on a massive body of "anonymized phone conversations," according to a release. Every scheduling task will have its own problems to solve when arranging a specific type of appointment, but all will be underpinned by Google's massive volume of data from searches and recordings that will help the AI hold a conversation. Still, the technology cannot carry on just any conversation. Even though Duplex can seemingly handle far more context than other systems, it only works within a narrow set of queries (Google hasn't listed all of them yet). And despite releasing six new more natural sounding voices for the Assistant product available today, none approached the humanity of its Duplex example.

61 of 103 comments (clear)

  1. So many things wrong with this, where do I start? by Rick+Schumann · · Score: 4, Insightful

    1. More ways that Google (and 'partner companies', I'm sure) can track more aspects of your life.
    1a. More opportunities for hackers to pry your personal data from you.
    1b. More opportunities for criminal hackers to commit fraud (fraudulent purchases via hacked 'digital assistant', etc).
    2. More depersonalization of your interactions with other people.
    3. More excuses to avoid interactions with other human beings.
    4. Less opportunities for people to develop their interpersonal skills/be properly socialized.

  2. Telemarketers, Tele-SPAM and Robo-Calls, Oh My.. by Mike+Greaves · · Score: 2

    Holy abuse potential, Batman!!

    I guess we'll just have to forget about the telephone as an on-balance helpful form of communication..

    --
    -- Mike Greaves
  3. And eventually... by Dzimas · · Score: 4, Insightful

    Businesses will use their own digital assistants to answer calls, so we'll end up living in a bizarre alternate universe where computers phone each other and have conversations to schedule our lives. Abbreviated botspeak will eventually supplant standard English, as humans mimic the mannerisms and verbal shortcuts used by impatient digital assistant apps.

    1. Re:And eventually... by bickerdyke · · Score: 1

      Yes. Why shouldn't what works for scheduling a meeting with colleagues in Outlook not work for scheduling an appointment with a plumber?

      --
      bickerdyke
    2. Re:And eventually... by excelsior_gr · · Score: 1

      Sounds good to me...

    3. Re:And eventually... by swillden · · Score: 2

      Businesses will use their own digital assistants to answer calls, so we'll end up living in a bizarre alternate universe where computers phone each other and have conversations to schedule our lives. Abbreviated botspeak will eventually supplant standard English, as humans mimic the mannerisms and verbal shortcuts used by impatient digital assistant apps.

      I doubt that.

      It's more likely that businesses will just publish a scheduling API, and your digital assistant will recognize that the API is available and use that instead, completing the process in tens of milliseconds. That will be cheaper for everyone, and more convenient for you, since you'll say "Okay Google (or whatever), make me a haircut appointment Wednesday morning at my usual salon" and the assistant will be able to respond instantly "Okay, I've made an appointment for you at 10. Jenny will cut your hair. Would you like me to book you a car on <your preferred self-driving car service>?". Actually, that last part will probably be unnecessary, since you'll just have standing instructions that your assistant should always arrange your transportation on your preferred service, or whichever is cheaper at the moment, etc.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    4. Re:And eventually... by cascadingstylesheet · · Score: 1

      Businesses will use their own digital assistants to answer calls, so we'll end up living in a bizarre alternate universe where computers phone each other and have conversations to schedule our lives. Abbreviated botspeak will eventually supplant standard English, as humans mimic the mannerisms and verbal shortcuts used by impatient digital assistant apps.

      Fine with me. My bot assistant can call and badger the monopoly internet provider trying to get a lower rate from their bot.

      I still won't get a lower rate, but it will be better for my blood pressure ...

    5. Re:And eventually... by h4ck7h3p14n37 · · Score: 1

      This seems like another solution in search of a problem.

      When I get done at the hair salon I schedule my next appointment after paying for the current appointment.

      If I want to schedule service at the car dealership I use their web portal.

      Meetings with people I know? Send a Google Calendar invite.

    6. Re:And eventually... by bickerdyke · · Score: 1

      Sending an event invite does NOT help to find a time that's convinient to both of you. It's rather one party taking away the other partys control over their own time by setting a meeting and not caring about it's convinient. Yes, there are tools that are designed to help you with that and even integrate nicely into Google calendar (doodle.com, vyte.in) but again, the other party has to support them.

      And yes, scheduling an apointment through a website - that's exactly what Google assistant already does - like booking a table through open table.

      But if you have a look at the complete presentation of Duplex, they announced that they saw the need for that as 60% of buisnesses don't have any digital event scheduling interface yet but they don't want to unfairly prefer big businesses that can afford paying for an electronic booking service that integrates with assistant, so smaller businesses can take bookings from voice assistants, too.

      --
      bickerdyke
  4. humanity is directly related to compute resources by RhettLivingston · · Score: 2

    And despite releasing six new more natural sounding voices for the Assistant product available today, none approached the humanity of its Duplex example.

    There is a big difference in what Google can do and what they can do en masse. You may have also noticed a statement today about efforts in optimizing trained networks. The more complex networks aren't economical to run millions of times a day. Parallel work is under way both in hardware and algorithms to change that.

    Duplex is not being deployed today because the compute costs are high enough that it is not yet economical to deploy.

    Similarly, the voice we hear from the Assistant differs greatly from their best in-house efforts on those same voices. It is from a more energy optimized model.

    An everyday example of this can be self-demonstrated with Google Maps in the driving mode. Some of the voice commands are produced by the server and sound very nice. Others are produced directly on the phone and sound like text to speech engines from previous decades. I'm not sure what the criteria are for using a locally produced direction versus one from the server, perhaps it loses the cell tower for a moment. But, you'll know it when you hear it.

  5. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by Tablizer · · Score: 1

    Bart [calling]: Is Oliver there?

    Moe: Who?

    Bart: Oliver Klozoff.

    Moe: Hold on, I'll check. Paging Oliver Klozoff! Oliver Klozoff!...

  6. The real question: by sconeu · · Score: 5, Interesting

    Where did they get this body of "anonymized phone conversations"?

    Is it from Google Voice? Is it from Android phones calling home?

    --
    General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
    1. Re:The real question: by The-Ixian · · Score: 1

      In Soviet Russia, Android phones you!

      --
      My eyes reflect the stars and a smile lights up my face.
    2. Re: The real question: by Anonymous Coward · · Score: 1

      This is the only question worth asking on this article.

      Seriously? Wtf? We knew the google bastards were evil but now they openly advertise it.

    3. Re:The real question: by AmiMoJo · · Score: 2

      Android does not covertly record calls or transmit them to Google.

      There are companies that collect and curate this stuff from customer service calls (with consent) for training humans.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    4. Re:The real question: by LordNicholas · · Score: 1

      Almost certainly Google Voice is one source. They have 9 years worth of transcribed voicemails and call recordings to pull from, and I remember them stating things like voice recognition and natural language processing research as uses for such data when you signed up.

      100% they're using data from Google Assistant as well.

      Google has plenty of sources for this kind of data that people have opted in to.

  7. Re:So many things wrong with this, where do I star by Zaelath · · Score: 2

    3. More excuses to avoid interactions with other human beings.

    4. Less opportunities for people to develop their interpersonal skills/be properly socialized.

    Maybe it's just introversion, but avoiding interactions with random other human beings is a massive benefit to this tech.

    And the reason is the "other human beings" lack interpersonal skills (like empathy and courtesy) and particularly the children in starter jobs that tend to answer the phones, no amount of forcing me to interact with assholes is going to make me dread it less.

  8. Solving the important problems. by shess · · Score: 1

    Wow, this will save me like five minutes a week!

    Assuming the failure rate isn't horrendous, and then instead of talking to some front-line person with a service incentive to quickly make a reservation or appointment, I'll be talking to an overwhelmed backend support person trying to fix a screw-up. So 19 times out of 20, you'll save 90 seconds, and the other time you'll lose 45 minutes.

    1. Re:Solving the important problems. by zdzichu · · Score: 1

      Every minute saved from speaking with carbon-based meat person is a reason to celebrate!

      --
      :wq
    2. Re: Solving the important problems. by Brockmire · · Score: 1

      I could have used this feature this week. My local Ford dealer is overwhelmed by a recent recall notice and haven't called me back after leaving two messages to book a service time. Even if they did call me back, it affected my schedule thinking I'd soon get a call back (shower, driving, etc). With Duplex, I'd just have it keep trying until they answered and not impact me as much.

  9. Can we name it? by josiahgould · · Score: 1

    Tom Smykowski, he's a people person. I hope you can get downloadable voices.

  10. Perfect for the robocallers by mspohr · · Score: 1

    Just turn this loose on the robocallers. It should tie them up for a long time.

    --
    I don't read your sig. Why are you reading mine?
  11. Re:Does it work... by greenwow · · Score: 1

    Many of our locations are still on dial-up since they're mostly in the Seattle area. I would love to be able to use an offline AI. We used wit.ai before they were bought out by Facebook, and it worked great with our locations with fast Internet access (about >512bps). It did a great job of determining customer "intents" to use their term. Too bad it didn't work well over dial-up and after they were acquired by Facebook, their system now doesn't work well at all.

  12. Re:So many things wrong with this, where do I star by 110010001000 · · Score: 2

    Avoiding people who lack interpersonal skills doesn't help either them or you. Insane.

  13. Re:Does it work... by 110010001000 · · Score: 1

    Thanks to the Directors Rules and progressive Seattle government, Seattle enjoys some of the highest Internet access speeds on the planet. 1Gbps is common. There are over 28 ISPs in Seattle offering high speed Internet.

  14. Re:So many things wrong with this, where do I star by b0s0z0ku · · Score: 1

    Sounds like you're a lot of fun on a first date. :D

  15. Re:Great by b0s0z0ku · · Score: 1

    Why, so you can regress even further into social isolation and alienation?

  16. I just played these calls for my wife. by waspleg · · Score: 3, Interesting

    She immediately started talking about debt collectors talking to your digital assistant. I said no the debt collectors will be automated too so it will be them talking at each other.

    They are fucking creepy as hell too.

  17. Re:So many things wrong with this, where do I star by Zaelath · · Score: 1

    Thankfully past dating, but it's certainly a much different Risk vs Reward situation than "booking a table at short notice".

  18. Re:So many things wrong with this, where do I star by b0s0z0ku · · Score: 1

    Not really, without practice, it falls off :)

  19. Let me get this straight by Dixie_Flatline · · Score: 2

    Google has workedâ"unsuccessfullyâ"for years to make a decent chat app and had to shelve it, but your phone can make appointements for you and might actually confuse people into thinking it's a real person?

  20. Advantageous by GameboyRMH · · Score: 1

    Sounds like Google is trying to re-enact the scene from the full-length version of Advantageous where the main character finds out her assistant/coach was an AI the whole time.

    --
    "When information is power, privacy is freedom" - Jah-Wren Ryel
    1. Re:Advantageous by GameboyRMH · · Score: 1

      A minor spoiler at most...and yeah it wasn't great. The full-length version is little more than the short version stretched out with artsy cinematography.

      --
      "When information is power, privacy is freedom" - Jah-Wren Ryel
  21. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by bettodavis · · Score: 1

    I already tend to answer a call only if I have the caller number in my contacts.

    It's maybe rude but I found out that I'm not missing anything, really.

    Anyone I want to potentially contact me has and can use instant messaging apps or even SMS if they're old school.

    And I have a fixed phone only because it comes with the Internet access. It's mostly disconnected. There has been too much abuse of it, for really making you want to use the telephone for anything else than calling businesses for making an appointment (as in the article above), or chatting with persons in your circle of acquaintances.

  22. Turing Test by mi · · Score: 1

    From Wikipedia:

    The Turing test, developed by Alan Turing in 1950, is a test of a machine's ability to exhibit intelligent behavior equivalent to, or indistinguishable from, that of a human. Turing proposed that a human evaluator would judge natural language conversations between a human and a machine designed to generate human-like responses. The evaluator would be aware that one of the two partners in conversation is a machine, and all participants would be separated from one another. The conversation would be limited to a text-only channel such as a computer keyboard and screen so the result would not depend on the machine's ability to render words as speech. If the evaluator cannot reliably tell the machine from the human, the machine is said to have passed the test. The test does not check the ability to give correct answers to questions, only how closely answers resemble those a human would give.

    It seems, we are about to arrive...

    --
    In Soviet Washington the swamp drains you.
  23. Re:Will it speak understand other then English? by Guspaz · · Score: 1

    Like the second example on their blog, where it tries to make a reservation at a Chinese restaurant, and the lady has a thick accent?

  24. Re:So many things wrong with this, where do I star by taylorius · · Score: 1

    Just let Google Duplex handle all flirting and dating smalltalk tasks, it's for the best... :-)

  25. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by AmiMoJo · · Score: 1

    Phones haven't been useful for a decade or more.

    People will learn to recognise these things and hang up on them, or at least pass them to their own AI assistant.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  26. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by senileoldfart · · Score: 1

    You need the Telecrapper2000 https://www.youtube.com/watch?...

  27. I can imagine it by nospam007 · · Score: 1

    Hello, this is Google Assistant, I assume you are at lunch right now, are you happy with your long distance provider? ....

    1. Re:I can imagine it by aberglas · · Score: 1

      Why assume? Google knows where your phone is. And what you like to eat, and how long it takes. Google *knows* that you are at lunch, have just eaten it, and it is the optimal time to call.

  28. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by bickerdyke · · Score: 1

    During the presentation, this was placed as a kind of bridge technology for businesses that don't have a digital reservation system yet. (OpenTable or whatever there is for hairdressers and doctors)

    So as soon as they have something electronic, in place to reserve timeslots, Duplex will be obsolete.

    Related question: Anyone else thought this would have been a fantastic April Fools story?

    --
    bickerdyke
  29. Re:So many things wrong with this, where do I star by worf_mo · · Score: 1

    2. More depersonalization of your interactions with other people.
    3. More excuses to avoid interactions with other human beings.

    "Have your digital assistant call my digital assistant to schedule an appointment."

  30. Digital-assistant supported flirting by DrYak · · Score: 1

    Just let Google Duplex handle all flirting and dating smalltalk tasks,

    Made me think of this video (around 2:45, the guys uses a "wingman" app to help on his date).

    Of course, the creepiest part is a few of the current "big AI companies" probably have the kind of data resource to attempt training this kind of stuff for real.
    (And some like Uber are already training simple systems to spot one-night-stands in their database).

    --
    "Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
  31. Re:recording of calls law ? by Enigmafan · · Score: 1

    "calls may be recorded for training and monitoring purposes"

    'may' instead of 'are', because that way when they screw up, they can claim that your particular conversation wasn't recorded.

  32. Wasting AI on outdated procedures by MoarSauce123 · · Score: 1

    Why would Google waste time and effort on a bot that calls a phone to make an appointment? I rather see them invent a system that makes it easy and inexpensive for any business to receive and confirm appointments online. I want to make reservations or a doc appointment at 10 at night. What good does a bot do when at that time only a different bot will be picking up the phone at best?

    1. Re:Wasting AI on outdated procedures by jeff4747 · · Score: 2

      I rather see them invent a system that makes it easy and inexpensive for any business to receive and confirm appointments online.

      There are many of those that already exist. All of them are incompatible with each other, and everyone is pushing their own "standard".

      Place-phone-call is about the closest thing we have to a standard.

      If your response is "Then Google should push it's own standard", 1) they already do, and 2) https://xkcd.com/927/

  33. Re:So many things wrong with this, where do I star by swillden · · Score: 1

    1. More ways that Google (and 'partner companies', I'm sure) can track more aspects of your life.

    Meh. Anyone using this is going to be putting the appointment on their Google calendar anyway.

    1a. More opportunities for hackers to pry your personal data from you.

    How so?

    1b. More opportunities for criminal hackers to commit fraud (fraudulent purchases via hacked 'digital assistant', etc).

    How so? Hacking your digital assistant would mean hacking Google's servers. If they can do that, I fail to see how the digital assistant makes anything worse.

    2. More depersonalization of your interactions with other people.

    Yeah, because calling to make appointments really helps you keep in touch with humanity. <sarcasm/>.

    3. More excuses to avoid interactions with other human beings.

    Opportunities to avoid meaningless, content-free, time-wasting interactions with people. Actually, this is just a stopgap. What we really need is for salons, restaurants, etc., to provide online scheduling APIs. All the fancy natural language processing is just to cover this deficiency.

    4. Less opportunities for people to develop their interpersonal skills/be properly socialized.

    If you're so isolated that making reservations is a significant part of your interpersonal interaction, you have a real problem.

    --
    Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  34. Re:recording of calls law ? by wootcat · · Score: 1

    But also, 'may' can be interpreted as 'giving permission' as in 'YOU may record this for monitoring purposes'. One could argue this gives you permission to record the calls yourself.

    --
    I'm really a low 5-digit Slashdotter, but this ID is where I am now.
  35. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by iczer1 · · Score: 1

    I think this should be effective against tele-spammers too:
    http://www.jollyrogertelco.com...

    It's not AI, but it's better in a way because the timed responses will talk over the caller and interrupt them.

  36. Re:So many things wrong with this, where do I star by jeff4747 · · Score: 1

    Forcing interaction doesn't help either.

  37. Re:So many things wrong with this, where do I star by Rick+Schumann · · Score: 1

    Well, for your kids' sake, I certainly hope you're socializing them properly (with real people in person, not so-called 'social media') and not allowing them to become antisocial/socially avoidant hermits. There's already too much of that in the world and it's not a good thing.

  38. Re:Does it work... by greenwow · · Score: 1

    What a load of garbage. CenturyLink is testing gigabit on a couple of streets. It is not available to the vast majority of the city. As to the 28 claim, what does that matter if the city only allows one of two of them to offer service at your address?

  39. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  40. Re:So many things wrong with this, where do I star by philmarcracken · · Score: 1

    2. More depersonalization of your interactions with other people.

    3. More excuses to avoid interactions with other human beings.

    Were these supposed to be negatives?

  41. Re:So many things wrong with this, where do I star by wonkavader · · Score: 1

    "Without practice"? I think it's way, way, way too much practice in a short time which makes it fall off.

    That or leprosy.

  42. The NSA, of course! by davide+marney · · Score: 1

    I may be mis-remembering this, but the NSA tapped 500M+ pin logs last year based on a court authorization to investigate just 40 people.

    --
    "We receive as friendly that which agrees with, we resist with dislike that which opposes us" - Faraday
  43. Re:So many things wrong with this, where do I star by jeff4747 · · Score: 1

    My gut (which isn't science) says putting people in situations where they have to communicate with other people helps them learn to communicate.

    Putting people in situations does. When they are ready and willing to do so.

    Forcing people into situations does not. Instead, it triggers the recoil effect and drives them away from further communication.

    Your gut is a terrible psychologist.

  44. Half Duplex by jtgd · · Score: 1

    So when my Duplex is talking to some company's bot, it's just two computers communicating at a really really low data rate?

    --
    J
  45. Hours by SavSoul · · Score: 1

    Maybe they can get the hours correct finally if they call and ask. POS tells me everything is closed all the time.

  46. Re:Telemarketers, Tele-SPAM and Robo-Calls, Oh My. by Sperbels · · Score: 1

    or at least pass them to their own AI assistant

    Or why not just have your AI assistant answering the phone calls from the other AIs. It's the peak of bloated, inefficient, and overly expensive ordering systems. I write systems that can place hundreds of orders a second. These new AI systems will be able to place one order every one hundred seconds.