Slashdot Mirror


Did Google's Duplex Testing Break the Law? (daringfireball.net)

An anonymous reader writes: Tech blogger John Gruber appears to have successfully identified one of the restaurants mentioned in a post on Google's AI blog that bragged about "a meal booked through a call from Duplex." Mashable then asked a restaurant employee there if Google had let him know in advance that they'd be receiving a call from their non-human personal assistant AI. "No, of course no," he replied. And "When I asked him to confirm one more time that Duplex had called...he appeared to get nervous and immediately said he needed to go. He then hung up the phone."

John Gruber now asks: "How many real-world businesses has Google Duplex been calling and not identifying itself as an AI, leaving people to think they're actually speaking to another human...? And if 'Victor' is correct that Hong's Gourmet had no advance knowledge of the call, Google may have violated California law by recording the call." Friday he added that "This wouldn't send anyone to prison, but it would be a bit of an embarrassment, and would reinforce the notion that Google has a cavalier stance on privacy (and adhering to privacy laws)."

The Mercury News also reports that legal experts "raised questions about how Google's possible need to record Duplex's phone conversations to improve its artificial intelligence may come in conflict with California's strict two-party consent law, where all parties involved in a private phone conversation need to agree to being recorded."

For another perspective, Gizmodo's senior reviews editor reminds readers that "pretty much all tech demos are fake as hell." Speaking of Google's controversial Duplex demo, she writes that "If it didn't happen, if it is all a lie, well then I'll be totally disappointed. But I can't say I'll be surprised."

73 comments

  1. The Definition: by Barny · · Score: 4, Insightful

    Conversation, noun:

    A talk, especially an informal one, between two or more people, in which news and ideas are exchanged.

    How many people were involved? Or are we already granting AI status as a person?

    From all the available (I don't live in the US) law information I can find, CONVERSATION seems to be a key word in all of it.

    --
    ...
    /me sighs
    1. Re:The Definition: by Barny · · Score: 4, Interesting

      Found the relevant line:

      For the purposes of this section, “person” means an individual, business association, partnership, corporation, limited liability company, or other legal entity, and an individual acting or purporting to act for or on behalf of any government or subdivision thereof, whether federal, state, or local, but excludes an individual known by all parties to a confidential communication to be overhearing or recording the communication.

      An AI is none of those things.

      --
      ...
      /me sighs
    2. Re:The Definition: by Anubis+IV · · Score: 4, Insightful

      So, two things:

      1) The actual law refers to communications, not conversations, so the fact that there was a biological person on only one side of the call doesn’t matter. Communication still occurred.

      2) Duplex acts on Google’s behalf and Google falls under the definition of “person” according to the law. It’s no different than when you work through an automated phone system and they warn you that the call may be recorded. Whether it’s an AI or a simple automated system, it’s still just a tool being used by the “person” on that end of the line.

      But that actually raises an interesting point to consider: are these robocalls, and if so, do they run afoul of federal regulations against robocalls?

    3. Re:The Definition: by nospam007 · · Score: 1

      Also this is Google Voice, they can route every call through one of the 1 party consent states.

    4. Re: The Definition: by Anonymous Coward · · Score: 0

      Google, being the evil too-big-to-follow-the-law scumbags that they are could do that but it would not get them out of a violation of Californiaâ(TM)s 2 person consent law.

      Nerds can be such pedantic idiots. The law is clear. Google management and staff are evil as fuck.

      And while weâ(TM)re here, so is Musk because Iâ(TM)ll bet youâ(TM)re one of those âoeautopilot isnâ(TM)t reaaaaally autopilotâ big corporate Tesla loving clowns, too.

    5. Re: The Definition: by Anonymous Coward · · Score: 0

      California doesn't get to apply local laws to other States, no matter how much they wish they could.

      Autopilot means exactly what it says, it's not Tesla's fault you dipshits think it works like it does in the movies.

    6. Re:The Definition: by Anonymous Coward · · Score: 0

      First off, this is America. The only law that matters is the court of public opinion. As long as you have the people on your side, it doesn't matter what's written on a piece of paper.

      Second, this is America. Individual good; Unique bad. Everyone wants to stand out in the herd but no one is willing to leave the herd to accomplish that. So everyone will hate on this new tech until it becomes normal. Then you'll have to leave the herd not to use it. (Like cellphones or social media)

      Third, even an AI lawyer could tell you that you've cited a law that deals with recording calls between people and their government representation. Yes, it may be true that I'm not allowed to record your calls to the government, but that has nothing to do with restaurant reservations. If anything, you've made the case that all interactions with government representation must be done in person because you can't know for sure if your text, email, or call was recorded by a third party.

      Lastly, What's funny is the idea of the government spending money to staff offices with people instead of changing the law and buying their own Google Duplex. I'll never understand why Slashdot has so much trouble understanding trends in technology. If it improves GDP it's the future. Plain and simple.

    7. Re:The Definition: by Anonymous Coward · · Score: 0

      Doesn't that depend on where Google initiated the call from and where the recording was done? I've not seen any evidence one way or the other that the calls were initiated from a California Google office or that the recording was done in a California data center.

    8. Re:The Definition: by Anonymous Coward · · Score: 0

      Most people are glossing over another law in several states regarding "robocalls" as can be found here: https://en.wikipedia.org/wiki/Robocall

  2. Who cares? by PopeRatzo · · Score: 3, Insightful

    Laws don't matter any more. Break 'em or not, if nobody's going to do anything about it, go right ahead. I'm getting that directly from the top.

    --
    You are welcome on my lawn.
    1. Re: Who cares? by Anonymous Coward · · Score: 1

      Yes, the Clintons and Albert âoeno controlling legal authorityâ Gore taught us that a generation ago as a follow up to Kennedy getting away with killing a woman.

    2. Re:Who cares? by Anonymous Coward · · Score: 0

      I knew this story had to have a Trump angle if you were desperate enough.

    3. Re:Who cares? by PopeRatzo · · Score: 1

      I knew this story had to have a Trump angle if you were desperate enough.

      Trump? What does he have to do with this? You libs need to stop making everything about Trump.

      --
      You are welcome on my lawn.
  3. Google violated two California laws. by Anonymous Coward · · Score: 0

    Google may have violated California law by recording the call.

    They also violated California law by placing a robocall without asking the called party for permission before letting the bot interact with the person.

    1. Re: Google violated two California laws. by Anonymous Coward · · Score: 0

      I don't understand what all the fuss is about. When I call my insurer or bank I always talk to a computer. Why would it be different when the initiative is reversed?
      As long as the conversation is not annoying I wouldn't care who is on the other end. It sure beats the helpdesk in India...

    2. Re: Google violated two California laws. by Anonymous Coward · · Score: 0

      You don't understand the difference between calling and being called? Really?

      The difference is in the first instance, you are initiating contact. In the second, someone else is initiating contact. If we get rid of the current laws against robocalling, are you prepared to deal with the deluge of spam calls that will follow? If you think it's bad now, then just imagine how much worse it could be.

      Talk about short-sighted.

    3. Re: Google violated two California laws. by Anonymous Coward · · Score: 0

      He already said he doesn't care tho, so,
      Have him post his phone number so all of his "HUMANS" can call him.

    4. Re: Google violated two California laws. by Anonymous Coward · · Score: 0

      You forgot about amendment 1 with all this robocalling nonsense

  4. Lets beat the this dead horse by Anonymous Coward · · Score: 2, Insightful

    Who cares.

  5. Probably not confidential under California law by raymorris · · Score: 5, Informative

    California law (penal code 632) requires consent to record a "confidential communication". It then defines what a confidential communication is and is not.

    First, in order to be a "confidential communication", the circumstances must indicate that a party desires it to be confidential between only the people involved in the conversation. In a restaurant or salon, there would have been other people around. If the employee didn't whisper or take the phone into another room, nor talk about personal private matters, they probably didn't intend it to be confidential. Indeed whatever they said to some random person calling, someone they've never met, probably isn't intended to be private.

    Secondly, California laws says it's not protected when the parties "may reasonably expect that the communication may be overheard or recorded". (Note the word "may", may be overheard, not "will be overheard". Google assistant says "I'm booking an appointment for a client". It would be reasonable to expect that the client may be overhearing the conversation. People routinely use speakerphone while booking restaurant reservations or hair appointments, so again the restaurant or salon "may reasonably expect that the communication MAY be overheard".

    If there was no reasonable expectation of privacy, if it wasn't a confidential communication, recording it doesn't violate the law.

    1. Re:Probably not confidential under California law by netlag1 · · Score: 2, Funny

      Secondly, California laws says it's not protected when the parties "may reasonably expect that the communication may be overheard or recorded". (Note the word "may", may be overheard, not "will be overheard".

      I can reasonably expect that the NSA or another agency may be listening. So I'm free to record any call then?

    2. Re:Probably not confidential under California law by Anonymous Coward · · Score: 1

      I don't think you're wrong. It's one of those things that feels really loophole-ish, though.

      My understanding is that a good number of call-centers, if they are informed by the caller that they are being recorded, then the requirement is to immediately disconnect. Something like "Hello, this is Name, how can I help you?", "Hi Name, I must inform you this call is being recorded", *click*. Maybe not that fast, but a quick boiler-plate saying and then *click. Obviously most call centers work across state lines, which doesn't seem to be the case here.

      So, I guess to me the CA law feels weird because it requires the call initiator to ascertain the privacy situation of the answerer in advance. For example in a restaurant scenario, what if it's that private office line is only for "those in the know", that super secret line that the plebs don't know about. Might still use a speaker-phone, might be privy to multiple people (corporate meeting w/ a client). This whole thing just feels, hmm, appealable to a Federal District Court, not the 9th obviously.

      The libertarian I me almost feels like I need to answer the phone "Hi, it's me, this conversation may be recorded, press #1 to speak".

    3. Re:Probably not confidential under California law by raymorris · · Score: 1

      > The Google demo violated CPC 632

      CPC 632(c):

      (c)âFor the purposes of this section, âoeconfidential communicationâ means any communication carried on in circumstances as may reasonably indicate that any party to the communication desires it to be confined to the parties thereto, but excludes ... any other circumstance in which the parties to the communication may reasonably expect that the communication may be overheard or recorded.

      Care to explain to me how a hair appointment is confidential? How the circumstances indicate the salon wants to keep it a secret, and they would be confident that it couldn't be overheard?

    4. Re:Probably not confidential under California law by Anonymous Coward · · Score: 0

      Maybe not hair appointments, but how about doctor or dentist appointments? Now Google would be running afoul of HIPAA if anyone within Google hears that call.

  6. PS it may still be spooky, just not illegal by raymorris · · Score: 2

    Btw still I understand why some might find it a bit spooky. The submission asked if it was illegal, not if it was spooky.

    It would be illegal only if the other party was trying to have a confidential discussion and thought there was little or no chance that it might be overheard.

    1. Re:PS it may still be spooky, just not illegal by Khyber · · Score: 1

      This doesn't violate various robocall laws?

      --
      Still waiting on Serviscope_minor to wake up to fucking reality and realize that Jessica Price isn't going to fuck him.
    2. Re:PS it may still be spooky, just not illegal by Anubis+IV · · Score: 2

      Interesting points. The law does seem to point towards the call only qualifying for protection if any party had reason to believe their communication would be private. Google clearly has no expectation of privacy, so it’s all on the recipient of the call, in which case it depends on their circumstances.

      On one end of the spectrum the salon could be in a mall with an open storefront, answering the calls from the front desk where anyone could overhear. On the other end, they may only answer calls from a back office on private property with “no recording allowed” signs posted.

      Either way, it’s not a good idea for Google to make assumptions. Disclosing that they’re recording is the only way this can safely work. And even then, it may run afoul of robocall laws.

    3. Re: PS it may still be spooky, just not illegal by Anonymous Coward · · Score: 0

      If goog simply converts the conversation into text, the rule does not apply.

      If goog simply does not record the conversation at all - doing all the AI learning bits on the fly.

      If if if.

    4. Re:PS it may still be spooky, just not illegal by Anonymous Coward · · Score: 0

      They do not get to say "No recordings allowed" since there's not even copyright involved. The ONLY Way they can get away with that demand is if they don't deal with the public. If the salon books in a back room with the public, it is still the public and still not private.

  7. Wait, what't the problem here? by h33t+l4x0r · · Score: 1

    If the noodle guy doesn't care then what's the issue? It sounds like he's nervous that Google employees will stop eating there because of that stupid blogger.

  8. They probably did get permission. by Anonymous Coward · · Score: 0

    I bet they randomly selected 100 business, and got them to give permission to do this, but never told when or if they would actually ring.

    That way, when actually rung, every call could be the AI - but the person answering would never know.

    Therefore it sounds authentic.

    Getting the permission of a a large sample means it could be anyone.

  9. Does it matter? by Anonymous Coward · · Score: 0

    By definition, laws apply to the poor and powerless.

  10. It wasn't recorded. by Anonymous Coward · · Score: 0

    It was remembered by an AI. No different from you calling up the restaurant and remembering what was said. Except more reliable. And it's not any sort of a slippery slope, because what was on the other side was a business, not a person. The person there was answering AS THE BUSINESS. And if they don't want to be publicly known and recorded AS a business, without the right to privacy of a private individual, make it a private members only restaurant. You're not a business open to the public then, and you CAN decide your dealings are not with the public.

    1. Re:It wasn't recorded. by TheRaven64 · · Score: 1

      It was remembered by an AI

      Wonderful defence! I didn't delete the files I have a legal obligation to retain, my computer forgot them! I didn't record you illegally, my computer just remembered the video. I'm sure that will go over really well in a court.

      --
      I am TheRaven on Soylent News
    2. Re:It wasn't recorded. by Anonymous Coward · · Score: 0

      There is no such thing as "AI", it's a chatbot, nothing more.. The computer is recording the call. It doesn't matter if it's an audio recording or a text transcript, it's still a record and it's still illegal. The robocall itself is also illegal because a human caller did not ask permission from the person being called before putting the chatbot on.

  11. It is not a robocall by Anonymous Coward · · Score: 0

    It's an AI calling. Robocalling is dialing 00001, then 00002, then 00003.... Meaning the line being called was not the intended destination of a call. Otherwise every business using voice activated screening (press 1 for sales, 2 if you want to be given the runaround, pound sign to hang up) is guilty of robocalling. As is nearly every helpdesk (the number you call is not the number you get to).

    1. Re:It is not a robocall by Anonymous Coward · · Score: 0

      A robocall is any call that is placed by a machine.

      And it's not a AI, it's speech recognition + text to speech.

    2. Re:It is not a robocall by Anonymous Coward · · Score: 0

      All my calls are placed by a machine. I just tell it what number to call.

    3. Re:It is not a robocall by Anonymous Coward · · Score: 0

      If you are on the phone when the other person answers, you are placing the call.

  12. Please decide what to accuse Google of by WoOS · · Score: 1

    I am definitely no Google fanboy but maybe people could decide what to accuse Google of:
    * First it was, that it was all a fake and people knew they were called by the AI.
    * Now it is that it was no fake and people did not know they were called by the AI.
    It appears rather difficult not to fall into one of the two categories.

    1. Re:Please decide what to accuse Google of by Anonymous Coward · · Score: 0

      It can be both, none or either or. It's up to Google to be honest about what the demo really was, and up to society to establish laws that prevent abuses of this technology.

      If it was fake, we do know we're not that far from this technology becoming mature enough to be usable anyways. It's not Turing-test complete, but can work in specific areas like ordering, though only makes sense for companies without API infrastructure.

      If the people were genuine employees at companies, with no prior warning of being recorded by the other end and even deceived into thinking it might be human, then no conversation took place and one can cast doubt whatever appointments were made can be legally binding.

      This is a typical case where Legal lags technological advancements, and everybody need to make some compromise.

  13. Very easy fix. by Anonymous Coward · · Score: 0

    It was a staged demonstration. If/when it turns into a real service, all they have to do is start each talk with a disclaimer like 'Hi, I'm the Google Duplex Software, this call is recorded."

  14. Cavalier stance? by thegarbz · · Score: 1

    Google may have violated California law by recording the call." Friday he added that "This wouldn't send anyone to prison, but it would be a bit of an embarrassment, and would reinforce the notion that Google has a cavalier stance on privacy (and adhering to privacy laws)."

    Or maybe the intent of the law in question was to protect people and their privacy and Google me the intent by removing all possible identifying information about the call. They did this to such an extent that they got accused of staging the call in the first place. So what is it? Is it fake as hell, or are we violating laws by not faking it?

    It's amazing how regardless of what anyone both sides of any argument will still find a way to complain about it. Seriously some people need to get a life.

  15. Just practice on banks, insurance companies,... by misnohmer · · Score: 1, Interesting

    Banks, insurance companies, and other big business tend to have pre-recorded "this conversation may be recorded for quality assurance and training purposes" before you're passed to a live person. Tada, permission given for google to record for QA and training of Duplex.

    1. Re:Just practice on banks, insurance companies,... by Anonymous Coward · · Score: 1

      Yes, and by Google's own comments they didn't provide that information. How do you leap at your "Tada" statement?

  16. "Journalists" by Anonymous Coward · · Score: 0

    >unveil cool new AI technology
    >feel good about yourself, everyone was impressed
    >journalists jealous they can't make cool things
    >journalists start framing your tech as evil and scary
    >journalists start looking for ways that you've done something criminal

    Fucking Jewish media, man. I'm no fan of Google but they don't deserve this.

    1. Re: "Journalists" by Anonymous Coward · · Score: 0

      What? Nice strawman you've erected. Google announced this loudly to the press. They asked for this. They knew the laws, and did it anyway. Sort of like Tesla. Google deserves everything it's getting here.

      They are based in California where this law applies. I'm assuming they have some lawyers working for them. I'm sure the lawyers signed off on this basically saying "Ask for forgiveness, not permission".

  17. two party consent needs to go away anyway by Anonymous Coward · · Score: 0

    Because it is otherwise known as "protect the politician/law enforcement/business mogul law" and the first two should be required to wear body cams with audio for all work interactions anyway.

  18. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  19. No, they didn't break any laws. by Hallux-F-Sinister · · Score: 1

    Google is rich enough that laws don't apply to it. This is not how it should be, but in a country where bribery has been legalized provided you maintain the fiction that it's just a "campaign donation," and there's no clearly identifiable quid being promised in consideration of a proposed specific quo, with enough money you can do whatever you want.

    The republic is dead, and I for one welcome our corporate oligarch overlords, and you would too if you were smart... because we simply have no alternative.

    --
    Our reign has gone on long enough. Indeed. Summon the meteors.
  20. Complainers got to complain. by Megol · · Score: 1

    What is the actual problem here?

    We are increasingly going to a complaint culture not because there are more problem today than in the past but because we allow ordinary people to complain on a new scale, world-wide. We encourage them even by commenting on their complaints, even if only saying we think they are acting like children.
    This leads to this complaint culture: everything that can be complained about is, as people like complaining. And this leads media to hang on to this "trend" and start complaining too. Not that they in turn haven't tried to manufacture controversies since the start of their existence.

    So to answer myself: the actual problem are the complainers. Those that cover up the real problems of the world in their mind-numbing noise of petty crap.

  21. Re:Weaponized autism by Anonymous Coward · · Score: 0

    if people spent as much time on sociopolitical issues, as they do trying to tear tech companies or strangers on the internet down?

    They do. That's why we have outrage mobs and wannabe journalists who go after every perceived wrongthink with an unyielding fervor that would make facists blush and a screeching retardation that makes even 4chan take a step back. The problem is, they're only making things worse not better.

  22. Move business to Texas by Anonymous Coward · · Score: 0

    We have a one party notification law, meaning anyone is free to record the conversation without having to notify the other, as it should be. :). Freedom.

    There are plenty of great software developers here..

    1. Re:Move business to Texas by PPH · · Score: 1

      So lets say I make a reservation at a local restaurant in California (two party notification state) but I do so through an AI hosted in a one party notification state (like Texas). Who' s laws apply?

      --
      Have gnu, will travel.
  23. Turing Test by Anonymous Coward · · Score: 2, Insightful

    Is everyone else here missing that the Turing Test has been at least partially solved? Google has AI that humans cannot distinguish from real people (in limited interaction).

    1. Re: Turing Test by Anonymous Coward · · Score: 0

      This isn't close to passing the turing test, even slightly.

  24. If the other party thinks so too, yes by raymorris · · Score: 1

    Yes, if all parties agree with you that they can reasonably expect someone might be listening.

  25. Only weird because it's a lot of words by raymorris · · Score: 1

    "You shouldn't record confidential conversations" doesn't seem that weird, does it? Or "don't record people's secrets".

    How about "Don't invade people's privacy. Someone preaching on a street corner isn't talking in privacy".

    Yeah any time law considers intent it can bring up questions, on the other hand my 3yo can distinguish between someone telling her a secret and someone making an announcement.

  26. TCPA applies to solicitors. And doctors' offices by raymorris · · Score: 2

    The main robocall legislation is the Telephone Consumer Protection Act, signed by President Bush in 1991. It generally applies to people trying to sell something. Here are the relevant FCC regulations:

    https://apps.fcc.gov/edocs_pub...

    The FTC also has some regulations based on TCPA, but again that's for solicitors.

    Besides calls from solicitors, TCPA also restricts automated calls to hospitals, emergency rooms, and doctors' offices. So it may technically be illegal to use Google Assistant to schedule an appointment with a doctor. I don't think it violates the spirit of the law, though, as the law was intended to protect people from receiving unwanted, nuisance bulk calls. So long as Google Assistant does a reasonably good job, it's not a nuisance call.

  27. Most demo's staged by Anonymous Coward · · Score: 0

    I would say most demo's are staged and rehearsed. Not the least surprised and other then geeks drooling over this presentation as being real. Most people I talked too figured it was staged. Neither business answered by name, and it appeared as though it was pretty much scripted and not random calls. Probably to make the technology seem better then it really is. But that's pretty much what and demo tries to do.

  28. Victor wasn't the person in the demo by Anonymous Coward · · Score: 0

    Unless the woman Duplex talked to goes by a male name. If Hong's is the same restaurant, it's possible that Victor's English is as bad as the woman in the demo, and he didn't understand the reporter's questions.

  29. But but ... by hcs_$reboot · · Score: 1

    When was the law written? When was that smart AI tool created?

    --
    Slashdot, fix the reply notifications... You won't get away with it...
  30. Re:Life in prison is the sentence by Anonymous Coward · · Score: 0

    Jail? He should be publicly tortured and executed. You think too small.

  31. The internet is toxic by Anonymous Coward · · Score: 0

    They called a restaurant.

  32. You're worried about that? by Anonymous Coward · · Score: 0

    Dude, Facebook. Nah, forget it, too.

    Trump.

    You might be worried about what calls AI will do next, not those ones making reservations...

  33. Two Party Consent by Anonymous Coward · · Score: 0

    Is two party consent even constitutional? I'd like to see the supreme court take up that one.

  34. ***** BREAKING NEWS ***** by Anonymous Coward · · Score: 0

    A Silicon Valley company ignores any possible ethical considerations in order to get blind stinking rich.

    Also, water is wet.

  35. John Gruber's Bias is the Real Story Here by Anonymous Coward · · Score: 0

    Gruber has been a total Apple fanboy/whore for decades. The point is not that Google is being careless about the restaurant's privacy when Duplex called to place an order--it's hardly a state secret and nothing unflattering happened--the point is that Gruber is blatantly trying to cause trouble for Google; whereas if Apple had come up with this first, he'd be filled nothing but praise and worship. I have always disliked him for his twisting of the truth and obvious bias, and this is just another example of it.