Slashdot Mirror


Amazon Explains Why Alexa Recorded And Emailed A Private Conversation (mercurynews.com)

Amazon has issued the following statement about why their Alexa device recorded a woman's private conversation and then emailed it to one of her friends: Echo woke up due to a word in background conversation sounding like "Alexa." Then, the subsequent conversation was heard as a "send message" request. At which point, Alexa said out loud "To whom?" At which point, the background conversation was interpreted as a name in the customers contact list. Alexa then asked out loud, "[contact name], right?" Alexa then interpreted background conversation as "right." As unlikely as this string of events is, we are evaluating options to make this case even less likely.
This apparently didn't satisfy the woman whose conversation was recorded, according to the Mercury News:
Now her family has unplugged all the devices, and although Amazon offered to "de-provision" the devices of their communications features so they could keep using them to control their home, Danielle and her family reportedly want a refund instead.

When reached Friday, an Amazon spokeswoman would not comment about whether the company will issue a refund.

Other smart home speakers carry similar privacy risks. Last year, for example, Google had to release a patch for its Home Mini speakers after some of them were found to be recording everything.

29 of 163 comments (clear)

  1. Not a bug by Anonymous Coward · · Score: 5, Insightful

    Its a feature and working as intended

    1. Re:Not a bug by Joce640k · · Score: 5, Insightful

      This.

      They bought a device that listens to what you say and sends it to other people.

      It listened, it sent. Where's the problem?

      --
      No sig today...
    2. Re:Not a bug by gweihir · · Score: 5, Insightful

      Stupid people that do not even begin to understand the technology they bought in bright-eyed enthusiasm. Of course, it is the technologies fault now.

      Now, I do not plan to bring such a listening device into my home, ever. But if I were to, I would at least familiarize myself with how it works...

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    3. Re:Not a bug by Tony+Isaac · · Score: 2

      Well, not quite. It did mistake several verbal phrases as commands or responses, which were apparently different from what the owner of the device intended. The "bug" isn't that it sent a message based on a verbal command, but rather, that it misunderstood what was being said.

    4. Re: Not a bug by gweihir · · Score: 3, Interesting

      That AC is either stupid, in full-on panic mode (causing stupidity) or trying to spread propaganda (i.e. lying). While attacks by apps against careless users are easy, it is a whole different story to attack a carefully managed phone. And no, the FBI does not have that capability. Maybe the NSA has in some cases, but if so, they are very careful to protect it, which means it does not get used a lot. Also note that this is pretty easy to detect for a competent expert, as the data exfiltration will show up in various ways.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  2. You want privacy? by jawtheshark · · Score: 5, Insightful

    You want privacy? Don't use these assistants. It's not that hard.

    --
    Ahhh...the great dumpster continuum. Many a free computer will be found there. -- sowth (748135)
    1. Re:You want privacy? by fahrbot-bot · · Score: 4, Insightful

      You want privacy? Don't use these assistants. It's not that hard.

      Agreed, but there seems to be a growing assumption that people will have them.

      I just noticed that TiVo added "Amazon Alexa" (along with "Get New Experience") to the App sub-menu on my device and neither item can be removed. Seems presumptuous. I will *never* have an Alexa (or similar device) in my home and will never willingly upgrade to their New Experience (which, like the new Amazon interface, seems horrible, unnecessarily busy and dumbed-down).

      Just my $0.02.

      --
      It must have been something you assimilated. . . .
  3. Interesting Explanations by oldgraybeard · · Score: 5, Insightful

    "woke up due to a word in background conversation", "At which point, the background conversation was interpreted" and "Alexa then interpreted background conversation as "right.""

    OK, so these deices ARE listening to everything at all times. But don't worry. It will only be used in good ways.

    I think the PR department is going to be working over time to cover this one over.

    Just my 2 cents ;)

    1. Re:Interesting Explanations by 93+Escort+Wagon · · Score: 3, Insightful

      It is unfortunate that people have gotten so inured to the continual harvesting of their personal data by companies like Facebook and Google that they don’t care about this. Last time I mentioned a similar story (where the Google device sent police to someone’s home) to my family, they all suddenly turned into Eric Schmidt - “privacy is dead, get over it”.

      --
      #DeleteChrome
    2. Re:Interesting Explanations by thegarbz · · Score: 4, Insightful

      OK, so these deices ARE listening to everything at all times.

      Well of course they are, how do you think they recognise their code word? There has never been a question of whether they are listening at all times, the question has only ever been if everything is being sent back to be processed by the borg, and as far as anyone has been able to tell the answer to that is no, not until the code word has been identified (or in this case, thought it had been identified).

    3. Re:Interesting Explanations by 91degrees · · Score: 2

      It is quite possible. In this case, a packet sniffer would tell you how much data was being sent back.

      The idea that probing a negative is impossible is weird.

    4. Re:Interesting Explanations by chihowa · · Score: 2

      Here's an interesting technical article on how "Hey Siri" works. I'd assume that Google's equivalent or any of these that run on battery powered devices work similarly.

      --
      If you want a vision of the future, imagine a youtube comments section scrolling - forever.
  4. Arse by Carrot007 · · Score: 2

    If only these devices had a button to stop them paying attention.

    Oh wait.

    --
    +----------------- | What is the question!
  5. Story Is informative, Summary is Fake News by blazerw · · Score: 5, Informative

    This is pretty sensationalist and, overall, poor summarizing. The actual story is nothing like the summary. Yes, the Alexa recorded the conversation and sent it. That is true, but the women's reaction of unplugging them all was immediate and NOT after Amazon's response. This summary portrays the order wrong to sensationalize. Also, the Google Mini issue was limited to very few devices and discovered before general release. The feature (bug) causing the issue was disabled before going on sale to the general public. Then permanently disabled when a fix was not possible. Seriously, the actual story is barely longer than the summary and much better. Do better.

  6. "Smart" my a** by jabberw0k · · Score: 5, Insightful

    Computers are scary, but call them "telephones" and folks trust them. Meanwhile, anything euphemistically called "smart" really means "a computer you do not, and cannot, control." Those of us without such nefarious gadgets are increasingly treated as second-class citizens. You want a taxi? Sorry, we got rid of those, and without a "smart" so-called "telephone" you can't get a ride anymore. Everyone on the street goes around in a daze under the spell of these gadgets. Remember, we have always been at war with Oceania...

  7. Sigh. by ledow · · Score: 5, Insightful

    The fact that they know what happened to this level of detail means that it's always recording and they can go back to their records far enough, even days later.

    Turn this shit off.

    1. Re:Sigh. by mentil · · Score: 4, Informative

      This isn't secret. You can actually go into the Alexa app and listen to voice clips of everything you've ever said to your Alexa devices. The clip even starts with the person saying 'Alexa' so there's a buffer which gets added to the recording once it detects you're addressing it. Sometimes you can even hear voice clips from other people talking to their own Alexa devices on other accounts, although customer support claims this is rare.

      --
      Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    2. Re:Sigh. by Obfuscant · · Score: 4, Insightful
      This is insightful?

      The fact that they know what happened to this level of detail means that it's always recording

      No, it doesn't. It means that it records command sessions so that the user can go back and hear what it was that triggered some event.

      and they can go back to their records far enough, even days later.

      So can the owner. I've heard what triggers Alexa to wake up because I can listen to the interaction using the app.

      Turn this shit off.

      If you are telling people to turn the device off entirely, well, if you don't want one don't buy one, and if you have one and suddenly realized that it is listening to what you say and you want to shut it off, then unplug it. Problem solved.

      If you are telling Amazon to stop keeping recordings of what interactions Alexa has with the owners, then get screwed. I want to know what caused mine to wake up when I have it on, and how it interpreted the commands. If you're never going to own one then why do you think you can tell others how it should work?

  8. Re:Why a refund? by Calydor · · Score: 5, Insightful

    If a bank teller misunderstood you and sent all your money to some random guy you once mentioned you knew you'd probably change banks even if they got all your money back.

    --
    -=This sig has nothing to do with my comment. Move along now=-
  9. I told you so by kbg · · Score: 4, Interesting

    I saw this scenario coming a mile away. When you use a constant listening device that can execute actions on your behalf with very poor AI then this will happen. Until the AI can rival human intelligence then this device can not be relied upon.

  10. So, according to Amazon... by technomom · · Score: 2

    Their own voice recognition software is crap.

  11. Re:Sounds like a fishy explanation to me by Obfuscant · · Score: 2

    There is too much of ~then some noise in the background is interpreted as a command~ excuses to make it a plausible explanation for me.

    Do you own one, and have you ever listened to the recordings after it has done something it thought you told it to do? If not, then you have no idea what is plausible, because this scenario is exactly what several of us in the previous discussion predicted as the cause. It also shows that Alexa asked for information explicitly, and for a confirmation like a few people here said it should have done.

    They also claimed we know it did not ask, but now we all know different, don't we?

  12. Re:Sounds like a fishy explanation to me by drinkypoo · · Score: 4, Informative

    There is too much of ~then some noise in the background is interpreted as a command~ excuses to make it a plausible explanation for me.

    Nobody said "some noise in the background". There was a conversation occurring. It wasn't noise, it was speech. The device is designed to recognize speech. Apparently, it's not fantastically good at the job; or even adequately. It should be able to detect when a keyword it's listening for is part of a stream of conversation, meaning it's not meant for Alexa. That should actually be an easier job than recognizing the words. In any case, the actual phrase used was "a word in background conversation", and your misrepresentation is utterly disingenuous.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  13. Problem Solved by pi_rules · · Score: 3, Interesting

    Alexa: "To confirm you'd like to send this message repeat 5... 6... 8"
    User: "5... 6... 8"

    There. Pick 3 random positive integers for the send code each time.

  14. Re:De-provision or unplug ? by Obfuscant · · Score: 3, Insightful

    I believe I'm being productive by getting rid of unproductive and useless toys.

    Your comment had nothing to do with you getting rid of things you don't want. It was telling others what they don't need and they should get rid of them. That's the non-productive part.

    You are free to define what you want and need. Not so much when you try to do it for everyone else. The latter is just arrogance and completely unproductive.

  15. Re:Sounds like a fishy explanation to me by dcollins117 · · Score: 2

    They also claimed we know it did not ask, but now we all know different, don't we?

    We know what an Amazon spokesperson said happened, implausible as it sounds. Seems to me if this thing was close enough to record their conversation it was close enough for them hear it ask for confirmation, but that doesn't seem to be addressed anywhere.

  16. Investigation tells us about retention by manu0601 · · Score: 2

    The fact they can come to some conclusions in this investigation suggests Amazon retains logs a lot of data about every Alexa installed. Do they have the full audio record? Just the commands?

  17. And this is why I never bought one, but .... by King_TJ · · Score: 4, Insightful

    I'm not going to hand out the smug, pointless "Told you so!" answer either.

    The real problem is that people buy these new technologies with unrealistic expectations. Then they get angry when it can't live up to them.

    I work in I.T. and I see examples, all the time, of technologies failing in totally unexpected ways. Even the best voice recognition systems I've ever used get my commands wrong at least 1 out of 4 times or so. That doesn't enthuse me about having an "always on" system trying to take commands properly when it's going to hear all sorts of random conversations all day long that don't involve it.

  18. Re:Why a refund? by Dog-Cow · · Score: 2

    And if a waiter misunderstood me and brought the wrong food, I'd send it back and not pay for it. People in service jobs know to be sure they have your attention, and the good ones will confirm when it's clear you are attending. The bad ones don't get tips.