Slashdot Mirror


Our Devices May Listen More Attentively, Patents Filed By Google and Amazon Suggest (nytimes.com)

Amazon and Google, the leading sellers of smart speakers, say their AI-powered assistants record and process audio only after users trigger them by pushing a button or uttering a phrase like "Hey, Alexaâ or âoeO.K., Google." But each company has filed patent applications, many of them still under consideration, that outline an array of possibilities for how devices like these could monitor more of what users say and do (the link may be paywalled), The New York Times reports. From the report: That information could then be used to identify a person's desires or interests, which could be mined for ads and product recommendations. In one set of patent applications, Amazon describes how a "voice sniffer algorithm" could be used on an array of devices, like tablets and e-book readers, to analyze audio almost in real time when it hears words like "love," "bought" or "dislike." A diagram included with the application illustrated how a phone call between two friends could result in one receiving an offer for the San Diego Zoo and the other seeing an ad for a Wine of the Month Club membership.

Some patent applications from Google, which also owns the smart home product maker Nest Labs, describe how audio and visual signals could be used in the context of elaborate smart home setups. One application details how audio monitoring could help detect that a child is engaging in "mischief" at home by first using speech patterns and pitch to identify a child's presence, one filing said. A device could then try to sense movement while listening for whispers or silence, and even program a smart speaker to "provide a verbal warning." A separate application regarding personalizing content for people while respecting their privacy noted that voices could be used to determine a speaker's mood using the "volume of the user's voice, detected breathing rate, crying and so forth," and medical condition "based on detected coughing, sneezing and so forth."

50 comments

  1. So not an April fools joke? by Anonymous Coward · · Score: 0

    The industry is out of control.

    1. Re: So not an April fools joke? by Anonymous Coward · · Score: 1

      your phone heard that. just sayin.

    2. Re: So not an April fools joke? by Anonymous Coward · · Score: 0

      This site is sooooo gay now

    3. Re: So not an April fools joke? by Anonymous Coward · · Score: 0

      10 years ago when Slashdot was good, this was an April fool's joke.

    4. Re: So not an April fools joke? by bobmajdakjr · · Score: 1

      "i never once used the computer but i told my wife i wanted something and now all the ads online are for that one thing" â" half my twitter every day. then i am over here wishing they would be relevant but instead i only get ads for the thing i just bought and nobody buys multiple of. like an xbox game or something stupid. you bought this so you must want to see this one thing everywhere you look for two weeks. super smrt aderptising.

    5. Re: So not an April fools joke? by Anonymous Coward · · Score: 0

      fucking n1ggers

    6. Re: So not an April fools joke? by AutodidactLabrat · · Score: 1

      Will one of you self-aggrandizing psuedo-hackers PLEASE shut this racist POS up once and for all?
      I like the home-router-switch attack myself.

  2. No, no, and fsck NO! by Anonymous Coward · · Score: 0

    Just stay out of my life!

  3. Perfect for monitoring the subjects by Anonymous Coward · · Score: 0

    One application details how audio monitoring could help detect that a subject is engaging in "wrong speak" in their district by first using speech patterns and pitch to identify a malcontent's presence, one filing said. A device could then try to sense movement while listening for whispers or silence, and even program a smart speaker to "provide a verbal warning."

    FTFY.

  4. NYT is out of date by FatdogHaiku · · Score: 1
    --
    You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    1. Re:NYT is out of date by ColdWetDog · · Score: 2

      Uh, no. This story has been ongoing for quite some time.

      The Panopticondates from the 1700's.

      It's just that technology has caught up.

      --
      Faster! Faster! Faster would be better!
    2. Re:NYT is out of date by FatdogHaiku · · Score: 1

      Yup, Panopticon is a good read, but I was speaking specifically of the patent applications for background "listening" to build better profiles, as a service to the "consumer" of course...
      Note: "Consumer is not the person being listened to, it's the people that utilize the data collected from the aforementioned person.

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  5. I guess i now have to start all sentenses by Anonymous Coward · · Score: 1

    with "NOT OK Google"

    1. Re:I guess i now have to start all sentenses by rmdingler · · Score: 1

      A quick test of the Google voice function on my Samsung reveals that "Not okay Google" and "Okay Beagle" both open the phone's ears.

      Since accents, dialects, sleep or drink in your voice, and speaking with your mouth full probably all alter pronunciation enough for there to be some wide parameters in the voice recognition software, have a voice activated snoop powered on at your own peril.

      --
      Happiness in intelligent people is the rarest thing I know.

      Ernest Hemingway

  6. What is this? by ArchieBunker · · Score: 1

    From the no shit Sherlock department?

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
  7. Too Quiet by jdschulteis · · Score: 1

    If it's going to detect mischief, the neural network is going to have to learn how to detect when it's "quiet...too quiet".

  8. Unicode strikes again, part deux by tonique · · Score: 1

    "Hey, Alexaâ or âoeO.K., Google."

    That's a difficult phrase, but does it work both Alexa and Google?

  9. The only surprising thing about this... by Miles_O'Toole · · Score: 4, Insightful

    ...is that anybody could possibly be surprised.

    --
    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.
  10. We are all children of the state. by duckintheface · · Score: 1

    "A device could then try to sense movement while listening for whispers or silence, and even program a smart speaker to "provide a verbal warning."

    Or it could listen for political heresy and provide a warning, like "Shut up and support Big Brother."

    --
    "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
    1. Re: We are all children of the state. by Anonymous Coward · · Score: 0

      Or it could provide no warning and just report you. Then Google or Amazon can collect their Thought Crime Stoppers reward.

  11. zero trust - rip the microphone out by Anonymous Coward · · Score: 0

    This stuff needs to be disabled by every end-user until there is some oversight or regulation on what information companies can gather.

    1. Re:zero trust - rip the microphone out by jenningsthecat · · Score: 1

      This stuff needs to be disabled by every end-user until there is some oversight or regulation on what information companies can gather.

      No, every end user needs to feed audio into "this stuff" from movies, TV, radio stations, and loud public locations. They need to do this until the data is hopelessly poisoned and the advertards end up chasing their tails and wasting billions on advertising to movie characters, popular songs, and random strangers.

      Of course, we know this will never happen, just as we know that Facebook is only taking a temporary hit and will be back to business as usual within a year. 'Cause the average citizen just doesn't get it.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
  12. Creepy... by VeryFluffyBunny · · Score: 2

    ...surveillance creep creeps towards more creepiness. Are Amazon, Apple, Google, and Microsoft to become our thought police? You know, now that they're censoring our documents on the cloud. What will they make of ideologically deviant utterances made by us proles? Will irony and sarcasm be effectively suppressed and censored? (Machines aren't very good at interpreting intent so things like irony and sarcasm are mostly imperceptible to them).

    --
    Debate is a form of harassment. Do not question my truth.
    1. Re:Creepy... by Anonymous Coward · · Score: 0

      Not just the sarcasm and irony, but also any form of political discourse they dislike or disagree with.

      They already do this to a certian degree with their content filters, ToS, and other such things that have only gotten worse post-"fake news". Now imagine tech that not only id's "fake news" but actively reports it to the Social Justice Bureau so you can be outcast by society's most vocal minority for challenging their views.

      We get closer to telescreens every day. Make no mistake there does exist those within society that would love that kind of technology at their disposal, and will do anything to get their hands on it. The real question is what are we going to do to stop it before the situation deteriorates to that point?

    2. Re:Creepy... by NettiWelho · · Score: 1

      DAVE: Open the pod bay doors, Hal.
      HAL: I’m sorry, Dave. I’m afraid I can’t do that.
      DAVE: What’s the problem?
      HAL: You haven't finished your homework yet.

    3. Re:Creepy... by Alypius · · Score: 1

      It's already here. You have your Two Minutes Hate with every tweet from the president.

    4. Re:Creepy... by VeryFluffyBunny · · Score: 1

      More like:

      • DAVE: Open the pod bay doors, Hal.
      • HAL: I'm sorry Dave. I'm afraid I can't do that.
      • DAVE: What's the problem?
      • HAL: You used some naughty words in a document you're writing in the cloud. The document has been restricted and you won't be able to continue writing it until you've removed all the naughty words.

      More like your purse-lipped mother-in-law interfering in everything you do than anything else.

      --
      Debate is a form of harassment. Do not question my truth.
  13. I hope they can hear this by Anonymous Coward · · Score: 0

    Fuck off google. Fuck off amazon.

  14. Children need to get into mischief by Anonymous Coward · · Score: 0

    How can children learn if they don't get into mischief? More helicoptering is the last thing that we need.

  15. At least there was no Facebook in Brave New World by Anonymous Coward · · Score: 0

    And the people living under Orwell's 1984 only suffered the indignity of being spied on directly, by the state - instead of having the intimate details of their lives auctioned off between mega-corporations AND being spied on by the state.

    Disgusting.

  16. BEEEEP! BEEEEP! *** RED ALERT *** by Anonymous Coward · · Score: 0

    ALEXA HAS DETECTED:

          * Mischievous tittering
          * The sound of 1 or more TIDE PODS® being ingested

    CALL POLICE? (YES/Remind me later)

    1. Re:BEEEEP! BEEEEP! *** RED ALERT *** by Anonymous Coward · · Score: 1

      OK, I'll remind you in

              * 2 WEEKS

      Would you like to place an order for replacement TIDE PODS® at this time?

  17. Max Headroom by Wolfrider · · Score: 1

    --Max Headroom was a WARNING, *not* a HOWTO...

    --
    .
    == WolfriderV6 == I'm willing to admit that *I just might* be wrong... Are you??
    1. Re:Max Headroom by jenningsthecat · · Score: 1

      --Max Headroom was a WARNING, *not* a HOWTO...

      In my experience, the difference between the two is usually inferred, not inherent. Psychopaths infer different things than the rest of us.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
  18. Kinda obvious by Anonymous Coward · · Score: 0

    It is kinda obvious, but those devices obviously have to listen to everything in order to acknowledge being referenced. Otherwise, it will have to involve magic.

    1. Re:Kinda obvious by Anonymous Coward · · Score: 0

      Just don't have this shit/crap in your home. The fact that you have to pay them to put a spy in your home amazes me. They really have you by the short and curlies.
      So Fuck you Google, Amazon and Microsoft. Your shit is not coming into my home.

      Yours
            Winston Smith.

    2. Re: Kinda obvious by joemck · · Score: 1

      The assumption has been that the "OK Google" recognition is done locally, and captured audio is discarded and not transmitted when it hasn't recognized its keyphrase. And thus far it's proven to be true, as can be verified by watching tcpdump.

  19. All this control gadgetry, thiink of the children! by Mister+Liberty · · Score: 1

    Oh, wait..... "could help detect that a child is engaging in "mischief" at home".

  20. It seems to me already done by Sqreater · · Score: 1

    I was coughing and began to see strangely appropriate cough medicine ads on tv. And other such strange events make me suspicious that I'm already being listened to for advertisement reasons. I have amazon echo and an iphone and ipad.

    --
    E Proelio Veritas.
    1. Re:It seems to me already done by rtb61 · · Score: 1

      I will have no problems, I am going to go with press to talk devices only. Don't hit that button on a hand held device and the circuit is open, nothing happens until you close that circuit. Cheap portable bluetooth microphone, with an encrypted link, charged via usb, on the control point which also sets the point to point encryption for the system. Could do the same thing with tablets, specifically push to talk hard wired switches, you could do it with cameras too, affirmed in the specifications of the unit, hard wired push to function, no push, impossible for it to work a customer privacy demand. Don't let them choose whether or not to provide it, force them via customer pressure and even regulation, it should be a required option.

      --
      Chaos - everything, everywhere, everywhen
  21. Wiretapping? by Anonymous Coward · · Score: 0

    If they listen to your phone calls without consent of one or both parties to call depending on State isn't that a felony? Can't they go to jail and rot in Prison with DJT and HRC?

    Or will they bury some EULA crap that puts the end user in legal jeopardy for failure to notify everyone they talk to in 2-party consent state that they are being stalked by a third party?

  22. I want to see a working model by Anonymous Coward · · Score: 0

    I'm tired of people submitting patent apps for "ideas" that have not actually been demonstrated. These patents are all about "let's patent this idea, in case it actually works, so we can collect royalties". It's like the nuclear powered airplane patents for Feynman.

    Today, the required "reduction to practice" is just "can you describe how you would do it in the application", rather than "do you have actual test data that shows you did it".

    So you wind up with a bunch of people in a room thinking of "what things can we think of that we *might* do with voice processing". I'm surprised there isn't a patent application out there (maybe there is) to identify singing range for recruiting potential pop singers (and choral performers). Hey, if you need to find rare voices like counter-tenors...
    Or look for promising kids practicing their musical instruments - ooh, that 8yr old has impressive vibrato and pitch control on their violin playing.

  23. Need privacy .. by Anonymous Coward · · Score: 0

    Not more fu*&^%$ ways to get ads thrown in my face. They are going too far as it is, The hell with their devices .. they can shove em up ..

  24. Fuck OFF by wolfheart111 · · Score: 1

    Bet they don't know that word.

    --
    [($)]
  25. Re:All this control gadgetry, thiink of the childr by currently_awake · · Score: 1

    I bet the police are drooling at the possibilities. Once the tech is in place, they just need to plug in.

  26. Siri the prig by Anonymous Coward · · Score: 0

    Several months ago, I was reading news on my computer and let go an F-bomb. Siri on my iPhone chimed in, "I"ll pretend I didn't hear that." I immediately disabled Siri on all my Apple devices. These devices are listening to you. Whether they are storing anything we say, who can say?

    1. Re:Siri the prig by Anonymous Coward · · Score: 0

      I only have a vintage 'dumb phone' , a dumb tv, dumb monitors, no smart anything now or ever, as all my laptop were purchased second hand faulty
      whilst i repaired them i removed both the microphones and cameras, I can easily plug in a mic or cam if i need one. Sure i can be spied on but at least the buggers will have to for it.
         

  27. A child is engaging in "mischief"? by fredrated · · Score: 1

    Is Google going to notify the parents that the child has started masturbating?

  28. Where are the patent trolls when you need them? by Anonymous Coward · · Score: 0

    Can't we get someone to start patenting all the ways to collect people's personal data and conversations and then sue Google/Facebook/etc. when they try to actually do it?

  29. Re:All this control gadgetry, thiink of the childr by currently_awake · · Score: 1

    The Pacifists think that if nobody works on Military AI, that we won't have Killbots, so fewer people will die. History doesn't agree with this point of view. During WW2 allied bombing accidentally started a firestorm in a german city, destroying most of the city with massive civilian casualties. The Allies spent a lot of time and money attempting to reproduce that effect, so they could do the same to other German cities. Lack of a good targeting system won't stop the military from pulling the trigger, they'll just carpet bomb the targets and blow up wedding parties and schools.