Slashdot Mirror


Our Devices May Listen More Attentively, Patents Filed By Google and Amazon Suggest (nytimes.com)

Amazon and Google, the leading sellers of smart speakers, say their AI-powered assistants record and process audio only after users trigger them by pushing a button or uttering a phrase like "Hey, Alexaâ or âoeO.K., Google." But each company has filed patent applications, many of them still under consideration, that outline an array of possibilities for how devices like these could monitor more of what users say and do (the link may be paywalled), The New York Times reports. From the report: That information could then be used to identify a person's desires or interests, which could be mined for ads and product recommendations. In one set of patent applications, Amazon describes how a "voice sniffer algorithm" could be used on an array of devices, like tablets and e-book readers, to analyze audio almost in real time when it hears words like "love," "bought" or "dislike." A diagram included with the application illustrated how a phone call between two friends could result in one receiving an offer for the San Diego Zoo and the other seeing an ad for a Wine of the Month Club membership.

Some patent applications from Google, which also owns the smart home product maker Nest Labs, describe how audio and visual signals could be used in the context of elaborate smart home setups. One application details how audio monitoring could help detect that a child is engaging in "mischief" at home by first using speech patterns and pitch to identify a child's presence, one filing said. A device could then try to sense movement while listening for whispers or silence, and even program a smart speaker to "provide a verbal warning." A separate application regarding personalizing content for people while respecting their privacy noted that voices could be used to determine a speaker's mood using the "volume of the user's voice, detected breathing rate, crying and so forth," and medical condition "based on detected coughing, sneezing and so forth."

29 of 50 comments (clear)

  1. Re: So not an April fools joke? by Anonymous Coward · · Score: 1

    your phone heard that. just sayin.

  2. NYT is out of date by FatdogHaiku · · Score: 1
    --
    You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    1. Re:NYT is out of date by ColdWetDog · · Score: 2

      Uh, no. This story has been ongoing for quite some time.

      The Panopticondates from the 1700's.

      It's just that technology has caught up.

      --
      Faster! Faster! Faster would be better!
    2. Re:NYT is out of date by FatdogHaiku · · Score: 1

      Yup, Panopticon is a good read, but I was speaking specifically of the patent applications for background "listening" to build better profiles, as a service to the "consumer" of course...
      Note: "Consumer is not the person being listened to, it's the people that utilize the data collected from the aforementioned person.

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
  3. I guess i now have to start all sentenses by Anonymous Coward · · Score: 1

    with "NOT OK Google"

    1. Re:I guess i now have to start all sentenses by rmdingler · · Score: 1

      A quick test of the Google voice function on my Samsung reveals that "Not okay Google" and "Okay Beagle" both open the phone's ears.

      Since accents, dialects, sleep or drink in your voice, and speaking with your mouth full probably all alter pronunciation enough for there to be some wide parameters in the voice recognition software, have a voice activated snoop powered on at your own peril.

      --
      Happiness in intelligent people is the rarest thing I know.

      Ernest Hemingway

  4. What is this? by ArchieBunker · · Score: 1

    From the no shit Sherlock department?

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
  5. Too Quiet by jdschulteis · · Score: 1

    If it's going to detect mischief, the neural network is going to have to learn how to detect when it's "quiet...too quiet".

  6. Unicode strikes again, part deux by tonique · · Score: 1

    "Hey, Alexaâ or âoeO.K., Google."

    That's a difficult phrase, but does it work both Alexa and Google?

  7. The only surprising thing about this... by Miles_O'Toole · · Score: 4, Insightful

    ...is that anybody could possibly be surprised.

    --
    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.
  8. We are all children of the state. by duckintheface · · Score: 1

    "A device could then try to sense movement while listening for whispers or silence, and even program a smart speaker to "provide a verbal warning."

    Or it could listen for political heresy and provide a warning, like "Shut up and support Big Brother."

    --
    "He took a duck in the face at 250 knots." -- William Gibson, Pattern Recognition
  9. Creepy... by VeryFluffyBunny · · Score: 2

    ...surveillance creep creeps towards more creepiness. Are Amazon, Apple, Google, and Microsoft to become our thought police? You know, now that they're censoring our documents on the cloud. What will they make of ideologically deviant utterances made by us proles? Will irony and sarcasm be effectively suppressed and censored? (Machines aren't very good at interpreting intent so things like irony and sarcasm are mostly imperceptible to them).

    --
    Debate is a form of harassment. Do not question my truth.
    1. Re:Creepy... by NettiWelho · · Score: 1

      DAVE: Open the pod bay doors, Hal.
      HAL: I’m sorry, Dave. I’m afraid I can’t do that.
      DAVE: What’s the problem?
      HAL: You haven't finished your homework yet.

    2. Re:Creepy... by Alypius · · Score: 1

      It's already here. You have your Two Minutes Hate with every tweet from the president.

    3. Re:Creepy... by VeryFluffyBunny · · Score: 1

      More like:

      • DAVE: Open the pod bay doors, Hal.
      • HAL: I'm sorry Dave. I'm afraid I can't do that.
      • DAVE: What's the problem?
      • HAL: You used some naughty words in a document you're writing in the cloud. The document has been restricted and you won't be able to continue writing it until you've removed all the naughty words.

      More like your purse-lipped mother-in-law interfering in everything you do than anything else.

      --
      Debate is a form of harassment. Do not question my truth.
  10. Max Headroom by Wolfrider · · Score: 1

    --Max Headroom was a WARNING, *not* a HOWTO...

    --
    .
    == WolfriderV6 == I'm willing to admit that *I just might* be wrong... Are you??
    1. Re:Max Headroom by jenningsthecat · · Score: 1

      --Max Headroom was a WARNING, *not* a HOWTO...

      In my experience, the difference between the two is usually inferred, not inherent. Psychopaths infer different things than the rest of us.

      --
      'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
  11. Re:BEEEEP! BEEEEP! *** RED ALERT *** by Anonymous Coward · · Score: 1

    OK, I'll remind you in

            * 2 WEEKS

    Would you like to place an order for replacement TIDE PODS® at this time?

  12. Re:zero trust - rip the microphone out by jenningsthecat · · Score: 1

    This stuff needs to be disabled by every end-user until there is some oversight or regulation on what information companies can gather.

    No, every end user needs to feed audio into "this stuff" from movies, TV, radio stations, and loud public locations. They need to do this until the data is hopelessly poisoned and the advertards end up chasing their tails and wasting billions on advertising to movie characters, popular songs, and random strangers.

    Of course, we know this will never happen, just as we know that Facebook is only taking a temporary hit and will be back to business as usual within a year. 'Cause the average citizen just doesn't get it.

    --
    'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
  13. All this control gadgetry, thiink of the children! by Mister+Liberty · · Score: 1

    Oh, wait..... "could help detect that a child is engaging in "mischief" at home".

  14. It seems to me already done by Sqreater · · Score: 1

    I was coughing and began to see strangely appropriate cough medicine ads on tv. And other such strange events make me suspicious that I'm already being listened to for advertisement reasons. I have amazon echo and an iphone and ipad.

    --
    E Proelio Veritas.
    1. Re:It seems to me already done by rtb61 · · Score: 1

      I will have no problems, I am going to go with press to talk devices only. Don't hit that button on a hand held device and the circuit is open, nothing happens until you close that circuit. Cheap portable bluetooth microphone, with an encrypted link, charged via usb, on the control point which also sets the point to point encryption for the system. Could do the same thing with tablets, specifically push to talk hard wired switches, you could do it with cameras too, affirmed in the specifications of the unit, hard wired push to function, no push, impossible for it to work a customer privacy demand. Don't let them choose whether or not to provide it, force them via customer pressure and even regulation, it should be a required option.

      --
      Chaos - everything, everywhere, everywhen
  15. Re: So not an April fools joke? by bobmajdakjr · · Score: 1

    "i never once used the computer but i told my wife i wanted something and now all the ads online are for that one thing" â" half my twitter every day. then i am over here wishing they would be relevant but instead i only get ads for the thing i just bought and nobody buys multiple of. like an xbox game or something stupid. you bought this so you must want to see this one thing everywhere you look for two weeks. super smrt aderptising.

  16. Fuck OFF by wolfheart111 · · Score: 1

    Bet they don't know that word.

    --
    [($)]
  17. Re:All this control gadgetry, thiink of the childr by currently_awake · · Score: 1

    I bet the police are drooling at the possibilities. Once the tech is in place, they just need to plug in.

  18. Re: Kinda obvious by joemck · · Score: 1

    The assumption has been that the "OK Google" recognition is done locally, and captured audio is discarded and not transmitted when it hasn't recognized its keyphrase. And thus far it's proven to be true, as can be verified by watching tcpdump.

  19. A child is engaging in "mischief"? by fredrated · · Score: 1

    Is Google going to notify the parents that the child has started masturbating?

  20. Re:All this control gadgetry, thiink of the childr by currently_awake · · Score: 1

    The Pacifists think that if nobody works on Military AI, that we won't have Killbots, so fewer people will die. History doesn't agree with this point of view. During WW2 allied bombing accidentally started a firestorm in a german city, destroying most of the city with massive civilian casualties. The Allies spent a lot of time and money attempting to reproduce that effect, so they could do the same to other German cities. Lack of a good targeting system won't stop the military from pulling the trigger, they'll just carpet bomb the targets and blow up wedding parties and schools.

  21. Re: So not an April fools joke? by AutodidactLabrat · · Score: 1

    Will one of you self-aggrandizing psuedo-hackers PLEASE shut this racist POS up once and for all?
    I like the home-router-switch attack myself.