Amazon Workers Are Listening To What You Tell Alexa (bloomberg.com)
Amazon reportedly employs thousands of people around the world to help improve its Alexa digital assistant. "The team listens to voice recordings captured in Echo owners' homes and offices," reports Bloomberg. "The recordings are transcribed, annotated and then fed back into the software as part of an effort to eliminate gaps in Alexa's understanding of human speech and help it better respond to commands." From the report: The team comprises a mix of contractors and full-time Amazon employees who work in outposts from Boston to Costa Rica, India and Romania, according to the people, who signed nondisclosure agreements barring them from speaking publicly about the program. They work nine hours a day, with each reviewer parsing as many as 1,000 audio clips per shift, according to two workers based at Amazon's Bucharest office, which takes up the top three floors of the Globalworth building in the Romanian capital's up-and-coming Pipera district. The modern facility stands out amid the crumbling infrastructure and bears no exterior sign advertising Amazon's presence. The work is mostly mundane. One worker in Boston said he mined accumulated voice data for specific utterances such as "Taylor Swift" and annotated them to indicate the searcher meant the musical artist. Occasionally the listeners pick up things Echo owners likely would rather stay private: a woman singing badly off key in the shower, say, or a child screaming for help. The teams use internal chat rooms to share files when they need help parsing a muddled word -- or come across an amusing recording.
Sometimes they hear recordings they find upsetting, or possibly criminal. Two of the workers said they picked up what they believe was a sexual assault. When something like that happens, they may share the experience in the internal chat room as a way of relieving stress. Amazon says it has procedures in place for workers to follow when they hear something distressing, but two Romania-based employees said that, after requesting guidance for such cases, they were told it wasn't Amazon's job to interfere. [...] Amazon, in its marketing and privacy policy materials, doesn't explicitly say humans are listening to recordings of some conversations picked up by Alexa. "We use your requests to Alexa to train our speech recognition and natural language understanding systems," the company says in a list of frequently asked questions. In Alexa's privacy settings, the company gives users the option of disabling the use of their voice recordings for the development of new features. A screenshot reviewed by Bloomberg shows that the recordings sent to the Alexa auditors don't provide a user's full name and address but are associated with an account number, as well as the user's first name and the device's serial number. An Amazon spokesperson said in a statement to Bloomberg: "We take the security and privacy of our customers' personal information seriously. We only annotate an extremely small sample of Alexa voice recordings in order [to] improve the customer experience. For example, this information helps us train our speech recognition and natural language understanding systems, so Alexa can better understand your requests, and ensure the service works well for everyone."
They added: "We have strict technical and operational safeguards, and have a zero tolerance policy for the abuse of our system. Employees do not have direct access to information that can identify the person or account as part of this workflow. All information is treated with high confidentiality and we use multi-factor authentication to restrict access, service encryption and audits of our control environment to protect it."
Further reading: How To Stop Amazon From Listening To Your Recordings
Sometimes they hear recordings they find upsetting, or possibly criminal. Two of the workers said they picked up what they believe was a sexual assault. When something like that happens, they may share the experience in the internal chat room as a way of relieving stress. Amazon says it has procedures in place for workers to follow when they hear something distressing, but two Romania-based employees said that, after requesting guidance for such cases, they were told it wasn't Amazon's job to interfere. [...] Amazon, in its marketing and privacy policy materials, doesn't explicitly say humans are listening to recordings of some conversations picked up by Alexa. "We use your requests to Alexa to train our speech recognition and natural language understanding systems," the company says in a list of frequently asked questions. In Alexa's privacy settings, the company gives users the option of disabling the use of their voice recordings for the development of new features. A screenshot reviewed by Bloomberg shows that the recordings sent to the Alexa auditors don't provide a user's full name and address but are associated with an account number, as well as the user's first name and the device's serial number. An Amazon spokesperson said in a statement to Bloomberg: "We take the security and privacy of our customers' personal information seriously. We only annotate an extremely small sample of Alexa voice recordings in order [to] improve the customer experience. For example, this information helps us train our speech recognition and natural language understanding systems, so Alexa can better understand your requests, and ensure the service works well for everyone."
They added: "We have strict technical and operational safeguards, and have a zero tolerance policy for the abuse of our system. Employees do not have direct access to information that can identify the person or account as part of this workflow. All information is treated with high confidentiality and we use multi-factor authentication to restrict access, service encryption and audits of our control environment to protect it."
Further reading: How To Stop Amazon From Listening To Your Recordings
The article seems to present this as some new info, I assumed this was happening all the time, otherwise how else can Alexa improve?
it's incidentally also why I don't have anything like Alexa or other voice assistants in my house, but if you are sending audio to Amazon hey guess what, something or someone is going to listen to that audio. DURRRR.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
Well, at least such could be helpful to the next person who asks for "Natalie Portman to moan romantically about a Beowulf cluster of hot grits." It does get better each time ... my friend asks for it.
Table-ized A.I.
Seriously, I have no objections to technology, but the people behind the technology are not even remotely trustworthy. Until we hit some semi-utopian Star Trek civilization, I cannot trust the machines due to the untrustworthy people behind the machines.
Be Excellent To Each Other
There are a myriad of ways this can go badly. Everything from misinterpreting conversations leading to arrests to blackmail of politicians.
If you're like a lot of people, you already have a cell phone (more properly known as a tracker because that's what it does most of the time) so you already have the same spying capability in your house, on your person, and you likely choose to carry that around with you everywhere you go. Even technical users don't expect that the portable spy devices are listening whenever the proprietor wishes (and there's no indicator to tell the user when the mic is hot). You shouldn't own a tracker either.
Digital Citizen
Lock a random sentence generator, with multiple voices into a box with your choice of home spy systems.
Feed your spot, echo, home, siri, cortana GB of gibberish 24x7
I knew this was happening. Everyone I've warned about though, just plays it down. They like to believe that the chances of being listened to are very slim. They like to believe the privacy controls are sufficient and reliable.
(This is why the listening work is done out of the country.)
So how many times, when we’ve discussed these devices before and someone like me has brought up this EXACT concern... has someone right here said some variant of “oh, no, they don’t transmit anything unless it’s preceded by the trigger phrase”?
#DeleteChrome
...of our customers' personal information seriously.
Translation: We do not give a fuck about you or your privacy. We will keep these recordings forever and eventually monetize them any way possible.
From what I have seen, the more a company stresses how it values privacy, the less it actually does. The "Big Lie" approach at work.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
How would the "hear" that? Also, people that are capable of making a WMD will not talk about it in front of a known listening device.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
You only have this surveillance if you gave Google access to the mic permission.
I suggest you go into your phone and access permissions, microphone and turn off everything but the camera app and phone apps.
The big problem with Android is you cannot deny apps NETWORK access, so I'd like to stop the phone and camera apps accessing networks.
Presumably both of those things have been happening for quite a while now. The system is operating as designed.
Big Brother Bezos is always watching.
...that Alexa actually has no AI at all. It just records audio commands, sends them to a central server, where human monkeys listen to conversations, and make Alexa act accordingly. It is just like the Truman show, only bigger. Probably the same happens for Siri.
Under German law, devices that can be used as hidden surveillance device are illegal. The doll "My Friend Cayla" comes under that and was banned in Germany.
I wonder if Alexa is the next casualty of that... would serve Amazon right ;-)
C - the footgun of programming languages
Because ideally Amazon should be anonymizing the voice captures. All the agents should get is the voice clip, with at most a regional indicator. But otherwise they should get no details about who said it, where or when it was said. The point is to transcribe the words recorded and feed them back into the system with the capture so that it can learn to recognize those variants of the words.
Maybe in the future if there is demand, they could consider adding a sub routine that could identify captures that indicate serious life threatening crimes and feed those directly to the local authorities.(who would then listen and if they decide it is an actual criminal act, rather than dialogue captured from a nearby TV,) then they could pull the location and respond. But not via transcribers in another country who may be working on captures that are hours or even days old.
And what does making a WMD sound like? Is it a WMD or is it a chemical experiment for school? Or a home inventor at work building the next super duper vacuum to sell? Or a couple retired military buddies talking about some of the IED's they ran across in Iraq back in the Day?
I'm too lazy to compose a creative sig.
Nobody who VOLUNTARILY PLACED AN ALWAYS-ON MICROPHONE IN THEIR HOME is seriously complaining about the privacy violation here, are they?
-Styopa
That's how all machine learning systems improve. Humans look at real data, annotate it, and feed it back into the system.
Alexa, show me all the article's about Amazon's spying on me.
Alexa, how do I spell the plural of "article"?
Who is the idiot who didn't think this would be the case? Hint: So do smartphones, Uber, your "smart TV", Facebook and Uber.
Laws are rules for the court, but merely a bottom bar to hit for life. Think beyond laws in your actions always.
And without those samples, they won't know who you are. You and I have the choices of putting our phones in Faraday bags, and thwarting the surveillance economy at ever turn if we think about it. Most will not.
But this is about choices, and fealty to the results of those choices. Government deadlocks will prohibit meaningful moves towards privacy unless that fealty is revoked.
---- Teach Peace. It's Cheaper Than War.