Beautiful Virgin Islands

Saturday, Feb 22, 2025

Your smart devices listening to you, explained

Humans are listening to your conversations, but that’s not the same as spying.

Facebook was listening to you. Then it wasn’t. Now it’s listening again.

Google, Apple, and Amazon are listening too, but it’s not all as pernicious as it sounds.

Facebook told Bloomberg this week that it collects and stores audio from its smart speaker, Portal, when users awaken the device by saying, “Hey Portal.” Contractors may later transcribe a small portion of the ensuing dialogue to help train Portal’s algorithms so it can come up with better responses in the future. (Facebook now says it will give users the option to turn off human audio transcription.)

Still, people are concerned and confused about the possibility that their devices are spying on them and that human workers could potentially be listening to their conversations.


Why companies listen


There are valid reasons why tech companies listen to your dialogue with their smart devices. These companies review a small sample — less than 1 percent for Google and Apple — of user conversations. They say they do this because the recordings help make their products better. The workers who listen to these recordings take note of common mistakes — say an Amazon Echo hearing the word “elections” as “Alexa” — with the intent of improving the software.

The samples tech companies review are anonymized, so they don’t include personally identifiable information. But that’s not entirely reassuring because if you really want to figure out who someone is, in some cases you can just listen to what they’re saying.

“Anyone who’s dealt with voice systems will have worked in call centers, and all of them use these practices: Humans looking at errors, assessing them, and feeding corrections back into the system for machine learning to improve performance,” Bret Kinsella, founder of Voicebot.ai, a publication that covers voice-activated technology like smart speakers, told Recode. “You can’t run the system without recording, and it’s difficult to improve the system without human reviewers annotating errors.”

Really, smart assistants, which are the brains behind voice technology on smart speakers and smartphones like Google’s Assistant, Apple’s Siri, Amazon’s Alexa, and Facebook’s Portal, are always listening for their wake word, the phrase that tells them to start recording and to transmit that information to its servers so that it can figure out how best to respond. These companies then vet the wake word that devices picked up a second time, to see if you really meant to say “Hey Google.”

And as anyone with a smart devices knows, they can be set off unintentionally — when they think they hear a wake word, but really it’s just you saying something similar, so dialogue that smart assistants unintentionally pick up can be reviewed as well.

One way to avoid other people listening would be to have smart assistants answer queries on the device as opposed to transmitting the audio to the cloud, Todd Mozer, CEO of Sensory, a company that works to do just that, told Recode.

“A lot of companies will reduce privacy to keep costs down and keep the device smaller,” Mozer said. Google and Amazon have begun releasing on-device versions of software, a move that’s both faster and more secure.

The fact that tech companies often employ contractors to review this audio also exacerbates people’s concerns with having other people review snippets of the dialogue they say in their homes. These workers may not have as much incentive as a full-time employee to keep the information they hear private.

Kinsella says the best way to mitigate concerns would be to hire reviewers in-house rather than rely on contract workers.


Siri/Portal/Alexa/Assistant, are you listening to me?


There’s also the persistent fear that our phones are listening to us even when we’re not trying to talk to them. Some 43 percent of American smartphone owners think their phone is recording them without their permission. Part of the reason for the belief that our devices are listening stems from advertisers’ eerie ability to show people ads for things they were just talking about.

But there doesn’t seem to be any proof our phones and other devices are listening without our permission.

That’s not to say it’s impossible — but it’s unnecessary.

As many have pointed out, tech companies and third-party data companies already have loads of information about you. Phones and apps already collect and transmit your location, your browser and purchase history, and your contacts, among other info. A new Northeastern University and Imperial College London study found that some smart TVs send data to companies like Netflix, Facebook, and Google, even when the devices are not in use.

Through this trough of information advertisers can get a pretty good idea of what you want and when.

Are they spying? Probably not. Do they already know plenty about you? Yes.

What’s perhaps more perturbing for people is that these companies haven’t been transparent about saying what they’re doing and why.

Amazon waited to disclose in plain English that Alexa relies on thousands of human beings to listen to users’ conversations until after Bloomberg reported the news. It now says Alexa training “relies in part on supervised machine learning, an industry-standard practice where humans review an extremely small sample of requests to help Alexa understand the correct interpretation of a request and provide the appropriate response in the future.”

Users of all the major assistants also now have the option to opt out of audio reviews. Most people don’t change factory settings, so having to opt out is largely meaningless. (Siri and Assistant are now opt-in services).


Does privacy even matter to people?


The jury is out on whether or not people care enough about privacy to change their tech use or demand changes from tech companies.

As OneZero writer Will Oremus demonstrated, it’s difficult to know how much privacy is worth to Americans. Our behavior is no indication. Despite news reports and a lot of hubbub on social media, companies like Facebook are still pushing their smart devices and people are still buying them.

Still, knowing that a total stranger could overhear snippets of what you say within the privacy of your own home is creepy.

Andrew Bosworth, Facebook’s head of hardware, told Bloomberg this week about Portal, “The consumer reaction the last several months to these practices, not just at Facebook but other companies, gave us insight into the fact that this was something people weren’t entirely comfortable with or weren’t sure about.”

It was an understatement.

Americans say they trust tech companies less than ever, and continual breaches of trust — like not telling users explicitly that their conversations could be reviewed by humans — are degrading this trust even further. This could have been a mundane announcement rather than something buried and obscured in terms of service disclosures. Instead, tech companies have handled it in a way that’s given their customers yet another reason to question what they’re doing and why.

Newsletter

Related Articles

Beautiful Virgin Islands
0:00
0:00
Close
Good News: Senate Confirms Kash Patel as FBI Director
Officials from the U.S. and Hungary Engage in Talks on Economic Collaboration and Sanctions Strategy
James Bond Franchise Transitions to Amazon MGM Studios
Technology Giants Ramp Up Lobbying Initiatives Against Strict EU Regulations
Alibaba Exceeds Quarterly Projections Fueled by Growth in Cloud and AI
Tequila Sector Faces Surplus Crisis as Agave Prices Dive Sharply
Residents of Flintshire Mobile Home Park Grapple with Maintenance Issues and Uncertain Future
Ronan Keating Criticizes Irish Justice System Following Fatal Crash Involving His Brother
Gordon Ramsay's Lucky Cat Restaurant Faces Unprecedented Theft
Israeli Family Mourns Loss of Peace Advocate Oded Lifschitz as Body Returned from Gaza
Former UK Defense Chief Calls for Enhanced European Support for Ukraine
Pope Francis Admitted to Hospital in Rome Amid Rising Succession Speculation
Senate Republican Leader Mitch McConnell, at the age of 83, Declares His Retirement.
Whistleblower Reveals Whitehall’s Focus on Kabul Animal Airlift Amid Crisis
Politicians Who Deliberately Lie Could Face Removal from Office in Wales
Scottish Labour Faces Challenges Ahead of 2026 Holyrood Elections
Leftwing Activists Less Likely to Work with Political Rivals, Study Finds
Boris Johnson to Host 'An Evening with Boris Johnson' at Edinburgh's Usher Hall
Planned Change in British Citizenship Rules Faces First Legal Challenge
Northumberland Postal Worker Sentenced for Sexual Assaults During Deliveries
British Journalist Missing in Brazil for 11 Days
Tesco Fixes Website Glitch That Disrupted Online Grocery Orders
Amnesty International Critiques UK's Predictive Policing Practices
Burglar Jailed After Falling into Home-Made Trap in Blyth
Sellafield Nuclear Site Exits Special Measures for Physical Security Amid Ongoing Cybersecurity Concerns
Avian Influenza Impact on Seals in Norfolk: Four Deaths Confirmed
First Arrest Under Scotland's Abortion Clinic Buffer Zone Law Amidst International Controversy
Meghan Markle Rebrands Lifestyle Venture as 'As Ever' Ahead of Netflix Series Launch
Inter-Island Ferry Services Between Guernsey and Jersey Set to Expand
Significant Proportion of Cancer Patients in England and Wales Not Receiving Recommended Treatments
Final Consultation Launched for Vyrnwy Frankton Power Line Project
Drug Misuse Deaths in Scotland Rise by 12% in 2023
Failed £100 Million Cocaine Smuggling Operation in the Scottish Highlands
Central Cee Equals MOBO Awards Record; Bashy and Ayra Starr Among Top Honorees
EastEnders: Four Decades of Challenging Social Norms
Jonathan Bailey Channels 'Succession' in Bold Richard II Performance
Northern Ireland's First Astronaut Engages in Rigorous Spacewalk Training
Former Postman Sentenced for Series of Sexual Offences in Northumberland
Record Surge in Anti-Muslim Hate Crimes Across the UK in 2024
Omagh Bombing Inquiry Concludes Commemorative Hearings with Survivor Testimonies
UK Government Introduces 'Ronan's Law' to Combat Online Knife Sales to Minors
Metal Detectorists Unearth 15th-Century Coin Hoard in Scottish Borders
Woman Charged in 1978 Death of Five-Year-Old Girl in South London
Expanding Sinkhole in Godstone, Surrey, Forces Evacuations and Road Closures
Bangor University Announces Plans to Cut 200 Jobs Amid £15 Million Savings Target
British Journalist Charlotte Peet Reported Missing in Brazil
UK Inflation Rises to 3% in January Amid Higher Food Prices and School Fees
Starmer Defends Zelensky Amidst Trump's 'Dictator' Allegation
Zelensky Calls on World Leaders to Back Peace Efforts in Light of Strains with Trump
UK Prime minister, Mr. Keir Starmer, has stated that any peace agreement aimed at ending the conflict in Ukraine "MUST" include a US security guarantee to deter Russian aggression
×