Beautiful Virgin Islands

Saturday, Feb 22, 2025

Google Lookout: App reads grocery labels for blind people

Google Lookout: App reads grocery labels for blind people

Google's AI can now identify food in the supermarket, in a move designed to help the visually impaired.

It is part of Google's Lookout app, which aims to help those with low or no vision identify things around them.

A new update has added the ability for a computer voice to say aloud what food it thinks a person is holding based on its visual appearance.

One UK blindness charity welcomed the move, saying it could help boost blind people's independence.

Google says the feature will "be able to distinguish between a can of corn and a can of green beans".

Eye-catching, not easy


Many apps, such as calorie trackers, have long used product barcodes to identify what you're eating. Google says Lookout is also using image recognition to identify the product from its packaging.

The app, for Android phones, has some two million "popular products" in a database it stores on the phone - and this catalogue changes depending on where the user is in the world, a post on Google's AI blog said.

In a kitchen cupboard test by a BBC reporter, the app had no difficulty in recognising a popular brand of American hot sauce, or another similar product from Thailand. It could also correctly read spices, jars and tins from British supermarkets - as well as imported Australian favourite Vegemite.

But it fared less well on fresh produce or containers with irregular shapes, such as onions, potatoes, tubes of tomato paste and bags of flour.

If it had trouble, the app's voice asked the user to twist the package to another angle - but still failed on several items.

The UK's Royal National Institute of Blind People (RNIB) gave a cautious welcome to the new feature.

"Food labels can be challenging for anyone with a visual impairment, as they are often designed to be eye-catching rather than easy to read," said Robin Spinks from the charity.

"Ideally, we would like to see accessibility built into the design process for labels so that they are easier to navigate for partially sighted people."

But along with other similar apps - such as Be My Eyes and NaviLens, which are also available on iPhones - it "can help boost independence for people with sight loss by identifying products quickly and easily".


Be My Eyes: How smartphones became ‘eyes’ for blind people



Lookout uses similar technology to Google Lens, the app that can identify what a smartphone camera is looking at and show the user more information. It already had a mode that would read any text it was pointed at, and an "explore mode" that identifies objects and text.

Launching the app last year, Google recommended placing a smartphone in a front shirt pocket or on a lanyard around the neck so the camera could identify things directly in front of it.

Another new function added in the update is a scan document feature, which takes a photo of letters and other documents and sends it to a screen reader to be read aloud.

Google also says it has made improvements to the app based on feedback from visually impaired users.

Newsletter

Related Articles

Beautiful Virgin Islands
0:00
0:00
Close
Good News: Senate Confirms Kash Patel as FBI Director
Officials from the U.S. and Hungary Engage in Talks on Economic Collaboration and Sanctions Strategy
James Bond Franchise Transitions to Amazon MGM Studios
Technology Giants Ramp Up Lobbying Initiatives Against Strict EU Regulations
Alibaba Exceeds Quarterly Projections Fueled by Growth in Cloud and AI
Tequila Sector Faces Surplus Crisis as Agave Prices Dive Sharply
Residents of Flintshire Mobile Home Park Grapple with Maintenance Issues and Uncertain Future
Ronan Keating Criticizes Irish Justice System Following Fatal Crash Involving His Brother
Gordon Ramsay's Lucky Cat Restaurant Faces Unprecedented Theft
Israeli Family Mourns Loss of Peace Advocate Oded Lifschitz as Body Returned from Gaza
Former UK Defense Chief Calls for Enhanced European Support for Ukraine
Pope Francis Admitted to Hospital in Rome Amid Rising Succession Speculation
Senate Republican Leader Mitch McConnell, at the age of 83, Declares His Retirement.
Whistleblower Reveals Whitehall’s Focus on Kabul Animal Airlift Amid Crisis
Politicians Who Deliberately Lie Could Face Removal from Office in Wales
Scottish Labour Faces Challenges Ahead of 2026 Holyrood Elections
Leftwing Activists Less Likely to Work with Political Rivals, Study Finds
Boris Johnson to Host 'An Evening with Boris Johnson' at Edinburgh's Usher Hall
Planned Change in British Citizenship Rules Faces First Legal Challenge
Northumberland Postal Worker Sentenced for Sexual Assaults During Deliveries
British Journalist Missing in Brazil for 11 Days
Tesco Fixes Website Glitch That Disrupted Online Grocery Orders
Amnesty International Critiques UK's Predictive Policing Practices
Burglar Jailed After Falling into Home-Made Trap in Blyth
Sellafield Nuclear Site Exits Special Measures for Physical Security Amid Ongoing Cybersecurity Concerns
Avian Influenza Impact on Seals in Norfolk: Four Deaths Confirmed
First Arrest Under Scotland's Abortion Clinic Buffer Zone Law Amidst International Controversy
Meghan Markle Rebrands Lifestyle Venture as 'As Ever' Ahead of Netflix Series Launch
Inter-Island Ferry Services Between Guernsey and Jersey Set to Expand
Significant Proportion of Cancer Patients in England and Wales Not Receiving Recommended Treatments
Final Consultation Launched for Vyrnwy Frankton Power Line Project
Drug Misuse Deaths in Scotland Rise by 12% in 2023
Failed £100 Million Cocaine Smuggling Operation in the Scottish Highlands
Central Cee Equals MOBO Awards Record; Bashy and Ayra Starr Among Top Honorees
EastEnders: Four Decades of Challenging Social Norms
Jonathan Bailey Channels 'Succession' in Bold Richard II Performance
Northern Ireland's First Astronaut Engages in Rigorous Spacewalk Training
Former Postman Sentenced for Series of Sexual Offences in Northumberland
Record Surge in Anti-Muslim Hate Crimes Across the UK in 2024
Omagh Bombing Inquiry Concludes Commemorative Hearings with Survivor Testimonies
UK Government Introduces 'Ronan's Law' to Combat Online Knife Sales to Minors
Metal Detectorists Unearth 15th-Century Coin Hoard in Scottish Borders
Woman Charged in 1978 Death of Five-Year-Old Girl in South London
Expanding Sinkhole in Godstone, Surrey, Forces Evacuations and Road Closures
Bangor University Announces Plans to Cut 200 Jobs Amid £15 Million Savings Target
British Journalist Charlotte Peet Reported Missing in Brazil
UK Inflation Rises to 3% in January Amid Higher Food Prices and School Fees
Starmer Defends Zelensky Amidst Trump's 'Dictator' Allegation
Zelensky Calls on World Leaders to Back Peace Efforts in Light of Strains with Trump
UK Prime minister, Mr. Keir Starmer, has stated that any peace agreement aimed at ending the conflict in Ukraine "MUST" include a US security guarantee to deter Russian aggression
×