Google’s new Guided Vision feature can help you read the fine print

AI assistance for reading fine print and identifying objects is now available on your Android phone for free.

Google has launched Guided Vision, an AI-powered feature integrated into Gemini Live on compatible Android devices. This new tool uses the phone's camera to provide real-time audio descriptions of the environment. Users can point their camera at objects or text, and Gemini will offer assistance such as reading small print, describing surroundings, identifying items, and detailing specific objects. The feature is designed to aid individuals who are blind, have low vision, or require situational assistance. Guided Vision is accessible through the Gemini app, Google's TalkBack screen reader, or an accessibility shortcut in the Settings app for devices running Android 9 and newer. Users can also ask follow-up questions about what they are viewing, and Gemini will provide audio cues to help align the camera for optimal results. Google advises against using Guided Vision for critical tasks like navigation or obstacle detection.

The introduction of Guided Vision signifies Google's continued investment in leveraging AI for accessibility, directly competing with features like Apple's VoiceOver Live Recognition. By integrating this capability into Gemini Live, Google aims to make AI assistance more contextually relevant and readily available for everyday tasks, particularly for users with visual impairments. This move expands the practical applications of generative AI beyond typical text and image generation into real-world object and text recognition with immediate audio feedback.

This feature's availability across a range of Android devices, including through TalkBack and an accessibility shortcut, broadens its potential reach. It democratizes access to advanced visual assistance tools, potentially reducing reliance on specialized hardware or more limited assistive technologies. The ability to ask follow-up questions enhances its utility, turning a simple description tool into an interactive assistant for understanding the immediate environment.