Google launches Guided Vision to help blind and low-vision users

Google has begun rolling out a new feature called Guided Vision on compatible Android devices through the Gemini Live app. The feature uses artificial intelligence to provide real-time audio descriptions of anything a user points their phone's camera at.

By sharing their camera feed within Gemini Live, users can get AI assistance with tasks such as reading small text, describing their surroundings, finding or identifying objects, and getting detailed descriptions of specific items.

Built for people with vision impairments

The feature is similar to Apple's VoiceOver Live Recognition, already available on iPhone and Vision Pro devices. Guided Vision is designed for people who are blind, have low vision, or simply want assistance in certain situations.

Beyond the Gemini app, the feature is also available through Google TalkBack. Users running Android 9 or later can additionally set up an accessibility shortcut for it in their device settings. Guided Vision was previously mentioned as part of a recent set of Pixel software updates.

Follow-up questions supported

Users can ask Gemini follow-up questions about whatever is in view, such as having it read out an expiration date on an item it just helped locate. If a user asks about something outside the camera's frame, Gemini provides audio cues to help them reposition the camera correctly.

Google has cautioned, however, that Guided Vision should not be relied upon for navigation, safe-travel guidance, or obstacle detection, nor should it be treated as a substitute for a cane or other mobility aid.