Guided Vision launches today in Gemini Live on supported Android devices to use AI to provide real-time audio descriptions of anything you point your phone’s camera at. By sharing your camera in Gemini Live, you can get help from Google AI with things like reading small text, describing your surroundings, finding or identifying objects around you, and describing details about specific objects.
Like the VoiceOver Live Recognition feature that Apple has added to the iPhone and Vision Pro, it is designed for people who are blind, have low vision, or want help in specific situations. In addition to the Gemini app, Guided Vision is also available on Google TalkBack, or users can set up an accessibility shortcut in the Settings app on devices running Android 9 and above, after it was announced in a recent set of Pixel updates.
You can also ask follow-up questions about whatever you’re looking at, like asking Gemini to read the expiration date on an item they helped you find. Google says Gemini will give you audio cues to help you align your camera if you ask about something that’s not in the shot. However, Google warns users not to rely on Guided Vision for things like “navigation, safe travel guidance, or obstacle detection,” or as a replacement for a cane or mobility aid.
