Google launches Guided Vision in Gemini Live for low vision users
Google has launched Guided Vision in Gemini Live on compatible Android devices to provide real-time AI audio descriptions, fine print reading, and object identification.
Stock photo for illustration only, not from the actual event
- Google is launching Guided Vision in Gemini Live on compatible Android devices today.
- The feature uses AI to provide real-time audio descriptions of surroundings and small text.
- Users can ask follow-up questions about the objects and text captured by the phone camera.
- Google cautions that the tool is not a replacement for mobility aids or navigation.
Google has officially rolled out a new feature named Guided Vision, integrated into Gemini Live on compatible Android devices. This tool leverages artificial intelligence to deliver real-time audio descriptions of anything users point their smartphone cameras at, providing a new layer of visual assistance.
By sharing the camera within Gemini Live, Google's AI assists with everyday tasks such as reading fine print, describing surrounding environments, locating or identifying nearby items, and detailing specific objects. The launch was detailed in a report by tech writer Stevie Bonifield from The Verge.
Stock photo for illustration only, not from the actual event
Similar to the VoiceOver Live Recognition feature introduced by Apple for the iPhone and Vision Pro, this capability is tailored for individuals who are blind, experience low vision, or require targeted assistance in specific scenarios. Alongside the Gemini app, Guided Vision is also integrated into Google TalkBack, and users can establish an accessibility shortcut via the Settings app on devices running Android 9 and newer, following its recent announcement in a Pixel update bundle.
Integrating generative AI models directly with live camera feeds represents a major leap in digital accessibility, bridging the gap for visually impaired users by translating small text and physical surroundings into natural audio. This reflects a broader industry trend where tech giants prioritize practical, assistive AI applications that function seamlessly on consumer hardware.
Users also have the flexibility to ask follow-up questions regarding whatever is in view, such as instructing Gemini to read out the expiration date on a located item. Google notes that the system provides audio cues to help users align their camera if the target subject falls outside the current frame.
Despite its capabilities, Google explicitly cautions users against relying on Guided Vision for critical tasks such as navigation, safe-travel guidance, obstacle detection, or as a substitute for a cane or physical mobility aid.
Source: The Verge
Found something wrong in this article? Report an issue with this article
Comments
Leave a Comment