Google Brings Real-Time Visual Assistance to Blind Users on Android

Google launched Guided Vision in Gemini Live on October 1, 2026, a real-time, voice-driven visual assistance feature built for people who are blind, have low vision, or want intuitive visual assistance. It is now available on Android devices running Android 9 and above in regions and languages where Gemini Live is supported.

Google first previewed the feature on September 1, 2026, in its September Android Drop, where Guided Vision was listed as coming soon to phones running Android 9 and above in countries where Gemini is available. That preview described the same camera-sharing descriptions and voice feedback for reframing, and carried a footnote cautioning that the feature can make mistakes and is not intended as a medical device, mobility aid, or substitute for safe-travel guides, nor for navigation or obstacle detection.

How Guided Vision Works

During a Gemini Live session, the user shares the phone’s camera and Gemini supplies spoken descriptions of the surroundings, answers detailed follow-up questions, and delivers proactive verbal cues to center whatever the user wants to explore. If the camera is pointed too high, too close, or slightly off to the side, Gemini responds with natural verbal prompts to reframe — asking the user to pan slowly to the right, tilt downward, or step back until it has the clear visual context it needs to answer.

The announcement, written by Isha Sheth, Senior Product Manager for Gemini Live, describes Guided Vision as turning Gemini into a conversational visual partner that fits into daily routines with minimal friction.

Developed With Aira and the Accessibility Community

Google said Guided Vision was developed through close collaboration with the accessibility community. To train Gemini Live for conversational, real-world context, the company partnered with Aira to visually interpret data for a total of tens of thousands of hours. More than 1,000 members of Aira’s Trusted Tester network helped stress-test and refine the model across daily routines, and Aira specialists worked directly with Google teams as subject-matter experts to establish and evaluate safety guardrails.

Sally Khoo, Deputy Director (Innovation) at SG Enable, said in the announcement: “As standard phones are typically built for sighted users who can see the screen, a product like Gemini Live’s real-time visual descriptions with proactive verbal camera guidance can help bridge a critical gap in everyday tasks at home, from reading fine print to locating daily essentials.”

According to Google, the feature reflects extensive testing and feedback from blind and low-vision communities across India, Brazil, Singapore, Indonesia, Japan, and more, gathered to make descriptions, reframing cues, and answers feel natural and helpful.

Prashant Verma of the National Association of the Blind, India, said in the same announcement: “Testing these capabilities directly with blind and low-vision users across Indian languages ensures this technology delivers dependable, practical assistance in everyday life.”

Documented Everyday Use Cases

Google described everyday tasks where quick visual verification matters most. For reading fine print and complex text, the company listed small nutrition labels on food packages, appliance dials and washing machine cycles, and printed menus in dimly lit restaurants. For finding and localizing objects, it gave the examples of a dropped earbud on the floor and the black pepper inside a crowded spice cabinet. For describing objects and matching details, users can ask about colors, patterns, and shapes, such as checking whether a striped shirt pairs with a pair of trousers or identifying the color of a specific jacket. For exploring the immediate environment, Guided Vision returns descriptive overviews of unfamiliar spaces, room layouts, or objects placed across a table.

Google said Guided Vision supports conversations across multiple languages and that, like many accessibility innovations, it also provides practical visual assistance for older adults, individuals with low literacy, or anyone trying to read fine print in low lighting.

Access Paths, Availability and Stated Limitations

Users can reach the feature through the Gemini app, an Android Accessibility shortcut, or Google TalkBack. In the Gemini mobile app, users open profile settings and switch on “Use Guided Vision in Live,” then open Gemini Live and tap to share the camera. Under Android Settings, within Accessibility and then Vision assistance, users can configure an Accessibility shortcut to launch Guided Vision using the floating accessibility button, a two-finger swipe gesture, or by pressing both volume keys. Users running Google TalkBack can bring up the TalkBack menu with a three-finger tap and select Guided Vision directly.

Google states that Guided Vision is an assistive utility and can make mistakes. The feature is not a medical device, mobility aid, or white cane replacement, and it is not intended for navigation, safe-travel guidance, or obstacle detection. Users should continue relying on established mobility aids and safe-travel practices in physical environments.

To get started, Google advises updating the Gemini app and Android system software to the latest versions.