Guided Vision in Gemini Live: built for accessibility

Guided Vision in Gemini Live: built for accessibility Oct 01, 2026 | x.com Facebook LinkedIn Mail Copy link Built alongside the blind and low-vision community, Guided Vision in Gemini Live offers conversational, real-time visual assistance. Share your camera to receive dynamic audio descriptions and natural verbal reframing cues to explore your environment. Isha Sheth Senior Product Manager, Gemini Live Share x.com Facebook LinkedIn Mail Copy link Today, we’re launching Guided Vision in Gemini Live across compatible Android devices — bringing voice-forward, real-time visual interpretation to people who are blind, have low vision, or want intuitive visual assistance. Technology is most powerful when it opens up the world for everyone, and Guided Vision turns Gemini into a conversational visual partner. Guided Vision was developed through close collaboration with the accessibility community. We previewed it earlier this month, among other tools to expand digital and physical accessibility across Android, To train Gemini Live for conversational, real-world context, we partnered with Aira to visually interpret data for a total of tens of thousands of hours. More than 1,000 members of Aira’s Trusted Tester network helped stress-test and refine the model across daily routines, while Aira specialists worked directly with our teams as subject-matter experts to help establish and evaluate our safety guardrails. Now, you can simply share your camera during a Gemini Live session to hear clear descriptions of your surroundings, ask detailed follow-up questions, and receive proactive, spoken cues to center whatever you want to explore. Real-time visual assistance designed for how you experience the world When you share your camera in Gemini Live with Guided Vision turned on, Gemini acts as a conversational partner. If your camera is pointed too high, too close, or slightly off to the side, Gemini provides natural verbal prompts to help you reframe — asking you to pan slowly to the right, tilt downward, or step back so it can get the clear visual context needed to answer your questions. Everyday moments made simple Whether locating objects, preparing a meal, or picking an outfit, Guided Vision supports everyday tasks where quick visual verification matters most: Reading fine print and complex text : Read small nutrition labels on food packages, decipher appliance dials and washing machine cycles, or read printed menus in dimly lit restaurants. Finding and localizing objects: Search your immediate area for everyday items, such as finding a dropped earbud on the floor or locating the black pepper inside a crowded spice cabinet. Describing objects and matching details: Ask about colors, patterns, and shapes — such as checking whether a striped shirt pairs with a pair of trousers or identifying the color of a specific jacket. Exploring your immediate environment : Get descriptive overviews of unfamiliar spaces, room layouts, or objects placed across a table. Conversing naturally in your preferred language: Guided Vision supports conversations across multiple languages. It reflects extensive testing and feedback from blind and low-vision communities across India, Brazil, Singapore, Indonesia, Japan, and more to make descriptions, reframing cues, and answers feel natural and helpful. Like many accessibility innovations, Guided Vision also provides practical visual assistance for older adults, individuals with low literacy, or anyone trying to read fine print in low lighting. Quick access across Android Guided Vision is designed to fit seamlessly into daily routines with minimal friction: Gemini App : Open your profile settings in the Gemini mobile app and switch on Use Guided Vision in Live . From there, open Gemini Live and tap to share your camera. Accessibility Shortcuts : Under Android Settings > Accessibility > Vision assistance > Guided Vision, configure an Accessibility shortcut to launch Guided Vision using the floating accessibility button, a two-finger swipe gesture, or by pressing both volume keys. TalkBack Integration : Users running Google TalkBack can bring up the TalkBack menu with a three-finger tap and select Guided Vision directly. As with any generative AI technology, Guided Vision is an assistive utility and can make mistakes. It is not a medical device, mobility aid, or white cane replacement, and it’s not intended for navigation, safe-travel guidance, or obstacle detection. Users should continue relying on established mobility aids and safe-travel practices in physical environments. Guided Vision is now available on Android devices running Android 9 and above in regions and languages where Gemini Live is supported. Make sure your Gemini app and Android system software are updated to the latest versions to get started. Get the latest news from Google in your inbox Sign up for our newsletters with product updates, event information, special offers, and more. Done. Just one step more. Check your inbox to confirm your subscription. You can also subscribe with a different email address . Your information will be used in accordance with Google's privacy policy. You may opt out at any time. Posted in: Related stories Gemini App A new wave of Connected Apps is rolling out to Gemini. By Mai Lowe Gemini App 4 ways to tackle household chores with Gemini By Sarah Armstrong Gemini App The Gemini app is now available for Windows By Erin Pettigrew Gemini App Create your best tracks yet with Lyria 3.5 in Gemini. AI The latest AI news we announced in August 2026 By News from Google Team Gemini App Turn your voice into action with new productivity features in Gemini Live By Neel Joshi — Company newsroom — sourced from Google. Matter furnished by the company. Not a Notice Nearby paid placement. This page reprints matter furnished by the company from its official newsroom. Notice Nearby did not write this release. Read the original: https://blog.google/innovation-and-ai/products/gemini-app/guided-vision-gemini-live