Here’s how to ask Gemini Live for help with anything you see.
Google’s Gemini app now lets users point their camera or share their screen to receive real-time assistance with tasks or objects in view, expanding hands-free support beyond text queries.
The useful question is what changes for users, developers or buyers, and whether the announcement stays industry context or becomes something people can actually use.
Google has introduced a new feature in its Gemini app that allows users to use their device’s camera to seek help with objects or tasks they encounter in real time. By tapping the Live icon and selecting the camera, users can point their lens at items like manuals, error codes, or household objects to receive step-by-step guidance. The tool aims to simplify complex tasks by providing visual context, reducing the need for lengthy verbal descriptions. This update is part of Google’s effort to integrate AI assistance more deeply into everyday activities.
The feature also supports screen sharing, enabling users to get help navigating confusing apps or interfaces by showing Gemini exactly what they see on their screen. This expands the app’s utility beyond physical objects to digital environments, offering tailored support for software-related challenges. The screen-sharing function is designed to assist with tasks like troubleshooting, learning new tools, or optimizing workflows. Google positions this as a way to bridge gaps in user understanding without requiring technical expertise.
Gemini Live now includes creative assistance, allowing users to brainstorm ideas or receive personalized advice based on visual input. For example, pointing the camera at a room could generate decor suggestions, while scanning items while shopping might provide product recommendations or comparisons. The feature leverages the app’s multimodal capabilities to offer context-aware suggestions, blending practical help with creative exploration. Google highlights this as a way to make AI assistance more interactive and adaptable to individual needs.
The update is available to users of the Gemini app, which integrates with Google’s broader ecosystem of AI tools. While the feature is accessible to a wide range of users, it requires a compatible device and an active internet connection to function in real time. Google has not specified additional costs for this functionality, positioning it as an enhancement to the existing free tier of the app. The company frames this as part of its ongoing efforts to make AI more accessible and useful in daily life.