Google is expanding Gemini’s role across Android devices with a series of new AI-powered tools designed to handle tasks more directly inside apps, browsers, and system features.

Ahead of its I/O developer conference, the company unveiled a broader initiative called Gemini Intelligence, a collection of advanced Gemini capabilities expected to appear first on premium Android smartphones such as upcoming Galaxy and Pixel devices.

One of the major upgrades is expanded multimodal support. Previously, Gemini mainly relied on voice or text prompts, but users will now be able to include screenshots and photos when interacting with the assistant. Google demonstrated examples such as uploading a screenshot of a grocery list and having Gemini automatically add those items into a shopping cart.

Google is also introducing a feature called Create My Widget, which allows users to generate customised home screen widgets using natural language prompts. Instead of manually building layouts, users can describe the information they want displayed, such as cycling weather conditions or weekly meal-planning suggestions, and Gemini will generate a widget automatically. The widgets will also work on Wear OS smartwatches.

The company says the feature represents an early step towards what it describes as “generative UI”, where software interfaces adapt dynamically based on user requests.

Gemini is also becoming more integrated with Chrome on Android. A new Gemini button inside the browser will allow users to ask questions about webpages directly without leaving Chrome. Subscribers to Google’s AI Pro and AI Ultra plans will additionally gain access to an “auto browse” function capable of carrying out online tasks such as booking appointments.

Another upcoming addition involves Android’s autofill system. Users will have the option to let Gemini assist with filling forms by accessing information linked through Google services including Gmail and Google Photos. In practical terms, this could allow the assistant to retrieve details such as vehicle registration numbers stored in photos or emails.

Google says the new Gemini Intelligence features will roll out gradually throughout the year, with flagship Samsung Galaxy and Google Pixel devices expected to receive updates first during the northern hemisphere summer.