Google is adding a number of new features to Gemini Live, its AI assistant that stands out with its real-time conversational capabilities. These improvements significantly enhance user interaction, both visually and app-based. These innovations will debut on Pixel 10 phones and will be available on other devices later.

Gemini Live Offers New Features

The most notable feature is the ability to highlight specific objects with the camera. If you’re trying to find the right tool for a project, simply point your phone’s camera at the tools and Gemini Live will highlight the tool you’re looking for directly on the screen.

This feature will first be available on Pixel 10 devices, which will be unveiled on August 28th. Google is preparing to expand the visual guidance feature to other Android devices on a similar date and bring it to iOS within a few weeks.

Gemini Live now interacts with the Messages, Phone, and Clock apps. If you realize you’re running late during a directions conversation, Gemini can text your friend to let them know you’ll be a few minutes late.

Google has also introduced an improved voice model for Gemini Live. The company announced that the new model will better utilize rhythm and intonation, the fundamental elements of human speech. This allows Gemini to change its tone of voice based on the topic of conversation.

Users can also adjust Gemini’s speaking rate. When you ask it to tell a story from the perspective of a specific character or historical figure, the assistant even uses accents for rich and engaging narration.