Google officially launched “Search Live,” a new AI Mode feature, in the US today, with support for voice and video input. Powered by Project Astra, this new feature allows users to access real-time information both by speaking and using their cameras. Here are the details.

How does Google Search Live work?

Tapping the “Live” icon next to the “AI Mode” tab at the top of the Google app takes you to a full-screen interface. This interface displays an arc-shaped waveform when you speak, or a valley-shaped waveform when Google responds.

Shiftdelete.net

You can mute the microphone with the controls at the bottom of the screen, or activate the camera by selecting “Video.” The “Transcript” option displays a written transcript of the conversation. Additionally, while in an existing chat, the Live icon is next to the prompt box.

Another way to access this new AI experience is through the Google Lens app, where the “Live” tab appears next to the “Search” and “Translate” options.

This feature, which began testing in July and is now widely available, stands out particularly for camera use cases. Google highlights how Search Live can help with things like learning a new hobby or setting up electronic devices:

• Learning a New Skill: When you’re learning a new skill, like making the perfect matcha, Search Live acts as your own expert advisor. You can point your camera at the equipment in your matcha kit and ask what each tool does. Or, if you’re looking for low-sugar or dairy-free alternatives to your matcha latte, you can get quick advice.
• Electronics Setup and Troubleshooting: If you’re struggling to set up a home theater system (or other electronic device), Search Live can help you step-by-step. Just point your camera and ask, “Which cable goes where?” There’s no need to manually type in your TV’s brand and model or search for different cable types. Search interprets the entire visual context to provide you with the information you’re looking for, and you can ask additional questions or browse related websites if you wish.

Web results appear in a slider above the three buttons below. You can use the ‘x’ icon in the upper right corner to exit the screen.