Skip to content
IFAI

AI models

Google supercharges Gemini audio for live agents and earbuds translation

Published Reach 51

Google just updated its Gemini 2.5 Flash Native Audio model to make real-time voice agents significantly better at multi-turn conversations and function calling. The tech also lands in the Google Translate app with a live speech-to-speech beta that streams translated audio straight into your headphones while keeping your natural tone and pitch.

Google supercharges Gemini audio for live agents and earbuds translation
Image: blog.google

The awkward pause of holding a phone between two people waiting for a robotic text-to-speech translator might finally be on its way out.

Google just rolled out an upgraded version of its Gemini 2.5 Flash Native Audio model, bringing real-time, speech-to-speech translation straight to your everyday headphones through the Google Translate app.

Real-time translation that keeps your tone

The marquee consumer update here is live speech translation, now rolling out in beta within Google Translate.

Instead of the clunky pipeline that converts speech to text, translates the text, and reads it back, Gemini processes audio natively. That allows it to preserve the speaker's original intonation, pitch, and pacing in real time.

It works in two distinct ways. Continuous listening lets you put in any pair of headphones and hear multilingual ambient speech translated into your chosen language on the fly. In two-way conversation mode, you hear translations in your ear while your phone broadcasts your translated reply out loud.

The feature handles over 70 languages and 2,000 language pairs, filters ambient noise, and auto-detects what is being spoken. It is currently rolling out on Android in the US, Mexico, and India, with iOS and additional regions slated for 2026.

Alongside the audio push, Google Translate is also upgrading its core text translations using Gemini to better parse idioms like "stealing my thunder" across nearly 20 languages, while expanding its in-app language learning drills to new regions.

Sharper ears for voice agents

For builders, Gemini 2.5 Flash Native Audio is aimed squarely at making voice agents reliable enough for production work.

Google reported that instruction adherence climbed from 84% to 90%, with multi-turn conversation context seeing noticeable gains. On ComplexFuncBench Audio, a benchmark testing multi-step tool use under constraints, the model notched a leading 71.5% score.

Enterprise adopters are already sharing real numbers. United Wholesale Mortgage said integrating the model helped generate over 14,000 loans through its broker platform. Shopify noted that users chatting with its Sidekick merchant assistant often forget they are speaking to AI within sixty seconds.

The model is generally available on Vertex AI, in preview on the Gemini API and Google AI Studio, and is currently rolling out into Gemini Live and Search Live.

Why it matters

We think this is one of Google's smartest deployments of native multimodal AI to date.

Rather than locking advanced voice features behind expensive dedicated hardware or obscure developer sandboxes, Google is putting end-to-end speech translation inside an app hundreds of millions of people already have installed, working with whatever headphones they already own. If you travel internationally or consume foreign lectures, this could turn your phone into a genuinely seamless personal interpreter.

For the broader industry, this raises the bar for interactive voice agents. Moving from chained transcription pipelines to native audio reduces latency and preserves emotional context, an area where OpenAI's Advanced Voice Mode has dominated mindshare.

That said, the rollout is distinctly cautious. Limiting the initial headphone beta to Android across just three countries means most of the world will have to wait until 2026 to see if native audio truly holds up in chaotic, real-world noise.

Sources (2)

  1. [1]
    blog.google(opens in a new tab)Originalblog.google
  2. [2]
    blog.google(opens in a new tab)Reportblog.google

Best of AI, daily