Google teases its answer to GPT-4o ahead of I/O
Google just dropped a teaser for an unreleased multimodal AI interface running on Android, right after OpenAI launched GPT-4o. The video shows the assistant using a phone's camera to understand its surroundings in real time and answer questions about the Google I/O stage setup. OpenAI may have had the spotlight for only 24 hours, though real-world performance remains to be seen at the keynote.
OpenAI held the crown for real-time multimodal AI for about twelve hours.
Just ahead of its annual I/O 2024 conference, Google posted a teaser on X showing off an unreleased multimodal AI interface running live on an Android phone.
A camera-first assistant on Android
The short demo video looks visually similar to the Pixel Camera app.
In the clip, someone points the phone's camera at an active construction site, which turns out to be the Google I/O stage. The AI assistant instantly recognizes that an event setup is underway.
It then spots the Google I/O wordmark, connects the dots, and explains the details of the developer conference out loud.
Gemini could already handle voice inputs, photos, and screenshots. What is new here is continuous, live visual understanding through the camera viewfinder, paired with fluid voice conversation.
It is the exact vision that hardware startups like Humane with the AI Pin and Rabbit with the R1 promised, but running directly on a standard smartphone.
Google has not confirmed whether this experience will live inside the Gemini app, debut as a standalone tool, or eventually replace Google Assistant. Since this is a pre-recorded demo, real-world latency remains to be verified.
Why it matters
Google clearly could not let OpenAI own the news cycle with GPT-4o, and this teaser confirms where mobile assistants are headed.
For everyday users, this shift removes the friction of taking a photo, opening a chatbot, and typing a question. You just point your phone and talk. If Google delivers this seamlessly across Android, it effectively eliminates the need for standalone wearable AI gadgets.
For the industry, the battleground has shifted from raw text benchmarks to real-time multimodal latency. OpenAI has the conversational lead, but Google owns the operating system and camera hardware in billions of pockets.
Still, we think healthy skepticism is warranted. Both Google and OpenAI are showing heavily curated demos. Handling continuous video feeds and voice synthesis without melting your phone or draining the battery in an hour is an engineering hurdle neither has publicly solved yet.
Sources (1)
- androidcentral.com(opens in a new tab)Originalandroidcentral.com