Meta brings real-time AI video to smart glasses

Meta is quietly pulling off what OpenAI and Google have mostly just showed in flashy demos: putting live, multimodal AI onto actual hardware that people already wear.

On Monday, Meta began rolling out firmware v11 to Ray-Ban Meta smart glasses owners enrolled in its early access program across the U.S. and Canada. The headline feature is "live AI," an upgrade that brings real-time video processing and continuous voice conversation to the frames.

Seeing what you see, without the wakewords

Until now, chatting with Meta AI on the glasses felt like using an old-school walkie-talkie. You had to say "Hey, Meta" before every single question and wait for a response.

With firmware v11, wearers can talk to Meta AI continuously. You can reference things discussed earlier, interrupt the assistant mid-sentence to ask a follow-up, or abruptly shift topics, all without repeating a wakeword.

Even better, the AI hooks directly into the front-facing camera. Wearers can ask questions about their immediate surroundings in real time, like asking what neighborhood spot they are walking past. Meta even teased that live AI will eventually offer "useful suggestions" proactively before you ask, though it declined to say what those look like.

Firmware v11 also packs live translation, translating real-time speech between English and Spanish, French, or Italian. Foreign speech gets translated to English through the open-ear speakers, accompanied by a transcript on your phone. Plus, there is now Shazam integration for quick music identification.

Why it matters

Google showed off similar continuous vision and voice with Project Astra, and OpenAI has its Advanced Voice Mode with Vision, but Meta just beat both to consumer faces. Google says it plans to release AR glasses with these capabilities down the line, but has not committed to any actual timeline. Meta, meanwhile, already has hardware in the wild that people actually buy.

And those glasses are selling. In October, Ray-Ban owner EssilorLuxottica revealed that the frames were the top-selling product across 60% of Ray-Ban stores in Europe, the Middle East, and Africa.

We think this firmware update represents a critical shift from gimmick to utility. An AI assistant trapped in a phone app requires pulling the device out and pointing the camera; on your face, it is ambient and natural.

That said, there are real hurdles ahead. Meta openly warns that live AI and live translation will make mistakes. Pushing continuous video and audio processing through tiny batteries and thermal-constrained frames is brutal engineering. Still, Meta just claimed high ground in the race for wearable AI by shipping real software to real users first.