Skip to content
IFAI

AI tools

Meta AI can now dub Reels into new languages with lip sync

Published Reach 35

Meta just expanded its AI translation tools for Reels, adding voice dubbing and lip syncing in Hindi and Portuguese alongside English and Spanish. The tool clones the creator's voice and mimics their mouth movements in the translated language. It's completely free for public Instagram accounts and Facebook creators with over 1,000 followers.

Meta AI can now dub Reels into new languages with lip sync
Image: about.fb.com

Language barriers have always been the quickest way to kill a short-form video's virality across borders. Meta is trying to fix that for good.

Meta rolled out an AI-powered translation and dubbing tool for Reels on Instagram and Facebook that translates what you say, clones your voice tone, and can even tweak your mouth movements to match the translated words.

It is completely free to use. Any public Instagram account in regions where Meta AI is active can tap into it, while Facebook creators need at least 1,000 followers to get access.

Your voice, their language, matching lips

Instead of overlaying a robotic text-to-speech voiceover, Meta AI mimics the original creator's vocal tone and rhythm. The goal is to make the dub feel like the creator actually recorded the video in another language.

Creators can also toggle on an optional lip-syncing feature. The model adjusts the creator's mouth movements in the video frame so the visuals line up with the cadence of the new audio track.

After starting with bidirectional English and Spanish, Meta added Hindi and Portuguese to bridge some of its largest Reels markets across the Americas and South Asia. The company later expanded support to several regional Indian languages like Bengali, Tamil, and Telugu, alongside global languages including French, German, Italian, Japanese, Korean, Arabic, and Vietnamese.

To keep viewers in the loop, every translated clip gets a visible Translated with Meta AI badge. Viewers who prefer the raw footage can simply tap the three-dot menu and turn off translations to hear the original audio.

Why it matters

For independent creators, this removes one of the most expensive barriers to going global. Hiring professional dubbing studios or managing multilingual voice tracks used to be a luxury reserved for top-tier YouTubers. Meta giving voice-cloned dubbing and lip syncing away for free inside the creator flow fundamentally changes the math for cross-border reach.

From a platform perspective, Meta is unlocking massive value from existing inventory. Reels that already proved their appeal in one market can now circulate across Latin America, South Asia, and beyond without losing viewer retention to awkward subtitles. It puts serious pressure on TikTok and YouTube Shorts to integrate comparable, frictionless dubbing suites directly into their mobile upload flows.

That said, we think the line between seamless translation and uncanny valley remains paper-thin. Rewriting a creator's mouth movements and cloning their exact timbre opens up real risks around subtle mistranslations, especially when creators discuss sensitive topics or specific advice. Meta's disclaimer tag is a necessary baseline, but managing the fidelity of meaning across dozens of colloquial dialects will be the real test.

Sources (2)

  1. [1]
    about.fb.com(opens in a new tab)Originalabout.fb.com
  2. [2]
    about.fb.com(opens in a new tab)Reportabout.fb.com

Best of AI, daily