Skip to content
IFAI

Generative media

ByteDance's X-Portrait 2 turns still photos into Hollywood-grade acting

Published Reach 31

ByteDance just unveiled X-Portrait 2, an AI model that transforms a single still portrait into a remarkably nuanced video performance mimicking famous movie scenes. Instead of relying on dot-tracking, it captures fluid facial muscle movements directly. The company is keeping the tech private over deepfake concerns.

ByteDance's X-Portrait 2 turns still photos into Hollywood-grade acting
Image: venturebeat.com

Give the AI a selfie, feed it a movie clip, and watch your photo scream with the exact same terror as Jack Nicholson in The Shining.

ByteDance has introduced X-Portrait 2, an AI system that breathes movie-grade emotional performance into any still portrait. In official demos, single photographs flawlessly act out scenes from films like Face Off, Fences, and The Shining, matching every twitch of fear, rage, and joy from trained Hollywood actors while keeping the original person's identity intact.

Ditching the dots for fluid motion

Old-school facial animation software has always relied on facial landmarks. Basically, engineers pin dozens of tracking dots to a face and pull on them like puppeteer strings, which is why older tools look so stiff and unnatural the second someone talks fast or turns their head.

X-Portrait 2 takes a totally different route. Instead of connecting dots, the system learns and observes the fluid motion of entire facial muscle groups as an interconnected whole. It holds up under sharp camera angles, rapid speech, and wild lighting.

Even better, the system generalizes beyond regular photos. It can drive stylized anime sketches and painterly portraits with the exact same expressive nuance.

ByteDance has a huge structural advantage here: TikTok. With more than one billion user-generated videos passing through its servers every day, the company sits on the world's most diverse real-world dataset of human faces, lighting setups, and camera angles. While Western competitors rely on scarce public sets or synthetic data, ByteDance feeds its models on real human behavior.

Keeping the gates shut amid global push

Interestingly, ByteDance is keeping X-Portrait 2 completely private. There is no open-source release and no public playground yet. With intense scrutiny over digital misinformation in the wake of the U.S. election, dropping a photorealistic portrait animator onto GitHub would have been a PR nightmare.

ByteDance is also busy expanding its AI footprint far beyond China. The company is setting up European research hubs across Switzerland, the UK, and France, while investing $2.13 billion into a data hub in Malaysia and partnering with Tsinghua University.

All of this comes against a backdrop of tight western regulations, including Canada's recent order for TikTok to shut down its local operations, alongside internal security headaches like the dismissal of an intern in October who allegedly tampered with model training.

Why it matters

While OpenAI and Anthropic are busy racing for artificial general intelligence through text and code, ByteDance is carving out an entirely different moat. They understand how humans move on camera better than anyone else on Earth.

For the film and gaming industries, this could be massive. Studios currently spend millions of dollars on elaborate motion-capture rigs and armies of clean-up animators just to get nuanced facial expressions on a 3D model. X-Portrait 2 suggests that high-end facial capture might soon require nothing more than a smartphone reference video and a single picture.

Keeping the code under wraps is a smart defensive move, but it also means everyday creators cannot touch it yet. We think ByteDance will likely bake this tech directly into CapCut and TikTok as exclusive creative filters or controlled enterprise tooling. Still, the risk of abuse is enormous. When a single static picture can convincingly weep, scream, or confess on command, verifying reality in video is about to get a whole lot harder.

Sources (1)

  1. [1]
    venturebeat.com(opens in a new tab)Originalventurebeat.com

Topic trackerByteDance's development of generative video models to compete with Sora

Every story on this topic, newest first.

  1. ByteDance's X-Portrait 2 turns still photos into Hollywood-grade actingThis story
  2. ByteDance's new video AI tackles multi-shot consistency
  3. ByteDance drops Jimeng AI to take on Sora

Best of AI, daily