Skip to content
IFAI

Open source

Qualcomm's MobileWan puts 5B video generation directly on your phone

Published Reach 59

Qualcomm researchers just open-sourced MobileWan, compressing Alibaba's 5B-parameter video model to run entirely on commercial smartphones. By pruning attention heads and slashing diffusion to three steps, it generates a 5-second 480p clip in about 20 seconds without touching the cloud.

Image: youtube.com

MobileWan is an open-source video generation system from Qualcomm AI Research that lets you turn text prompts into clips directly on a commercial smartphone, without pinging a cloud GPU or burning through data.

Type in a prompt, and the phone spits out a 5-second video at 480x832 resolution and 16 frames per second in about 20 seconds. The entire project weighs in at just 9.9GB on Hugging Face, meaning it actually fits inside standard mobile storage.

How they crammed 5B parameters into a phone

Past attempts at on-device video generation usually capped model sizes at 0.4B to 1.8B parameters. The outputs looked like mush because tiny diffusion models simply lack the capacity for motion coherence. Qualcomm took a different route: start with Alibaba's server-scale Wan2.2-5B and perform aggressive surgery.

First, they ditched full-sequence processing. MobileWan breaks video generation into small chunks using a recurrent distillation framework combined with causal linear attention. At inference time, the model behaves like an RNN, keeping attention memory nearly constant while generating video chunk by chunk.

Second, they introduced learnable attention head pruning. Using binary per-head gates with sparsity regularization, they stripped out redundant attention heads across the diffusion transformer without crashing video quality.

Finally, they crushed the sampling steps. Standard video diffusion requires 20 to 30 denoising iterations. MobileWan slashes that down to just 3 steps via progressive distillation, pairing it with a memory-optimized VAE decoder. The whole pipeline clocks an 83.79 score on VBench, establishing a new state of the art for mobile video diffusion.

How to run it and what to watch out for

The team has released the code, model weights, and technical paper. If you head over to their project page and Hugging Face repository, you will find step-by-step instructions on setting up the environment and loading the 9.9GB bundle onto a supported mobile device.

Keep expectations realistic, though. Qualcomm points out that temporal consistency is not bulletproof yet. Fast camera pans or complex character motions can still trigger visual artifacts and warping between chunks.

Why it matters

MobileWan flips the conventional wisdom on edge AI. Instead of compromising on tiny, undercooked models for phones, Qualcomm proved you can distill a full-fat 5B server model down to consumer silicon.

For mobile app developers and creators, this offers a compelling preview of local generative video editing. Running in 20 seconds locally means zero cloud compute bills, zero latency overhead from network transfers, and total privacy for on-device video creation.

Sources (2)

  1. [1]
    qualcomm-ai-research.github.io(opens in a new tab)Originalqualcomm-ai-research.github.io
  2. [2]
    youtube.com(opens in a new tab)Reportyoutube.com

Similar events

Past happenings like this one, for context.

Best of AI, daily