Skip to content
IFAI

Open source

SolarWM turns video models into hour-long interactive worlds

Published Reach 48

Researchers just open-sourced SolarWM, a world model framework that turns video generators into real-time interactive worlds lasting over an hour. Trained on five-second clips, it keeps environments coherent across long rollouts and fully opens a 25 TB dataset alongside recipes for models like Wan and Minimax H3.

SolarWM turns video models into hour-long interactive worlds
Image: junchao-cs.github.io

SolarWM is a new open-source framework that turns video generators into real-time interactive worlds you can actually explore for an hour without the scene falling apart.

What it does

Most interactive world models suffer from rapid hallucination. They feel responsive for the first two or three minutes, but error accumulation quickly turns the environment into incoherent soup.

SolarWM tackles that horizon bottleneck directly. It enables real-time, responsive interaction with continuous rollout that stays structurally coherent at minute scale and beyond an hour.

Instead of building a walled garden, the researchers designed a unified framework that plugs into multiple video backbones. It already supports architectures across different scales, including SolarWM-Wan-5B, SolarWM-Wan-14B, SolarWM-LTX-2.5, and Minimax H3.

On the efficiency side, their demo shows a SolarWM-Wan-5B causal student model delivering real-time output in just 4 sampling steps.

How it works and what is released

Surprisingly, SolarWM did not train on massive hour-long recordings. The model was trained entirely on 5-second video clips, yet successfully learned to sustain consistent scene physics and camera logic over extended rollouts.

Even better, the release is genuinely comprehensive. The team made their entire data engine public, sharing 1.43 million video clips amounting to 25 TB of data.

Along with the raw data, they released scale-consistent camera annotations, fine-grained filtering tools, multiple training recipes, and ready-to-run checkpoints on their project portal.

Anyone looking to train or tinker can download the data pipeline and pretrained models directly from the project site.

Why it matters

If you build simulation environments, autonomous agent sandboxes, or procedural game worlds, SolarWM is a massive gift. A clean 25 TB dataset with calibrated camera parameters saves teams months of tedious data prep.

More importantly, proving that 5-second training clips can power hour-long coherent rollout shifts the economics of building world models. It lowers the barrier for smaller labs to compete with frontier gaming engines.

Keep in mind that hosting and processing 25 TB is still a hefty infrastructure hurdle, and real-time inference on the larger backbones will still demand serious GPU iron.

Sources (1)

  1. [1]
    junchao-cs.github.io(opens in a new tab)Originaljunchao-cs.github.io

Similar events

Past happenings like this one, for context.

Best of AI, daily