H3 World: Turn open-source video models into playable worlds
H3 World just turned the open-source Miniax H3 video generator into an interactive game engine. Instead of building a complex control rig, it simply translates keystrokes into short text prompts that guide the video's motion in real time. The project code, local setup instructions, and training scripts are now fully open-sourced.

H3 World is a new open-source project that turns the Miniax H3 video generation model into a playable, interactive game engine.
You basically feed it an initial prompt alongside regular keyboard inputs, and it generates video that follows your keystrokes in real time, making it feel like you are actually navigating a virtual world.
How it works
The clever part here is that the creators didn't bother building an entirely new control rig or physics system from scratch.
Instead, H3 World takes a delightfully simple shortcut: it translates your keystrokes into concise English descriptions, which are then passed directly into Miniax H3's existing language understanding layer.
From there, it ties each command to the exact area of the video frame where that movement is supposed to occur. The underlying video model simply thinks it is following instructions, but the end result is a responsive playable loop.
What is released and where to try it
This is not a closed demo or a research teaser. The team has already released the project publicly on GitHub.
The repository includes detailed, step-by-step instructions on how to download and run the setup locally on your own machine.
Even better, they packaged and open-sourced the training scripts as well. Anyone with enough curiosity and computing power can inspect the pipeline or fine-tune it further.
Why it matters
Interactive video generation is moving fast, and H3 World offers a great lesson in architectural pragmatism.
Instead of burning massive compute to retrain giant models with custom inputs, piggybacking on existing text-conditioning layers gets you surprisingly far. It proves that open-source video models already harbor interactive potential waiting to be tapped.
For indie builders and generative media researchers, this is definitely worth cloning to test local latency and control limits. The open training script alone makes it a fantastic starting template for the next wave of neural game prototypes.
Sources (2)
- danzer1xxxxchan.github.io(opens in a new tab)Originaldanzer1xxxxchan.github.io
- youtube.com(opens in a new tab)Reportyoutube.com