Skip to content
IFAI

Open source

SenseTime's code-driven video model lets you edit individual elements

Published Reach 59

SenseTime just open-sourced SenseNova 6.8 Code2Video, a model that builds animations by generating executable code rather than diffusion sampling. Because every element is defined in code, you can tweak text, timing, or trajectories without re-rolling the entire clip. The 27B model weighs 55GB and requires a high-end GPU to run.

SenseTime's code-driven video model lets you edit individual elements
Image: github.com

Anyone who has wrestled with AI video knows the pain of the slot machine. The lighting looks gorgeous, the motion is smooth, but a piece of text in the corner is complete gibberish. If you want to fix that single typo, your only option is to rewrite the prompt, re-roll the whole clip, and watch every good frame disappear into the black box.

SenseTime is proposing an escape hatch. On October 24, the company open-sourced SenseNova 6.8 Code-to-Video, also known as Code2Video, a model that generates animated videos by writing and executing code rather than directly hallucinating pixels.

Video creation as a pure function

Basically, Code2Video works a lot like programmatic animation libraries such as Manim or HyperFrames. It translates natural language prompts into executable scripts that render every visual element frame by frame.

Because each frame is treated as a pure function of time, coordinates, timing, and typography are mathematically deterministic. Text is rendered exactly as typed, formulas remain legible, and motion follows explicit physical formulas rather than guesswork. SenseTime proved the concept by producing its entire 90-second launch film and several demo pieces, including a retro split-flap airport board and geometric explainers, purely through generated code.

Where this approach shines brightest is iterative editing. When SenseTime wanted to refine that split-flap board, they simply passed short design notes back to the model. Instead of regenerating the entire clip from scratch, Code2Video modified just a few lines of code in the existing project, tweaking the visual polish while keeping the flip mechanics and typography completely untouched.

A 55GB powerhouse built for 1,000-turn sessions

Under the hood, Code2Video is built on top of Qwen3.8 27B. That makes it quite hefty: the full model weighs in at roughly 55GB, meaning you will need a capable, high-end GPU to get it moving. SenseTime has made the weights available on Hugging Face along with deployment instructions using LightLLM on GitHub.

To handle complex creative workflows, the model supports an impressive 512K context window and incorporates advanced context compaction. SenseTime claims it can sustain interactive editing sessions spanning over 1,000 turns without losing track of project code.

Looking ahead, SenseTime sees code as the orchestrator across multimodal tools. The company envisions using these precise programmatic renders as previsualizations that lock down layout, cameras, and timing before passing them to video diffusion models for final styling. Because every coordinate is mathematically defined, the pipeline can also generate perfectly ground-truthed training data for world models.

Why it matters

We think this is a very sharp pivot in an industry obsessed with diffusion brute force. While frontier video models are great at dreamlike aesthetics, they remain notoriously terrible at exact typography, geometric precision, and granular revisions. For motion designers, educators, and technical animators, predictable control beats random cinematic beauty every day of the week.

Right now, the hardware hurdle is the main limitation. At 55GB, this is not an app casual creators will spin up on a standard laptop; it belongs in developer rigs and high-end creative pipelines. Still, SenseTime has laid out a viable hybrid blueprint: let code handle the logic, geometry, and edits, and let neural nets paint the surface. That is likely how production-ready generative video will actually get built.

Sources (2)

  1. [1]
    github.com(opens in a new tab)Originalgithub.com
  2. [2]
    youtube.com(opens in a new tab)Reportyoutube.com

Best of AI, daily