Google's VideoPoet trades diffusion for LLMs to generate video
Google just introduced VideoPoet, a multimodal model that ditches the prevailing diffusion approach in favor of a large language model architecture for video generation. It produces coherent 10-second clips featuring large motion and minimal artifacts, while handling text-to-video, image animation, and audio within a single unified model. It suggests LLMs could become a serious contender against diffusion in coherent video synthesis.