Alibaba's PrismAudio adds instant sound effects to silent video
Alibaba just open-sourced PrismAudio, a lightweight 518M-parameter model that generates synchronized sound effects for silent videos. By combining reinforcement learning with chain-of-thought reasoning, it generates 9 seconds of audio in just 0.63 seconds, outperforming multi-billion-parameter rivals in both speed and benchmarks.