Alibaba's EMO makes any photo sing and talk naturally
Alibaba researchers just unveiled EMO, an expressive audio-driven portrait-video generation framework. Give it a single still image and an audio clip—talking or singing—and it animates the portrait with realistic facial expressions and head poses for any duration. It even keeps up with fast-paced rap and works across multiple languages, paintings, and 3D models.