Twelve Labs just launched Pegasus-1, a video-language foundation model designed to generate text directly from video. Instead of slicing clips into thousands of static images, it natively analyzes visual and audio cues together to handle summaries, chaptering, and custom reports. Why it matters: It treats video as a unified medium rather than a glorified slideshow.
D-ID just launched its mobile app on iOS and Android, bringing its viral AI video tech straight to smartphones. Users can upload a photo, type a script in 119 languages with customizable emotional tones, and generate talking videos up to 10 minutes long. Subscriptions start at $5.99 a month with a 14-day free trial.
Descript just launched Underlord, an agentic AI video and podcast co-editor designed to take tedious editing off your hands. It can analyze your script and video, center speakers, add captions, and clean up retakes from plain prompts. Why it matters: You can now direct an AI like a human collaborator instead of manually slicing timelines.
ElevenLabs just teamed up with video generation platform Pictory AI to bring its realistic voice synthesis to automated video editing. Creators can now turn text scripts and blog posts into videos with human-sounding narration, initially focusing on English and German content.
SAG-AFTRA just endorsed the "No Fakes Act," a new bipartisan discussion draft presented in the U.S. Senate. The proposal aims to establish federal protections prohibiting the use of AI-generated voice or likeness replicas without explicit informed consent. Why it matters: It directly addresses the union's core strike demands, blocking studios from cutting costs by replacing background actors and voice performers with synthetic AI replicas.
Adobe just showcased 11 experimental AI prototypes during its MAX Sneaks session, spanning video, audio, 3D, and design. Highlights include Project Fast Fill, which brings generative fill to video frames via text prompts, and Project Primrose, a dynamic fabric dress that transforms patterns in real time. While these are research projects, they offer a glimpse into the next generation of creative editing tools.
TikTok just launched Direct Post, letting creators publish videos directly from editing tools like Adobe Premiere Pro, Adobe Express, and CapCut. Editors can set captions and audience privacy without leaving their workspace. Why it matters: It cuts out the tedious export-and-upload step, smoothing out AI-assisted video workflows.
The Writers Guild of America just voted to end its five-month strike after securing a contract that puts strict limits on generative AI. Studios can no longer force writers to use tools like ChatGPT, and AI cannot write or rewrite literary source material. Why it matters: Hollywood just set the first major labor precedent protecting creative jobs from AI automation.
YouTube just announced a suite of creator tools, headlined by Dream Screen, an experimental feature that generates video or image backgrounds for Shorts from simple text prompts. The company also launched YouTube Create, a free mobile editing app with auto-captions and beat matching. Dream Screen will begin testing with select creators later this year.
Metaphysic just launched Metaphysic Pro, a new platform designed to help actors create and manage their own AI-generated likeness and voice data. Early adopters include Tom Hanks and Anne Hathaway. Why it matters: As Hollywood strikes over AI rights, performers are actively looking for ways to lock down their consent and get paid when their digital twins work.
Adobe just rolled out major AI and 3D updates across beta versions of Premiere Pro and After Effects. Premiere Pro gains Enhance Speech for one-click audio cleanup, automatic filler word removal, and a 5x faster timeline, while After Effects introduces an upgraded AI Roto Brush and native 3D workspace. Why it matters: It turns tedious rotoscoping and dialogue cleanup into quick background tasks. Features are in beta now and roll out broadly this fall.
Google just launched an AI-driven creative guidance tool in Google Ads for YouTube campaigns. The system automatically scans videos to check if logos appear in the first five seconds, flags suboptimal aspect ratios, and provides one-click AI voiceovers in 15 languages. Basically, it acts as an automated creative director to boost ad conversions across Shorts and feeds.
Motorica just launched the open beta for MoGen, its diffusion-based tool for generating 3D character animation. Trained on over 150 movement styles, it lets creators generate high-quality motion and tweak paths in FBX-compatible software like Maya, Blender, and Unreal Engine 5.
Researchers just open-sourced StableVideo, an ICCV 2023 project that enables text-driven, consistency-aware video editing using diffusion models. Built on ControlNet and Text2LIVE, it reduces VRAM usage down to roughly 14GB using CPU offload and xFormers. Why it matters: it delivers coherent frame-by-frame edits without enterprise-grade hardware.
Amazon just unveiled a wave of AI features for its NFL Thursday Night Football coverage on Prime Video. Built into the Prime Vision stream, in-house neural networks predict blitzes in real time by tracking player coordinates and acceleration, while highlighting open receivers before throws happen. Why it matters: It turns complex tactical chess matches into real-time visual insights for fans on live TV.
ElevenLabs just teamed up with ScienceCast and arXiv to transform complex research papers into 3-to-5-minute narrated video pitches. ScienceCast’s automated video tool now uses ElevenLabs' AI voices to summarize arXiv uploads, giving researchers an easier, more accessible way to stay ahead of the daily paper flood.
Runway just launched "Watch" on its website and iOS app, giving creators a dedicated hub to share and stream longer-form AI-generated videos. Amid ongoing Hollywood strikes over generative AI, CEO Cristóbal Valenzuela argued that the debate needs more nuance, positioning the feed as evidence that AI augments filmmakers rather than replacing them.
D-ID and ElevenLabs just teamed up to integrate natural-sounding synthetic speech into D-ID's Creative Reality studio. Pro subscribers can now combine avatars and facial expressions with nine premium voices in a single click, making AI video narrators sound far less robotic.
YouTube is testing AI-generated video summaries on search and watch pages to help viewers quickly decide if a clip is worth watching. The test is currently limited to select mobile users on English-language how-to, shopping, and vlog videos, and YouTube notes it won't replace creators' own descriptions.
Netflix just posted a job opening for an AI Machine Learning Program product manager with a salary reaching up to $900,000. The role aims to leverage machine learning to optimize film and TV production. With Hollywood actors and writers on strike partly over AI protections, studios are only doubling down on automation.
