Skip to content
IFAI

AI tools

ElevenLabs launches Studio 4.0 with script-based audio regeneration

Published Reach 37

ElevenLabs just introduced Studio 4.0, an all-in-one AI audio editor designed for podcasters and video creators. The platform features over 10,000 voices, background music generation, and instant speech correction that regenerates cloned audio simply by editing the script. It also adds Studio Agent, a co-editor that drafts scripts and arranges sound effects from a single prompt.

ElevenLabs launches Studio 4.0 with script-based audio regeneration
Image: elevenlabs.io

Anyone who produces podcasts, audiobooks, or video voiceovers knows the routine: misspeak a single word or pick up a loud background click, and you are stuck setting up the microphone all over again.

ElevenLabs rolled out Studio 4.0, a comprehensive overhaul of its creative suite aimed at turning messy audio post-production into a document-editing experience.

Edit the script, fix the voice

Studio 4.0 packs an extensive voice library with over 10,000 realistic accents, character voices, and narration profiles. The real convenience, though, is how it handles corrections.

With Speech Correction, editing spoken dialogue works like fixing a typo. You simply update the text in your script, and the system clones the voice to regenerate only that specific segment, saving you from doing extra takes.

Then there is Studio Agent, which acts as an AI co-editor. You describe what you want in plain words, and the agent writes a draft script, picks appropriate voices, generates contextual sound effects, and maps out the timeline. You can iterate back and forth with the agent or take manual control whenever you want.

For real-world field recordings, ElevenLabs integrated a Voice Isolator that strips out room reverb, background rumble, and distractions so messy location audio sounds closer to studio quality.

Auto-scoring and prompt-based effects

Beyond spoken dialogue, Studio 4.0 pulls background score and sound design directly onto the same editing canvas.

Using Eleven Music, creators can generate background tracks in any style or let Studio auto-score imported video footage based on visual scenes. You can also generate custom sound effects, ranging from subtle environmental hums to cinematic impacts, simply by typing a description.

The editor features full timeline controls, video playback, auto-captions, project sharing links, and support for more than 32 languages. Every core capability inside the editor is also being exposed through ElevenLabs' developer API.

Why it matters

ElevenLabs is smart to shift focus from standalone voice generation to the entire audio production loop.

Until now, building an AI-powered podcast or narration meant jumping between three different tools: one for text-to-speech, one for background music, and a desktop digital audio workstation to cut it all together. Consolidating prompt-based voice, score generation, and sound effects onto a unified timeline solves real friction for solo creators and fast-moving video teams.

For podcasters and audiobook authors, the script-based speech correction alone makes the platform worth testing immediately, as it directly eliminates painful retakes.

The challenge, however, will be quality control on fully automated projects. While the Studio Agent can draft and arrange clips quickly, prompt-generated music and automated pacing often lack the nuanced dynamic range that narrative storytelling requires. It provides an exceptional foundation, but high-end productions will still demand human ears on the final mix.

Sources (1)

  1. [1]
    elevenlabs.io(opens in a new tab)Originalelevenlabs.io

Best of AI, daily