ElevenLabs Dubbing v2 Brings Sync-Aware Localization to 90+ Languages
The AI dubbing update preserves original tone, pacing, and emotional intent across more than 90 languages and accents.
Stock photo for illustration only, not from the actual event
- ElevenLabs launches Dubbing v2 supporting over 90 languages and accents
- Features a sync-aware translation system to match original speech pacing
- Conditions on original performance instead of relying solely on written transcripts
- Available via ElevenCreative and ElevenProductions with an API coming soon
ElevenLabs has launched Dubbing v2, an update to its AI dubbing technology that supports more than 90 languages and accents while aiming to preserve the original performance's tone, pacing, delivery and emotional intent. Its central change is a sync-aware translation system designed to adapt wording for natural speech without losing alignment with the source audio.
For global video localization, that combination addresses a practical constraint that has long shaped dubbing workflows. A translation can be linguistically accurate but still sound unnatural when spoken, or it can run too long or too short for the original scene. Dubbing v2 is intended to handle both issues by conditioning on the original performance rather than treating a transcript as the sole input.
Stock photo for illustration only, not from the actual event
According to ElevenLabs' official Dubbing v2 announcement, the system automatically aligns starts, stops and pacing with the source content. The important distinction in ElevenLabs' description is performance conditioning. Instead of working only from written dialogue, Dubbing v2 uses characteristics of the original delivery to inform the generated dub, preserving a speaker's personality across languages.
By conditioning the generation on the original performance parameters rather than mere text translation, AI dubbing tools are bridging the gap between literal accuracy and natural human delivery in cross-lingual media production.
The release is connected to three main elements:
- Introductory offer: 1 minute on Free, 15 minutes on Starter, and 30 minutes on Creator+ over seven days
- Platform availability: Offered in ElevenCreative for creators and ElevenProductions for studios and broadcasters
- Upcoming API: Dubbing API is coming soon for automated developer pipelines
For enterprise users, the release is less about replacing every localization decision with automation and more about changing where human effort is spent. Creative and language teams can concentrate on market-specific review, brand suitability and editorial judgment, while the system handles voice generation and timing alignment.
Source: Dev.to
Found something wrong in this article? Report an issue with this article
Comments
Leave a Comment