AI Dubbing Operation Method#
Steps#
-
Create New Project
- Visit AI Dubbing Official Website.
- Select Create New Dub to create a new project.
- Add a name for the project.
- The target language can be manually selected or automatically detected by the system, supporting over 30 output languages.
-
Upload Video
- For example, upload an English video and translate it into Chinese:
- Select English for the original audio on the left.
- Select Chinese for the target language on the right.
- In addition to uploading videos, you can also paste links from YouTube, TikTok, Twitter, Vimeo, and any other video.
- Once the settings are complete, click the Create button at the bottom to start audio cloning.
- After completion, you can preview the effect and then download it.
- For example, upload an English video and translate it into Chinese:
-
Advanced Options
- In the advanced options, you can choose the number of characters in the original video, the quality of the video, and other settings.
Introduction to ElevenLabs#
ElevenLabs is a voice cloning and synthesis startup founded by former Google and Palantir employees, recently launching the AI Dubbing feature that can translate any voice (including long-form content) into over 20 different languages. This feature has caused a stir in the film and content creation industry.
Key Features#
- High-Quality Translation: AI Dubbing can provide high-quality translated audio in minutes while preserving the tone and emotion of the original speaker.
- Multilingual Support: Supports over 20 languages, including:
- English
- Japanese
- Chinese
- German
- Hindi
- French
- Korean
- Portuguese
- Italian
- Spanish
- Indonesian
- Dutch
- Turkish
- Filipino
- Polish
- Swedish
- Bulgarian
- Romanian
- Arabic
- Czech
- Greek
- Finnish
- Croatian
- Malay
- Slovak
- Danish
- Tamil
- Ukrainian
CEO's Perspective#
Mati Staniszewski, CEO and co-founder of ElevenLabs, stated:
“We have collaborated with hundreds of content creators to test and iterate this feature, dubbing their content to allow more audiences to access their work.”
He also mentioned that the new dubbing feature will be available to all users of the platform, but there will be some character limits.
Personal Experience#
At the launch event, Staniszewski shared his negative experiences with post-synchronized content during his childhood and how the new technology addresses this issue. He stated:
“I grew up in Poland, and the English movies we watched were all dubbed by a single narrator. This meant every actor had the same voice, which greatly diminished the viewing experience. The release of AI dubbing is the biggest step we’ve taken in breaking down these language barriers in content, helping viewers enjoy any content they want, regardless of what language they speak.”