Symphony Creative Studio: AI video dubbing and lip-sync translation
Symphony Creative Studio
Demo summary
The tool is used to translate a Spanish-speaking video into French, automatically adjusting the lip-syncing to match the new language.
Step-by-step
- Upload a video of a person or avatar speaking
- Select the target language for translation
- Choose between a new voice or cloning the original voice
- Enable the option to replace existing subtitles if desired
- Toggle the Lip-sync option to the enabled position
- Click Generate and wait for the processing to complete
- Press play to review the translated result
Options
- Clone and use the original voice
- Assign a completely new voice to the speaker
- Add a custom language if it does not appear in the default list
- Replace existing subtitles
Watch out for
- There is a limit of 20 videos for this specific tool
- The progress bar may stay at 95% for several minutes while the video finishes generating
Tips
- Leave the voice setting on 'cloned' to maintain the original speaker's tone
- Be patient during the final 5% of processing as it can take up to 5 minutes
Highlights
“the translation is perfect, the lip-syncing”
All demos from “NUEVA IA de TIKTOK para CREADORES Y MONETIZABLES : Guía Completa de Uso Profesional”
- 3:292:08Generate images with TikTok Symphony Creative StudioThe creator demonstrates how to generate high-quality images using the 'Nano Banana' model by entering a detailed prompt and receiving four variations.Symphony Creative Studio· Text to Image
- 7:472:11Create image-to-video with lip-syncingThe user uploads a generated image and applies a text prompt to create a 10-second video with synchronized voiceover and lip-syncing using TikTok's AI.Symphony Creative Studio· AI Avatar Video Generator
- 13:321:10Video generation with start and end frame referencesThe demo shows how to use two different images as the opening and closing shots to ensure visual consistency in a 12-second AI-generated video.Symphony Creative Studio· Image to Video
- 15:321:29Create AI avatar voiceoversThe creator selects a human-like avatar and inputs a script to generate a video where the avatar speaks the text with synchronized audio.Symphony Creative Studio· AI Avatar Video Generator
- 19:092:35Generate product marketing videos with AI avatarsTikTok Symphony is shown placing a product (a plate) into an AI avatar's hands and animating it with a marketing voiceover.Symphony Creative Studio· AI Commercial Generator
- 24:451:41AI video dubbing and lip-sync translationCurrentThe tool is used to translate a Spanish-speaking video into French, automatically adjusting the lip-syncing to match the new language.Symphony Creative Studio· AI Lip Sync Generator
- 26:521:06Basic video editing in TikTok SymphonyA brief look at the built-in video editor where users can drag generated assets onto a timeline and add stickers, text, and effects.Symphony Creative Studio· AI Video Editor
- Watch “NUEVA IA de TIKTOK para CREADORES Y MONETIZABLES : Guía Completa de Uso Profesional” →
AI Lip Sync Generator
- 24:451:41AI video dubbing and lip-sync translationCurrentThe tool is used to translate a Spanish-speaking video into French, automatically adjusting the lip-syncing to match the new language.ZehIAs
9:221:54Translate and dub videos with AI lip-syncingThe user demonstrates the Dub Translation feature in TikTok Symphony, showing how it clones a voice and adjusts lip movements to translate an English video into Spanish.ZoCo Marketing