Configure lip-sync settings and upscaling in ElevenLabs
ElevenLabs
Demo summary
The video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.
Step-by-step
- Select a model from the available options (W 2.6, Omnihuman, or Creatify Aurora)
- Adjust the duration settings based on the selected model's constraints
- Set the resolution to 1080p if using W 2.6 or 720p if using Creatify Aurora
- Upload an audio file to dictate video length if using the Omnihuman model
- Export the video and import it into Topaz for upscaling if using Creatify Aurora
- Split videos into segments of 30 seconds or less before processing in Topaz
Options
- Choose between 5, 10, and 15-second durations when using W 2.6
- Use Omnihuman for audio-synced lengths up to 30 seconds
Watch out for
- Creatify Aurora is currently limited to a maximum resolution of 720p
- Topaz only accepts clips that are 30 seconds or shorter at a time
- Omnihuman has a hard maximum limit of 30 seconds for audio-driven video
Tips
- Use Topaz to upscale 720p outputs from Creatify Aurora to higher resolutions
All demos from “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)”
- 0:050:42Lip-sync audio to an image with Creatify AuroraThe user demonstrates the workflow in ElevenLabs by selecting the Creatify Aurora model, uploading an avatar and audio, and generating a video with synchronized lip movements.ElevenLabs· AI Lip Sync Generator
- 2:030:41Configure lip-sync settings and upscaling in ElevenLabsCurrentThe video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.ElevenLabs· AI Lip Sync Generator
- Watch “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)” →
AI Lip Sync Generator
7:350:59Generate AI dialogue and lip-sync with 11LabsThe narrator uses 11Labs to select an AI avatar, generate text-to-speech dialogue, and then applies a lip-sync tool to animate the character's mouth movements.Tao Prompts- 0:050:42Lip-sync audio to an image with Creatify AuroraThe user demonstrates the workflow in ElevenLabs by selecting the Creatify Aurora model, uploading an avatar and audio, and generating a video with synchronized lip movements.ElevenLabs
- 2:030:41Configure lip-sync settings and upscaling in ElevenLabsCurrentThe video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.ElevenLabs