Configure lip-sync settings and upscaling in ElevenLabs

Demo summary
The video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.
Step-by-step
- Select a model from the available options (W 2.6, Omnihuman, or Creatify Aurora)
- Adjust the duration settings based on the selected model's constraints
- Set the resolution to 1080p if using W 2.6 or 720p if using Creatify Aurora
- Upload an audio file to dictate video length if using the Omnihuman model
- Export the video and import it into Topaz for upscaling if using Creatify Aurora
- Split videos into segments of 30 seconds or less before processing in Topaz
Options
- Choose between 5, 10, and 15-second durations when using W 2.6
- Use Omnihuman for audio-synced lengths up to 30 seconds
Watch out for
- Creatify Aurora is currently limited to a maximum resolution of 720p
- Topaz only accepts clips that are 30 seconds or shorter at a time
- Omnihuman has a hard maximum limit of 30 seconds for audio-driven video
Tips
- Use Topaz to upscale 720p outputs from Creatify Aurora to higher resolutions
All demos from “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)”
0:050:42Lip-sync audio to an image with Creatify AuroraThe user demonstrates the workflow in ElevenLabs by selecting the Creatify Aurora model, uploading an avatar and audio, and generating a video with synchronized lip movements.ElevenLabs· AI Lip Sync Generator
0:491:00Compare lip-sync models: Creatify Aurora vs Omnihuman vs Wan 2.6A side-by-side comparison of the same audio and image processed through three different AI models, highlighting differences in facial expressions, movement, and generation speed.ElevenLabs· AI Lip Sync Generator
2:030:41Configure lip-sync settings and upscaling in ElevenLabsCurrentThe video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.ElevenLabs· AI Lip Sync Generator
3:320:21Direct camera movement and lip-sync with Wan 2.6The demonstration shows how to use specific prompts with the Wan 2.6 model to control camera angles and character movement while maintaining lip-syncing.ElevenLabs· Text to Video- Watch “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)” →
AI Lip Sync Generator
0:050:42Lip-sync audio to an image with Creatify AuroraThe user demonstrates the workflow in ElevenLabs by selecting the Creatify Aurora model, uploading an avatar and audio, and generating a video with synchronized lip movements.ElevenLabs
0:491:00Compare lip-sync models: Creatify Aurora vs Omnihuman vs Wan 2.6A side-by-side comparison of the same audio and image processed through three different AI models, highlighting differences in facial expressions, movement, and generation speed.ElevenLabs
2:030:41Configure lip-sync settings and upscaling in ElevenLabsCurrentThe video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.ElevenLabs
ElevenLabs