demobook

ElevenLabs: Direct camera movement and lip-sync with Wan 2.6

Demo summary

The demonstration shows how to use specific prompts with the Wan 2.6 model to control camera angles and character movement while maintaining lip-syncing.

All demos from “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)

  1. 0:050:42Lip-sync audio to an image with Creatify AuroraThe user demonstrates the workflow in ElevenLabs by selecting the Creatify Aurora model, uploading an avatar and audio, and generating a video with synchronized lip movements.ElevenLabsAI Lip Sync Generator
  2. 0:491:00Compare lip-sync models: Creatify Aurora vs Omnihuman vs Wan 2.6A side-by-side comparison of the same audio and image processed through three different AI models, highlighting differences in facial expressions, movement, and generation speed.ElevenLabsAI Lip Sync Generator
  3. 2:030:41Configure lip-sync settings and upscaling in ElevenLabsThe video shows how to adjust resolution and duration settings for different models and explains the process of using Topaz for upscaling 720p outputs.ElevenLabsAI Lip Sync Generator
  4. 3:320:21Direct camera movement and lip-sync with Wan 2.6CurrentThe demonstration shows how to use specific prompts with the Wan 2.6 model to control camera angles and character movement while maintaining lip-syncing.ElevenLabsText to Video
  5. Watch “How to Lip Sync any Audio to Video with any AI Model (Wan 2.6, Omnihuman 1.5, etc...)” →

Text to Video

  1. 3:320:21Direct camera movement and lip-sync with Wan 2.6CurrentThe demonstration shows how to use specific prompts with the Wan 2.6 model to control camera angles and character movement while maintaining lip-syncing.ElevenLabs