demobook

Multi-speaker lip-sync with 'Detect Active Speaker'

SSyncTry it →Watch full video →Sebastian Kamph ·

Demo summary

The demonstration shows how to enable the 'detect active speaker' setting in Sync to automatically identify and sync only the person currently talking in a multi-person frame.

All demos from “AI lipsync with Sync

  1. 1:220:39Translate and lip-sync video with Sync.soThe creator demonstrates the Sync.so web interface by creating a new project, uploading a video, and pasting translated Spanish text to generate a lip-synced output.SSync.SoAI Lip Sync Generator
  2. 2:111:30Advanced voice cloning and obstruction detection in Sync.soThe demo shows how to upload an audio sample for voice cloning and toggle the 'detect obstructions' setting to maintain lip-sync accuracy when a hand covers the mouth.SSync.SoAI Lip Sync Generator
  3. 4:460:35Installing and using the Sync custom node in ComfyUISebastian walks through installing the Sync custom node via Git URL in ComfyUI and setting up a workflow with video/audio input nodes and the Sync generate node.ComfyUIAI Lip Sync Generator
  4. 5:291:09Combining image-to-video models with Sync in ComfyUIThe video demonstrates a complex workflow using Krea.ai to transform a shot into a cinematic style before passing the generated video into Sync for final lip-syncing.ComfyUIAI Lip Sync Generator
  5. 7:070:23Multi-speaker lip-sync with 'Detect Active Speaker'CurrentThe demonstration shows how to enable the 'detect active speaker' setting in Sync to automatically identify and sync only the person currently talking in a multi-person frame.SSyncAI Lip Sync Generator
  6. Watch “AI lipsync with Sync” →

AI Lip Sync Generator

  1. 5:110:38Edit video performance and lip-sync with Sync React-1A demonstration of Sync's React-1 model showing how to change a speaker's delivery, emotion, or language by editing text or audio while maintaining natural facial expressions and lip-sync.Malva AI
  2. 7:070:23Multi-speaker lip-sync with 'Detect Active Speaker'CurrentThe demonstration shows how to enable the 'detect active speaker' setting in Sync to automatically identify and sync only the person currently talking in a multi-person frame.Sebastian Kamph