Lip syncing video to audio with Facefusion
FacefusionDemo summary
The creator demonstrates syncing a static person's mouth movements to an external audio file by dragging both into the Facefusion source area and using the Lip Sinker processor.
Step-by-step
- Select both the face image and the audio file from your local folder
- Drag both files simultaneously into the Facefusion source area
- Enable the Lip Sinker processor
- Toggle the Face Enhancer off and then back on to ensure it is the last step in the processing chain
- Use the trim frame function to match the video length to the shorter audio clip duration
- Click Generate
Options
- Use Face Enhancer to improve output quality
Watch out for
- You must drag the source image and the audio file into the interface at the same time for the lip sync to work
Tips
- Turn the face enhancer off and back on again so it is the last thing in the processing chain
- Trim the video frames if your audio clip is significantly shorter than the source video to avoid unnecessary rendering time
All demos from “The BEST Face Swapper is Open Source! Facefusion 3.0 Update is incredible!”
- 2:522:39Face swapping and age modification with Facefusion 3.0The creator demonstrates how to swap a target face with Liam Neeson's face and apply the 'age modifier' slider to adjust the subject's age in the video.Facefusion· AI Face Swap Video
- 9:181:31Lip syncing video to audio with FacefusionCurrentThe creator demonstrates syncing a static person's mouth movements to an external audio file by dragging both into the Facefusion source area and using the Lip Sinker processor.Facefusion· AI Lip Sync Generator
- 11:052:50Multi-face swapping and batch job managementThe video shows how to use the Job Manager and 'remix step' feature to swap multiple faces in a single video and use 'occlusion' to handle foreground objects like sunglasses.Facefusion· AI Face Swap Video
- Watch “The BEST Face Swapper is Open Source! Facefusion 3.0 Update is incredible!” →
AI Lip Sync Generator
8:400:51Lip-syncing audio to video with Face FusionThe demo shows the 'lip sinker' feature where an 11 Labs audio file is synced to a video generated in Luma Labs, resulting in the character's mouth movements matching the speech.Theoretically Media- 9:181:31Lip syncing video to audio with FacefusionCurrentThe creator demonstrates syncing a static person's mouth movements to an external audio file by dragging both into the Facefusion source area and using the Lip Sinker processor.Bob Doyle Media
3:201:06Lip sync audio with video using Face Fusion 3.0The demonstration shows how to use the lip sync processor in Face Fusion 3.0 to align a source audio file with a target video, including using trim frame settings to match durations.MIMICPC