Facefusion: Lip-syncing audio to video with Face Fusion

Facefusion Try it →Watch full video →Theoretically Media · Sep 2024

Demo summary

The demo shows the 'lip sinker' feature where an 11 Labs audio file is synced to a video generated in Luma Labs, resulting in the character's mouth movements matching the speech.

Step-by-step

Click the Lip Sinker button
Upload the target video file into the video area
Upload the audio file (e.g., from ElevenLabs) into the source area
Click Start to begin the processing

Tips

Spend more than the default processing time to ensure the motion and timing are correct for the specific clip

Highlights

“all we really have to do from here is just hit start”

All demos from “Powerful AI Face Swapper: And it's FREE?”

3:551:02Video face swapping with Face Fusion 3.0The creator demonstrates how to perform a face swap by dragging a source image of himself and a target video clip from Beetlejuice into Face Fusion 3.0, showing the frame-by-frame preview and final generation.Facefusion· AI Face Swap Video
5:170:55Enhancing face swap quality with Face EnhancerThe user shows how to enable and use the 'face enhancer' stack in Face Fusion to improve the resolution and clarity of the swapped face output.Facefusion· AI Face Swap Generator
8:400:51Lip-syncing audio to video with Face FusionCurrentThe demo shows the 'lip sinker' feature where an 11 Labs audio file is synced to a video generated in Luma Labs, resulting in the character's mouth movements matching the speech.Facefusion· AI Lip Sync Generator
9:530:45Editing facial expressions with Face EditorUsing the Face Editor tool (based on Live Portrait), the creator demonstrates fine-tuning a character's facial expressions, such as adjusting the eyeline and smile intensity using sliders.Facefusion· AI Inpainting
10:381:52Modifying age with the Age ModifierThe video shows the use of the age modifier sliders to make an AI-generated character appear significantly older or younger by adjusting the direction and range parameters.Facefusion· AI Age Progression
Watch “Powerful AI Face Swapper: And it's FREE?” →

AI Lip Sync Generator

8:400:51Lip-syncing audio to video with Face FusionCurrentThe demo shows the 'lip sinker' feature where an 11 Labs audio file is synced to a video generated in Luma Labs, resulting in the character's mouth movements matching the speech.Theoretically Media
9:181:31Lip syncing video to audio with FacefusionThe creator demonstrates syncing a static person's mouth movements to an external audio file by dragging both into the Facefusion source area and using the Lip Sinker processor.Bob Doyle Media
3:201:06Lip sync audio with video using Face Fusion 3.0The demonstration shows how to use the lip sync processor in Face Fusion 3.0 to align a source audio file with a target video, including using trim frame settings to match durations.MIMICPC