Generate a talking head video with Infinite Talk in ComfyUI
ComfyUIDemo summary
The creator demonstrates the basic Infinite Talk workflow by uploading a portrait image and an audio file, adjusting the prompt and resolution, and rendering a lip-synced video.
Step-by-step
- Upload a portrait image to the workflow
- Upload an audio file to drive the animation
- Enter a prompt describing the subject (e.g., 'A man is talking')
- Adjust the width and height settings
- Click Run to generate the video
- Hover over the generated video to hear the audio playback
Options
- Switch width and height values to generate landscape videos instead of portrait
Watch out for
- The longer the audio file, the more time the generation will take
- Increasing width and height dimensions increases the render time
Tips
- Start with 3 or 4 seconds of audio first to ensure the workflow is working correctly before using longer files
- Use resolution ratios that match the aspect ratio of your uploaded image
- Check the output folder to find the saved video files
Highlights
“easier to find them. Let me show you an example really quick.”
All demos from “ComfyUI Tutorial Series Ep 60 Infinite Talk (Audio-Driven Talking AI Characters)”
- 0:441:10Generate a talking head video with Infinite Talk in ComfyUICurrentThe creator demonstrates the basic Infinite Talk workflow by uploading a portrait image and an audio file, adjusting the prompt and resolution, and rendering a lip-synced video.ComfyUI· AI Avatar Video Generator
- 5:411:07Configure frame window and motion settings for Infinite TalkThe user demonstrates how to adjust the frame window size and motion frame overlap to balance video smoothness, lip-sync consistency, and VRAM usage.ComfyUI· AI Lip Sync Generator
- 8:411:11Create a multi-person talking video in ComfyUIThe creator demonstrates the multi-talk version of the workflow, showing how to assign separate audio files to two different characters in a single image using the multimodel setting.ComfyUI· AI Lip Sync Generator
- Watch “ComfyUI Tutorial Series Ep 60 Infinite Talk (Audio-Driven Talking AI Characters)” →
AI Avatar Video Generator
5:421:22Configure InfiniteTalk for talking-head generationThe user demonstrates setting up the InfiniteTalk model loader, uploading a source image and audio file, and calculating the required frame count for a 25-second clip.MDMZ- 7:321:10Animate AI avatar with InfiniteTalk settingsThe creator adjusts the audio scale for expressiveness, adds a descriptive prompt for movement style, and configures the One Video Sampler steps before running the final generation.MDMZ
25:063:04Create talking avatars with InfiniteTalkThe demonstration shows how to sync a static character image with an audio file to create a talking avatar using the InfiniteTalk model and Wan 2.1.pixaroma
7:580:38Generating the final talking videoThe creator shows the KSampler settings using Lightning LoRA for fast 7-step generation and displays the final 53-second talking head result.Aiconomist
1:002:53InfiniteTalk AI avatar generation examplesA series of pre-rendered video clips showcasing InfiniteTalk's ability to generate talking avatars with synchronized lip movements and natural body language for long-form content.Benji’s AI Playground- 7:081:19Automating podcast videos with Ollama and Chatterbox SRTA workflow demonstration showing how to use Ollama for text generation and Chatterbox SRT for text-to-speech to automatically drive the InfiniteTalk avatar length and audio sync.Benji’s AI Playground
- 8:431:16Generating a 52-second avatar videoThe user walks through the step-by-step process of inputting a script, selecting a reference voice for cloning, and initiating the sampling process to generate a nearly one-minute video.Benji’s AI Playground
- 10:240:50Reviewing InfiniteTalk output and lip-sync qualityA playback of the generated 52-second retail-themed video, demonstrating the final quality of the lip-syncing and head movements produced by the tool.Benji’s AI Playground
- 0:441:10Generate a talking head video with Infinite Talk in ComfyUICurrentThe creator demonstrates the basic Infinite Talk workflow by uploading a portrait image and an audio file, adjusting the prompt and resolution, and rendering a lip-synced video.pixaroma