demobook

Create a multi-person talking video in ComfyUI

ComfyUITry it →Watch full video →pixaroma ·

Demo summary

The creator demonstrates the multi-talk version of the workflow, showing how to assign separate audio files to two different characters in a single image using the multimodel setting.

Step-by-step

  1. Select the multimodel version in the model selection node
  2. Upload an image containing two people
  3. Connect the first audio file for the person on the left
  4. Connect the second audio file for the person on the right
  5. Choose between 'parah' or 'ad' mode to determine audio playback order
  6. Run the workflow to generate the multi-person talking video

Options

  • Use 'parah' mode to play both audio files simultaneously
  • Use 'ad' mode to play audio files sequentially (first voice then second voice)

Watch out for

  • The workflow assigns audio based on position from left to right
  • The multimodel must be selected specifically for multiple voices; the single model will not work for this task

Tips

  • Use 'ad' mode if you have prepared separate audio files that should follow one another
  • Expect that results may not always be perfect even when using the multi-person setting

Highlights

“it is not always perfect, but it can be fun to play with”

All demos from “ComfyUI Tutorial Series Ep 60 Infinite Talk (Audio-Driven Talking AI Characters)”

  1. 0:441:10Generate a talking head video with Infinite Talk in ComfyUIThe creator demonstrates the basic Infinite Talk workflow by uploading a portrait image and an audio file, adjusting the prompt and resolution, and rendering a lip-synced video.ComfyUIAI Avatar Video Generator
  2. 5:411:07Configure frame window and motion settings for Infinite TalkThe user demonstrates how to adjust the frame window size and motion frame overlap to balance video smoothness, lip-sync consistency, and VRAM usage.ComfyUIAI Lip Sync Generator
  3. 8:411:11Create a multi-person talking video in ComfyUICurrentThe creator demonstrates the multi-talk version of the workflow, showing how to assign separate audio files to two different characters in a single image using the multimodel setting.ComfyUIAI Lip Sync Generator
  4. Watch “ComfyUI Tutorial Series Ep 60 Infinite Talk (Audio-Driven Talking AI Characters)” →

AI Lip Sync Generator

  1. 14:523:11Lip-syncing audio to images with LTX 2.3The tutorial shows how to upload an MP3 file and a character image to generate a lip-synced video, including a demonstration of the voice isolation subgraph in ComfyUI.AIKnowledge2Go
  2. 36:000:39Singing characters with LTX-2 and custom audioThe creator demonstrates how to use LTX-2 to make a character sing by providing a custom audio file and a specific singing prompt.pixaroma
  3. 10:070:59Lip-syncing with custom audioThe creator demonstrates importing an audio file into the timeline and using a specific prompt structure to synchronize the character's mouth movements with the audio track.What Dreams Cost
  4. 5:411:07Configure frame window and motion settings for Infinite TalkThe user demonstrates how to adjust the frame window size and motion frame overlap to balance video smoothness, lip-sync consistency, and VRAM usage.pixaroma
  5. 8:411:11Create a multi-person talking video in ComfyUICurrentThe creator demonstrates the multi-talk version of the workflow, showing how to assign separate audio files to two different characters in a single image using the multimodel setting.pixaroma
  6. 3:270:37Two-person image to video conversation in ComfyUIThe creator demonstrates how to use the 'add' setting in the ComfyUI node widget to load separate audio files for a back-and-forth conversation between two characters.ComfyUI Studio
  7. 4:041:22Parallel audio lip-sync for two charactersThe video shows how to use the 'PAR' setting in the WAN workflow to merge audio tracks for simultaneous or perfectly timed character interactions, including masking two faces in the node.ComfyUI Studio
  8. 4:460:35Installing and using the Sync custom node in ComfyUISebastian walks through installing the Sync custom node via Git URL in ComfyUI and setting up a workflow with video/audio input nodes and the Sync generate node.Sebastian Kamph
  9. 4:341:29Video-to-video lip sync with Infinite TalkThe creator shows how to use a vid-to-vid workflow to analyze an audio file and automatically synchronize a character's mouth and expressions in an existing video clip.Yaroflasher
  10. 8:381:53Multi-character lip-sync workflow in InfiniteTalkThe tutorial demonstrates the multi-audio workflow, showing how to assign different audio files to specific characters (parallel vs. add types) for a multi-person scene.Atelier Darren
  11. 6:310:34Animate talking avatar with LTX 2.3The creator uploads the generated image and audio into the ComfyUI LTX 2.3 workflow and runs the generation to produce a lip-synced video.Prince does AI
demobook

Show, don’t tell.

Categories

Video & AnimationImage Generation & EditingSales TechEmail Marketing

About

SubmitAboutPrivacyTermsContact

© demobook.co