demobook

Configure Infinite Talk and Wan 2.1 models in ComfyUI

Demo summary

The user demonstrates loading the Infinite Talk model alongside the Wan 2.1 I2V 14B model within ComfyUI, including enabling block swap and torch compile for VRAM optimization.

Step-by-step

  1. Install the One Video Wrapper plugin via the ComfyUI manager
  2. Load the Infinite Talk single model
  3. Load the Wan 2.1 I2V 14B 480P Q6K model
  4. Enable block swap settings to reduce VRAM usage
  5. Enable torch compile settings to speed up the process
  6. Set the clip vision model to clip vision H
  7. Set the VAE to Wan 2.1 VAE

Watch out for

  • Requires the One Video Wrapper plugin to be installed through the manager as it uses non-native nodes

Tips

  • Enable block swap and torch compile to optimize performance and VRAM usage

All demos from “Audio-Driven Lip Sync with Infinite Talk | ComfyUI Tutorial S04 P07

  1. 0:510:36Configure Infinite Talk and Wan 2.1 models in ComfyUICurrentThe user demonstrates loading the Infinite Talk model alongside the Wan 2.1 I2V 14B model within ComfyUI, including enabling block swap and torch compile for VRAM optimization.ComfyUIAI Animation Generator
  2. 1:270:23Process audio and images for lip syncThe demonstration shows uploading a character image and using Wav2Vec nodes to extract alignment data from an audio file to generate lip movement instructions.ComfyUIAI Lip Sync Generator
  3. 1:551:13Configure sampling and window settings for long video generationThe user walks through the Wan Video Wrapper sampling node, explaining how to set frame window size, motion frame overlap, and start steps for consistent video generation.ComfyUIAI Animation Generator
  4. 3:080:30Review Infinite Talk lip sync outputThe video shows the final rendered output where a character's lip movements are precisely synced to the input audio, followed by natural movement back to the original pose.ComfyUIAI Lip Sync Generator
  5. Watch “Audio-Driven Lip Sync with Infinite Talk | ComfyUI Tutorial S04 P07” →

AI Animation Generator

  1. 2:070:23Load Wan 2.2 Animate workflow and install nodesThe user demonstrates how to drag and drop the Wan 2.2 Animate workflow into ComfyUI and use the Manager to install missing custom nodes.MDMZ
  2. 2:551:05Configure video input and output settingsThe demo shows how to upload a source video to ComfyUI, set the frame count, and adjust the output dimensions to match the original aspect ratio.MDMZ
  3. 16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.AI Search
  4. 20:151:53Text-to-Video generation in ComfyUIA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.AI Search
  5. 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.AI Search
  6. 0:594:52Configure LTX 2.3 in ComfyUIThe creator walks through the ComfyUI node setup for LTX 2.3, explaining the GGUF model loader, VAE settings, and how to adjust resolution and frame counts for optimal rendering.AIKnowledge2Go
  7. 1:230:41Setting up LTX-2.3 in ComfyUIThe creator demonstrates how to browse templates in ComfyUI, search for LTX 2.3, and download the required missing models for the text-to-video workflow.MDMZ
  8. 13:071:21Applying LoRA to Wan 2.2 video generationThe video shows how to integrate a LoRA (Low-Rank Adaptation) into a Wan 2.2 workflow to achieve specific cinematic movements like a face zoom.pixaroma
  9. 31:133:44Text-to-video with LTX-2The video walks through setting up the LTX-2 model in ComfyUI to generate high-resolution video clips from text prompts and images.pixaroma
  10. 39:075:27Cloud-based ComfyUI on RunPod/RunHubThe video shows how to run complex video workflows in the cloud using RunHub AI, demonstrating the interface and execution of InfiniteTalk and Wan 2.2 without local hardware.pixaroma
  11. 2:351:46Configure Infinite Talk models in ComfyUIThe creator demonstrates how to organize the necessary models within the ComfyUI workflow, including the Lightning LoRA, quantized Infinite Talk UNET models, and the Wan 2.1 VAE and Clip Vision nodes.Aiconomist
  12. 11:060:26Combining audio, images, and promptsA demonstration of layering a specific action prompt (patting stomach) over a specific audio timestamp to create a fully directed AI scene.What Dreams Cost