ComfyUI: Configure WAN Video Sampler for image and video inputs
ComfyUIDemo summary
The creator walks through setting the 'start_frame' and 'light X2V LoRA' steps in the WAN video sampler to match the motion of the input source.
Step-by-step
- Set the seed generation to randomize.
- Adjust the start_frame based on your input type.
- Replace the Load Image node with a Load Video node for video-to-video workflows.
- Upload your audio file.
- Mix the audio with the video output.
- Switch the model type to multi before proceeding with multi-workflow setups.
Options
- Use a single image input for generation.
- Use a video input to guide motion.
Watch out for
- You must switch the model type to multi before you can proceed with the multi workflow.
Tips
- Set the start frame to zero if you are using an input image.
- Increase the start frame to two or three when using video input to ensure the result matches the motion.
- Use the first frame of a video as an image to generate video in the video workflow.
Highlights
“I think we've made that clear enough.”
All demos from “InfiniteTalk + WAN 2.1 Full Setup Tutorial (Single, Video & Multi workflow) in ComfyUI | 8GB VRAM”
- 4:580:42Image preparation and resizing for InfiniteTalkThe video shows how to select a forward-facing image and resize/crop it to 832x480 resolution to ensure compatibility with 8GB VRAM constraints.ComfyUI· AI Crop Image
- 7:490:49Configure WAN Video Sampler for image and video inputsCurrentThe creator walks through setting the 'start_frame' and 'light X2V LoRA' steps in the WAN video sampler to match the motion of the input source.ComfyUI· AI Animation Generator
- 8:381:53Multi-character lip-sync workflow in InfiniteTalkThe tutorial demonstrates the multi-audio workflow, showing how to assign different audio files to specific characters (parallel vs. add types) for a multi-person scene.ComfyUI· AI Lip Sync Generator
- Watch “InfiniteTalk + WAN 2.1 Full Setup Tutorial (Single, Video & Multi workflow) in ComfyUI | 8GB VRAM” →
AI Animation Generator
2:070:23Load Wan 2.2 Animate workflow and install nodesThe user demonstrates how to drag and drop the Wan 2.2 Animate workflow into ComfyUI and use the Manager to install missing custom nodes.MDMZ- 2:551:05Configure video input and output settingsThe demo shows how to upload a source video to ComfyUI, set the frame count, and adjust the output dimensions to match the original aspect ratio.MDMZ
16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.AI Search- 20:151:53Text-to-Video generation in ComfyUIA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.AI Search
- 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.AI Search
0:594:52Configure LTX 2.3 in ComfyUIThe creator walks through the ComfyUI node setup for LTX 2.3, explaining the GGUF model loader, VAE settings, and how to adjust resolution and frame counts for optimal rendering.AIKnowledge2Go
1:230:41Setting up LTX-2.3 in ComfyUIThe creator demonstrates how to browse templates in ComfyUI, search for LTX 2.3, and download the required missing models for the text-to-video workflow.MDMZ
13:071:21Applying LoRA to Wan 2.2 video generationThe video shows how to integrate a LoRA (Low-Rank Adaptation) into a Wan 2.2 workflow to achieve specific cinematic movements like a face zoom.pixaroma- 31:133:44Text-to-video with LTX-2The video walks through setting up the LTX-2 model in ComfyUI to generate high-resolution video clips from text prompts and images.pixaroma
- 39:075:27Cloud-based ComfyUI on RunPod/RunHubThe video shows how to run complex video workflows in the cloud using RunHub AI, demonstrating the interface and execution of InfiniteTalk and Wan 2.2 without local hardware.pixaroma
2:351:46Configure Infinite Talk models in ComfyUIThe creator demonstrates how to organize the necessary models within the ComfyUI workflow, including the Lightning LoRA, quantized Infinite Talk UNET models, and the Wan 2.1 VAE and Clip Vision nodes.Aiconomist
11:060:26Combining audio, images, and promptsA demonstration of layering a specific action prompt (patting stomach) over a specific audio timestamp to create a fully directed AI scene.What Dreams Cost