ComfyUI: Configure WAN Video Sampler for image and video inputs
ComfyUI
Demo summary
The creator walks through setting the 'start_frame' and 'light X2V LoRA' steps in the WAN video sampler to match the motion of the input source.
Step-by-step
- Set the seed generation to randomize.
- Adjust the start_frame based on your input type.
- Replace the Load Image node with a Load Video node for video-to-video workflows.
- Upload your audio file.
- Mix the audio with the video output.
- Switch the model type to multi before proceeding with multi-workflow setups.
Options
- Use a single image input for generation.
- Use a video input to guide motion.
Watch out for
- You must switch the model type to multi before you can proceed with the multi workflow.
Tips
- Set the start frame to zero if you are using an input image.
- Increase the start frame to two or three when using video input to ensure the result matches the motion.
- Use the first frame of a video as an image to generate video in the video workflow.
Highlights
“I think we've made that clear enough.”
All demos from “InfiniteTalk + WAN 2.1 Full Setup Tutorial (Single, Video & Multi workflow) in ComfyUI | 8GB VRAM”
- 4:580:42Image preparation and resizing for InfiniteTalkThe video shows how to select a forward-facing image and resize/crop it to 832x480 resolution to ensure compatibility with 8GB VRAM constraints.ComfyUI· AI Crop Image
- 7:490:49Configure WAN Video Sampler for image and video inputsCurrentThe creator walks through setting the 'start_frame' and 'light X2V LoRA' steps in the WAN video sampler to match the motion of the input source.ComfyUI· AI Animation Generator
- 8:381:53Multi-character lip-sync workflow in InfiniteTalkThe tutorial demonstrates the multi-audio workflow, showing how to assign different audio files to specific characters (parallel vs. add types) for a multi-person scene.ComfyUI· AI Lip Sync Generator
- Watch “InfiniteTalk + WAN 2.1 Full Setup Tutorial (Single, Video & Multi workflow) in ComfyUI | 8GB VRAM” →
AI Animation Generator
1:420:59Seed hunting with a multi-stage LTX 2.3 workflowThe creator demonstrates his custom ComfyUI workflow that generates four low-resolution LTX 2.3 samples simultaneously to find a 'golden seed' before upscaling to 1080p.Fox•Fur•Essence Films
16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.AI Search- 20:151:53Text-to-Video generation in ComfyUIA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.AI Search
- 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.AI Search
0:510:36Configure Infinite Talk and Wan 2.1 models in ComfyUIThe user demonstrates loading the Infinite Talk model alongside the Wan 2.1 I2V 14B model within ComfyUI, including enabling block swap and torch compile for VRAM optimization.Olares- 1:551:13Configure sampling and window settings for long video generationThe user walks through the Wan Video Wrapper sampling node, explaining how to set frame window size, motion frame overlap, and start steps for consistent video generation.Olares
0:310:46Generate cinematic video with LTX MSR workflowThe creator demonstrates using the LTX MSR workflow in ComfyUI to generate a video from multiple reference images and a prompt, highlighting the 3D camera movement and character consistency.Apex Artist
0:290:24Load source footage and models in ComfyUIThe user demonstrates importing source video footage and loading the necessary model nodes including WAN Video, VAE, and Clip Vision within the ComfyUI interface.ComfyUI
0:431:12Configure LTX-2.3 MSR LoRA and Prompt Relay in ComfyUIThe creator demonstrates setting up a ComfyUI workflow using the LTX-2.3 model with the MSR LoRA and Prompt Relay nodes to manage video generation on 8GB of VRAM.bigboss97
4:261:28Overview of the TensNodes Consistent Character Workflow in ComfyUIThe creator walks through a four-stage ComfyUI workflow utilizing TensNodes to process reference images and text for stable LTX video generation.SOTAI
3:411:25Configure LTX 2.3 foundational parametersA walkthrough of setting dimensions, frame counts, and loading core models including the LTX 2.3 distill model and audio VAE within a ComfyUI workflow.SOTAI- 5:060:37Process visual and audio inputs in ComfyUIThe demo shows how to use the LTX V image-to-video condition node and empty latent audio node to prepare data for the generation engine.SOTAI