ComfyUI: Animate 3D renders with Wan 2.1

Demo summary
The creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.
Step-by-step
- Load your final 4K rendering into the workflow
- Downscale the image to approximately 720p or 1K resolution
- Load the Wan 2.1 models and the Painterly I2V node
- Adjust the value in the Painterly I2V node to increase motion speed
- Enter a simple prompt describing the camera movement
- Press Control + Enter to run the generation
Options
- Use Kaji's workflow with block swap to manage VRAM usage
Watch out for
- You must work at about 1K or 720p resolution as higher resolutions take too long even on high-end hardware
- Wan is trained on 5-second clips; extending beyond this can cause artifacts like objects moving backwards
Tips
- Add motion blur to your base image to help the AI detect and bake in movement from the start
- Use the Painterly I2V node to fix the common issue of Wan motion appearing too slow
- Leverage ComfyUI's VRAM to CPU RAM swapping for better performance
Highlights
“the rest of the setup here is is pretty straightforward”
All demos from “Local "AI Rendering" Using 3D - Explained by a Human”
3:041:18Enhance 3D clay models with Flux and ControlNetThe creator demonstrates using the Flux model in ComfyUI with a Depth ControlNet to transform a gray 3D massing model into a detailed streetcar scene while maintaining structural integrity.ComfyUI· Image to Image
6:401:29Train a custom LoRA on CivitaiA step-by-step walkthrough of uploading a dataset of streetcar images to Civitai, using auto-labeling, and configuring training settings to create a custom LoRA model.Civitai· AI Image Generator
8:512:02Image-to-image enhancement with denoisingThe video shows how to use the 'denoising' strength in ComfyUI to blend a base 3D rendering with AI-generated details like autumn trees and realistic people.ComfyUI· Image to Image
12:211:24Text-to-image generation with Z-Turbo and QwenDemonstration of the Z-Turbo model and Qwen text encoder to generate specific advertising text on the side of a 3D tram model within a ComfyUI workflow.ComfyUI· Text to Image
15:063:12Transform 3D scenes with Qwen2-VL (Qwen-Edit)The creator uses the Qwen-Edit workflow to perform complex scene modifications, such as changing weather to rain or snow, while preserving the original 3D geometry and text.ComfyUI· AI Inpainting
20:221:07Fix text and faces using Crop and StitchA demonstration of a custom 'crop image' node to isolate specific areas like signs or faces, regenerate them at native resolution, and stitch them back into the high-res image.ComfyUI· AI Inpainting
23:511:57Animate 3D renders with Wan 2.1CurrentThe creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.ComfyUI· Image to Video- Watch “Local "AI Rendering" Using 3D - Explained by a Human” →
Image to Video
10:194:27Image-to-Video with LTX 2.3The creator demonstrates bringing a static image of a vampire warlord to life by using an image input node and a descriptive prompt to guide the animation and environmental effects.AIKnowledge2Go
3:070:38Image to Video with LTX DirectorThe creator demonstrates dragging an image into the LTX Director timeline and entering a text prompt to generate a video of a woman waving her hand.What Dreams Cost
8:242:33Multi-image to video generation with LTX 2.3 and IC-LoRAThe creator demonstrates how to use a ComfyUI workflow to generate video from multiple reference images using LTX 2.3, explaining how to align image sizes and write descriptions for each reference frame.WuYangfeng
5:244:57Image-to-video generation with Wan 2.2The user demonstrates how to use the Wan 2.2 GGUF model in ComfyUI to animate a static image of a woman based on a detailed text prompt.pixaroma
0:171:00LTX-2 Image-to-Video distilled workflow setupThe demonstrator walks through loading the LTX-2 distilled checkpoint, upscaling models, and Gemma CLIP text encoder, while configuring resolution and frame rates for video generation.LTX
6:300:17Advanced multi-node AI workflowsThe video shows a complex Roboneo setup where an image is generated, passed through an image editing node, and finally converted into a video.Malva AI
10:012:01Image-to-Video generation using Hunyuan 1.5 DistilledThe user demonstrates an I2V workflow in ComfyUI using the Hunyuan 1.5 distilled model, Google's Clip Vision for image encoding, and the 'image to video' node to animate a portrait.AI老腊肉
7:500:28Image-to-Video action testThe creator demonstrates image-to-video capabilities by uploading a static image and prompting for an intense fight scene in both Hunyuan and Wan models.AI Search
24:303:12Image-to-Video workflow in ComfyUIA demonstration of the image-to-video workflow in ComfyUI, including uploading a source image, setting crop dimensions, and generating an animated anime scene.AI Search
23:511:57Animate 3D renders with Wan 2.1CurrentThe creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.Matt Hallett Visual
5:064:11Animate an image using Wan 2.1 in ComfyUIThe creator demonstrates loading a 'native image to video' workflow in ComfyUI, uploading a source image, and using the Wan 2.1 14B model to generate a high-quality video of a woman walking.Danish Sofi
10:201:00Generate AI video of a horse with Wan 2.1A second demonstration showing the image-to-video process where a static image of a horse is animated into a walking sequence using the Wan 2.1 model in ComfyUI.Danish Sofi
ComfyUI