demobook

ComfyUI: Animate 3D renders with Wan 2.1

ComfyUITry it →Watch full video →Matt Hallett Visual ·

Demo summary

The creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.

Step-by-step

  1. Load your final 4K rendering into the workflow
  2. Downscale the image to approximately 720p or 1K resolution
  3. Load the Wan 2.1 models and the Painterly I2V node
  4. Adjust the value in the Painterly I2V node to increase motion speed
  5. Enter a simple prompt describing the camera movement
  6. Press Control + Enter to run the generation

Options

  • Use Kaji's workflow with block swap to manage VRAM usage

Watch out for

  • You must work at about 1K or 720p resolution as higher resolutions take too long even on high-end hardware
  • Wan is trained on 5-second clips; extending beyond this can cause artifacts like objects moving backwards

Tips

  • Add motion blur to your base image to help the AI detect and bake in movement from the start
  • Use the Painterly I2V node to fix the common issue of Wan motion appearing too slow
  • Leverage ComfyUI's VRAM to CPU RAM swapping for better performance

Highlights

the rest of the setup here is is pretty straightforward

All demos from “Local "AI Rendering" Using 3D - Explained by a Human

  1. 3:041:18Enhance 3D clay models with Flux and ControlNetThe creator demonstrates using the Flux model in ComfyUI with a Depth ControlNet to transform a gray 3D massing model into a detailed streetcar scene while maintaining structural integrity.ComfyUIImage to Image
  2. 6:401:29Train a custom LoRA on CivitaiA step-by-step walkthrough of uploading a dataset of streetcar images to Civitai, using auto-labeling, and configuring training settings to create a custom LoRA model.CivitaiAI Image Generator
  3. 8:512:02Image-to-image enhancement with denoisingThe video shows how to use the 'denoising' strength in ComfyUI to blend a base 3D rendering with AI-generated details like autumn trees and realistic people.ComfyUIImage to Image
  4. 12:211:24Text-to-image generation with Z-Turbo and QwenDemonstration of the Z-Turbo model and Qwen text encoder to generate specific advertising text on the side of a 3D tram model within a ComfyUI workflow.ComfyUIText to Image
  5. 15:063:12Transform 3D scenes with Qwen2-VL (Qwen-Edit)The creator uses the Qwen-Edit workflow to perform complex scene modifications, such as changing weather to rain or snow, while preserving the original 3D geometry and text.ComfyUIAI Inpainting
  6. 20:221:07Fix text and faces using Crop and StitchA demonstration of a custom 'crop image' node to isolate specific areas like signs or faces, regenerate them at native resolution, and stitch them back into the high-res image.ComfyUIAI Inpainting
  7. 23:511:57Animate 3D renders with Wan 2.1CurrentThe creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.ComfyUIImage to Video
  8. Watch “Local "AI Rendering" Using 3D - Explained by a Human” →

Image to Video

  1. 7:500:28Image-to-Video action testThe creator demonstrates image-to-video capabilities by uploading a static image and prompting for an intense fight scene in both Hunyuan and Wan models.AI Search
  2. 24:303:12Image-to-Video workflow in ComfyUIA demonstration of the image-to-video workflow in ComfyUI, including uploading a source image, setting crop dimensions, and generating an animated anime scene.AI Search
  3. 10:194:27Image-to-Video with LTX 2.3The creator demonstrates bringing a static image of a vampire warlord to life by using an image input node and a descriptive prompt to guide the animation and environmental effects.AIKnowledge2Go
  4. 6:160:38Image-to-video generation with LTX-2.3The creator demonstrates the image-to-video workflow in ComfyUI, showing how starting from an input image improves text legibility and subject consistency in the final video.MDMZ
  5. 5:244:57Image-to-video generation with Wan 2.2The user demonstrates how to use the Wan 2.2 GGUF model in ComfyUI to animate a static image of a woman based on a detailed text prompt.pixaroma
  6. 6:300:17Advanced multi-node AI workflowsThe video shows a complex Roboneo setup where an image is generated, passed through an image editing node, and finally converted into a video.Malva AI
  7. 3:070:38Image to Video with LTX DirectorThe creator demonstrates dragging an image into the LTX Director timeline and entering a text prompt to generate a video of a woman waving her hand.What Dreams Cost
  8. 6:130:36Animate posters using Luma and Kling nodesThe demonstration shows how to chain a video generation node (Luma and Kling/Seance) to the end of an image workflow to animate the final poster design.Sebastian Kamph
  9. 23:511:57Animate 3D renders with Wan 2.1CurrentThe creator walks through a Wan 2.1 video generation workflow in ComfyUI, using the Painterly I2V node to control motion speed and animate a static 3D render.Matt Hallett Visual
  10. 0:171:00LTX-2 Image-to-Video distilled workflow setupThe demonstrator walks through loading the LTX-2 distilled checkpoint, upscaling models, and Gemma CLIP text encoder, while configuring resolution and frame rates for video generation.LTX
  11. 5:064:11Animate an image using Wan 2.1 in ComfyUIThe creator demonstrates loading a 'native image to video' workflow in ComfyUI, uploading a source image, and using the Wan 2.1 14B model to generate a high-quality video of a woman walking.Danish Sofi
  12. 10:201:00Generate AI video of a horse with Wan 2.1A second demonstration showing the image-to-video process where a static image of a horse is animated into a walking sequence using the Wan 2.1 model in ComfyUI.Danish Sofi