demobook

ComfyUI: Cartoon animation with Wan SCAIL

ComfyUITry it →Watch full video →pixaroma ·

Demo summary

The user shows how to animate a cartoon ballerina using a real-person video as a motion reference via the Wan SCAIL workflow in ComfyUI.

Step-by-step

  1. Download the detection models and place them in the detection folder.
  2. Download the Wan SCAIL model (FP8 or BF-16) and save it in a new 'scale' folder within diffusion models.
  3. Save the LoRA in the 'wan 2.2' folder within the models/loras directory.
  4. Place the control model in the control net folder.
  5. Press 'R' to refresh node definitions in ComfyUI.
  6. Load a cartoon image and a video of a real person with a similar aspect ratio.
  7. Set the resolution to a 9:16 portrait ratio (512 pixels base).
  8. Enter a prompt describing the action and generate the video.

Options

  • Use the BF-16 version of the model instead of FP8 if you have high VRAM
  • Keep the audio from the reference video in the final output

Watch out for

  • The motion reference must be a video of a real person; cartoon references may fail detection.
  • The model is trained on 512px video and cannot handle large resolutions.
  • Generation is slow, typically taking more than 10 minutes.

Tips

  • Use Wan SCAIL specifically for cartoons and non-realistic animations.
  • Use a 9:16 portrait ratio for the best results in testing.
  • Ensure the image and reference video have similar ratios for better alignment.

Highlights

“It is quite hard to organize it to make it make sense and also to be easy to use for beginners.”

All demos from “ComfyUI Video Models: InfiniteTalk + Wan 2.2 + SCAIL + LTX-2 (Ep06)”

  1. 5:244:57Image-to-video generation with Wan 2.2The user demonstrates how to use the Wan 2.2 GGUF model in ComfyUI to animate a static image of a woman based on a detailed text prompt.ComfyUIImage to Video
  2. 13:071:21Applying LoRA to Wan 2.2 video generationThe video shows how to integrate a LoRA (Low-Rank Adaptation) into a Wan 2.2 workflow to achieve specific cinematic movements like a face zoom.ComfyUIAI Animation Generator
  3. 15:344:59Character replacement with Wan AnimateThe creator demonstrates using Wan Animate and SAM 3 to mask a character in a reference video and replace them with a new character from a static image while maintaining the original motion.ComfyUIVideo to Video
  4. 21:072:43Cartoon animation with Wan SCAILCurrentThe user shows how to animate a cartoon ballerina using a real-person video as a motion reference via the Wan SCAIL workflow in ComfyUI.ComfyUIVideo to Video
  5. 25:063:04Create talking avatars with InfiniteTalkThe demonstration shows how to sync a static character image with an audio file to create a talking avatar using the InfiniteTalk model and Wan 2.1.ComfyUIAI Avatar Video Generator
  6. 31:133:44Text-to-video with LTX-2The video walks through setting up the LTX-2 model in ComfyUI to generate high-resolution video clips from text prompts and images.ComfyUIAI Animation Generator
  7. 36:000:39Singing characters with LTX-2 and custom audioThe creator demonstrates how to use LTX-2 to make a character sing by providing a custom audio file and a specific singing prompt.ComfyUIAI Lip Sync Generator
  8. 37:281:08Upscale video with Seed-V2The user demonstrates upscaling a low-resolution AI-generated video to Full HD using the Seed-V2 workflow in ComfyUI for improved sharpness.ComfyUIAI Video Upscaler
  9. 39:075:27Cloud-based ComfyUI on RunPod/RunHubThe video shows how to run complex video workflows in the cloud using RunHub AI, demonstrating the interface and execution of InfiniteTalk and Wan 2.2 without local hardware.ComfyUIAI Animation Generator
  10. 44:340:52Frame interpolation for smoother motionThe user demonstrates a workflow to double the frame rate of a 16fps video to 32fps to create smoother motion in AI-generated clips.ComfyUIAI Video Interpolation
  11. Watch “ComfyUI Video Models: InfiniteTalk + Wan 2.2 + SCAIL + LTX-2 (Ep06)” →

Video to Video

  1. 2:280:44Swap human character for 3D Pixar model in MochaThe creator demonstrates swapping a real person in a video with a 3D Pixar-style character using Mocha, showing the transfer of lip movements and hand gestures.AI Search
  2. 20:110:27Generating final character swap videoThe video shows the K-Sampler process and the final rendered output of a character replacement task within ComfyUI.AI Search
  3. 15:344:59Character replacement with Wan AnimateThe creator demonstrates using Wan Animate and SAM 3 to mask a character in a reference video and replace them with a new character from a static image while maintaining the original motion.pixaroma
  4. 21:072:43Cartoon animation with Wan SCAILCurrentThe user shows how to animate a cartoon ballerina using a real-person video as a motion reference via the Wan SCAIL workflow in ComfyUI.pixaroma
  5. 8:150:26Using Keyframes to guide video generationThe demo shows how to slide an image to a later point in the timeline to use it as a target keyframe, allowing the model to generate the action leading up to that specific visual.What Dreams Cost
  6. 15:352:08Final video generation with Wan 2.1The demonstration shows how to use the Wan 2.1 V2V model to combine the generated 3D motion and a reference character image into a final, high-quality AI video animation.Benji’s AI Playground
  7. 1:003:01Generate character-consistent video with Wan 2.6 R2VThe creator demonstrates a ComfyUI workflow using the Wan 2.6 API node to transform a 5-second reference video of himself into a new scene while maintaining character consistency and native audio lip-sync.Sebastian Kamph
  8. 4:031:00Generating Guide Videos with BFS NodeThe demo shows how to use the BFS Node extension to combine a reference face image and a driving video into a green-screen guide video required for the LTX sampling process.Veteran AI
  9. 5:030:47Injecting Latent Constraints with Add Guide MultiThe video demonstrates using the 'Add Guide Multi' node from the KJ Node extension to inject the guide video constraints and VAE-encoded latents into the sampling pipeline.Veteran AI
  10. 1:551:00Adding reference images for character consistencyThe video shows how to use the MSR custom node to input up to four reference images and a background image to maintain character facial consistency across video frames.bigboss97
  11. 8:521:04Replacing a dancing character with MochaA concrete demonstration of replacing a woman dancing in a video with a new character using the Mocha workflow in ComfyUI.SOTAI
  12. 12:450:58Replacing a human with an animated werewolfThe video demonstrates replacing a human actor with a stylized werewolf character while maintaining consistent textures and movement.SOTAI
demobook

Show, don’t tell.

Categories

Video & AnimationImage Generation & EditingSales TechEmail Marketing

About

SubmitAboutPrivacyTermsContact

© demobook.co