demobook

ComfyUI: Replacing a dancing character with Mocha

Demo summary

A concrete demonstration of replacing a woman dancing in a video with a new character using the Mocha workflow in ComfyUI.

Step-by-step

  1. Resize the source video to 512 by 880
  2. Extract the first frame of the video
  3. Create a mask from the extracted first frame
  4. Pad the reference image with gray on both sides to match the video aspect ratio
  5. Verify all condition inputs and the mask for accuracy
  6. Unbypass the nodes in the main workflow group
  7. Run the workflow

Watch out for

  • The reference image must match the same aspect ratio as the video

Tips

  • Before running the main workflow, make sure all your conditions are correct, especially the mask, to avoid wasting time rerunning it

Highlights

the workflow is running perfectly... successfully replaced in the original video with no artifacts or glitches at all

All demos from “Mocha vs Wan2.2 Animate: Best Workflow for PERFECT Character Replacement in ComfyUI

  1. 4:221:26Configuring Mocha Embeds in ComfyUIThe creator demonstrates how to set up the Mocha Embeds node in ComfyUI, connecting the VAE model, reference video, first-frame mask, and character reference images.ComfyUIAI Image Generator
  2. 5:500:25Processing reference video for MochaThe video shows how to use the Load Video and Image Scale nodes to prepare the reference video frames and prevent RAM overflow.ComfyUIAI Video Editor
  3. 6:150:37Creating a single-frame mask with SAM 2The demo shows how to use the Point Editor and SAM 2 nodes to generate a mask for only the first frame of the video, as required by Mocha.ComfyUIAI Video Editor
  4. 6:520:39Preparing character reference imagesThe creator demonstrates resizing and padding a target character image to match the video aspect ratio using color padding to avoid distortion.ComfyUIAI Expand Image
  5. 8:521:04Replacing a dancing character with MochaCurrentA concrete demonstration of replacing a woman dancing in a video with a new character using the Mocha workflow in ComfyUI.ComfyUIVideo to Video
  6. 12:450:58Replacing a human with an animated werewolfThe video demonstrates replacing a human actor with a stylized werewolf character while maintaining consistent textures and movement.ComfyUIVideo to Video
  7. 13:431:00Lip sync character replacement with MochaThe creator shows Mocha's ability to sync the lip movements of a new character (both human and animated) with the original video's audio.ComfyUIAI Lip Sync Generator
  8. Watch “Mocha vs Wan2.2 Animate: Best Workflow for PERFECT Character Replacement in ComfyUI” →

Video to Video

  1. 0:000:54Mocha character replacement showcaseThe video demonstrates Mocha's ability to replace characters in existing videos with new characters from reference images while maintaining original movements and lighting.AI Search
  2. 2:280:44Swap human character for 3D Pixar model in MochaThe creator demonstrates swapping a real person in a video with a 3D Pixar-style character using Mocha, showing the transfer of lip movements and hand gestures.AI Search
  3. 20:110:27Generating final character swap videoThe video shows the K-Sampler process and the final rendered output of a character replacement task within ComfyUI.AI Search
  4. 15:344:59Character replacement with Wan AnimateThe creator demonstrates using Wan Animate and SAM 3 to mask a character in a reference video and replace them with a new character from a static image while maintaining the original motion.pixaroma
  5. 21:072:43Cartoon animation with Wan SCAILThe user shows how to animate a cartoon ballerina using a real-person video as a motion reference via the Wan SCAIL workflow in ComfyUI.pixaroma
  6. 8:150:26Using Keyframes to guide video generationThe demo shows how to slide an image to a later point in the timeline to use it as a target keyframe, allowing the model to generate the action leading up to that specific visual.What Dreams Cost
  7. 15:352:08Final video generation with Wan 2.1The demonstration shows how to use the Wan 2.1 V2V model to combine the generated 3D motion and a reference character image into a final, high-quality AI video animation.Benji’s AI Playground
  8. 1:003:01Generate character-consistent video with Wan 2.6 R2VThe creator demonstrates a ComfyUI workflow using the Wan 2.6 API node to transform a 5-second reference video of himself into a new scene while maintaining character consistency and native audio lip-sync.Sebastian Kamph
  9. 4:031:00Generating Guide Videos with BFS NodeThe demo shows how to use the BFS Node extension to combine a reference face image and a driving video into a green-screen guide video required for the LTX sampling process.Veteran AI
  10. 5:030:47Injecting Latent Constraints with Add Guide MultiThe video demonstrates using the 'Add Guide Multi' node from the KJ Node extension to inject the guide video constraints and VAE-encoded latents into the sampling pipeline.Veteran AI
  11. 15:031:04Apply camera movement from reference videoThe creator demonstrates copying camera motion and pose dynamics from a reference video (like a dance clip) and applying it to a still character image.Yaroflasher
  12. 1:551:00Adding reference images for character consistencyThe video shows how to use the MSR custom node to input up to four reference images and a background image to maintain character facial consistency across video frames.bigboss97