demobook

ComfyUI: Generating 3D motion from text prompts

Demo summary

Using the Hunyuan Motion 1.0 model in ComfyUI, a text prompt describing a person jumping between buildings is used to generate a specific 3D motion sequence.

Step-by-step

  1. Load the Hunyuan Motion 1.0 model in ComfyUI
  2. Enter a simple text prompt describing the desired motion
  3. Click generate to create the motion sequence
  4. Hover over the preview node to inspect the generated movement
  5. Locate the exported FBX file in the output folder under the 'Hanuan Motion_FBX' subfolder
  6. Tweak the seed or adjust the text prompt if the motion needs refinement

Options

  • Change variables in the generate node
  • Adjust the seed number for different motion variations

Tips

  • Keep text prompts simple as you only need to describe the motion itself rather than providing a detailed scene description
  • Grab the latest file in the subfolder to ensure you are working with the most recent generation

All demos from “Hunyuan Motion 1.0 - This Free And Open Source AI Creates 3D Animation In Seconds!

  1. 6:471:07Setting up Hunyuan Motion nodes in ComfyUIThe creator demonstrates how to add the 'load model' and 'motion generate' nodes in ComfyUI, connect them to a 3D preview node, and view a real-time skeleton animation of the generated motion.ComfyUIAI Animation Generator
  2. 8:210:59Generating 3D motion from text promptsCurrentUsing the Hunyuan Motion 1.0 model in ComfyUI, a text prompt describing a person jumping between buildings is used to generate a specific 3D motion sequence.ComfyUIAI Animation Generator
  3. 13:101:04Creating a character scene with DW Pose and Qwen2-VLThe creator shows how to extract a pose from the rendered motion using DW Pose and generate a descriptive caption using Qwen2-VL to prepare for final image generation.ComfyUIAI Image Generator
  4. 15:352:08Final video generation with Wan 2.1The demonstration shows how to use the Wan 2.1 V2V model to combine the generated 3D motion and a reference character image into a final, high-quality AI video animation.ComfyUIVideo to Video
  5. Watch “Hunyuan Motion 1.0 - This Free And Open Source AI Creates 3D Animation In Seconds!” →

AI Animation Generator

  1. 1:420:59Seed hunting with a multi-stage LTX 2.3 workflowThe creator demonstrates his custom ComfyUI workflow that generates four low-resolution LTX 2.3 samples simultaneously to find a 'golden seed' before upscaling to 1080p.Fox•Fur•Essence Films
  2. 16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.AI Search
  3. 20:151:53Text-to-Video generation in ComfyUIA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.AI Search
  4. 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.AI Search
  5. 0:510:36Configure Infinite Talk and Wan 2.1 models in ComfyUIThe user demonstrates loading the Infinite Talk model alongside the Wan 2.1 I2V 14B model within ComfyUI, including enabling block swap and torch compile for VRAM optimization.Olares
  6. 1:551:13Configure sampling and window settings for long video generationThe user walks through the Wan Video Wrapper sampling node, explaining how to set frame window size, motion frame overlap, and start steps for consistent video generation.Olares
  7. 0:310:46Generate cinematic video with LTX MSR workflowThe creator demonstrates using the LTX MSR workflow in ComfyUI to generate a video from multiple reference images and a prompt, highlighting the 3D camera movement and character consistency.Apex Artist
  8. 0:290:24Load source footage and models in ComfyUIThe user demonstrates importing source video footage and loading the necessary model nodes including WAN Video, VAE, and Clip Vision within the ComfyUI interface.ComfyUI
  9. 0:431:12Configure LTX-2.3 MSR LoRA and Prompt Relay in ComfyUIThe creator demonstrates setting up a ComfyUI workflow using the LTX-2.3 model with the MSR LoRA and Prompt Relay nodes to manage video generation on 8GB of VRAM.bigboss97
  10. 4:261:28Overview of the TensNodes Consistent Character Workflow in ComfyUIThe creator walks through a four-stage ComfyUI workflow utilizing TensNodes to process reference images and text for stable LTX video generation.SOTAI
  11. 3:411:25Configure LTX 2.3 foundational parametersA walkthrough of setting dimensions, frame counts, and loading core models including the LTX 2.3 distill model and audio VAE within a ComfyUI workflow.SOTAI
  12. 5:060:37Process visual and audio inputs in ComfyUIThe demo shows how to use the LTX V image-to-video condition node and empty latent audio node to prepare data for the generation engine.SOTAI