demobook

Text-to-Video generation in ComfyUI

Demo summary

A step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.

Step-by-step

  1. Select the downloaded models for each dropdown in the Step One card
  2. Choose the VAE model from the final dropdown in the card
  3. Enter your positive prompt in the text prompt field
  4. Enter any excluded elements in the negative prompt field
  5. Set the width, height, and length of the video in Step Four
  6. Calculate the length by multiplying the desired seconds by 24 (the FPS)
  7. Set the batch size to determine how many videos to generate
  8. Click Run to generate and save the video to the output folder

Options

  • Activate 'Easy Cache' via Ctrl+B or the toggle button to speed up generation
  • Adjust batch size to generate multiple videos at once

Watch out for

  • This specific workflow is for text-to-video only
  • Using Easy Cache speeds up the workflow but sacrifices video quality
  • Generation is slow; a 5-second video can take approximately 35 minutes on 16 GB of VRAM

Tips

  • To get a 5-second video at 24 FPS, set the frame length to 120

Highlights

notice that this was actually quite painfully slow

All demos from “We have a new #1 open-source AI video generator!

  1. 7:500:28Image-to-Video action testThe creator demonstrates image-to-video capabilities by uploading a static image and prompting for an intense fight scene in both Hunyuan and Wan models.ComfyUIImage to Video
  2. 16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.ComfyUIAI Animation Generator
  3. 20:151:53Text-to-Video generation in ComfyUICurrentA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.ComfyUIAI Animation Generator
  4. 22:461:42Upscaling video to 1080p in ComfyUIThe creator demonstrates how to activate and configure the 1080p super-resolution upscaler nodes within the ComfyUI workflow.ComfyUIAI Video Upscaler
  5. 24:303:12Image-to-Video workflow in ComfyUIA demonstration of the image-to-video workflow in ComfyUI, including uploading a source image, setting crop dimensions, and generating an animated anime scene.ComfyUIImage to Video
  6. 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.ComfyUIAI Animation Generator
  7. Watch “We have a new #1 open-source AI video generator!” →

AI Animation Generator

  1. 1:420:59Seed hunting with a multi-stage LTX 2.3 workflowThe creator demonstrates his custom ComfyUI workflow that generates four low-resolution LTX 2.3 samples simultaneously to find a 'golden seed' before upscaling to 1080p.Fox•Fur•Essence Films
  2. 16:361:56Setting up HunyuanVideo 1.5 in ComfyUIThe video demonstrates how to update ComfyUI and import the HunyuanVideo 1.5 JSON workflow files to create a node-based generation environment.AI Search
  3. 20:151:53Text-to-Video generation in ComfyUICurrentA step-by-step demo of configuring the Hunyuan nodes in ComfyUI, entering a prompt for a 'giant cat', and rendering the final 720p video.AI Search
  4. 29:151:33Running HunyuanVideo with GGUF (Low VRAM)The video shows how to use the GGUF loader node to run a compressed version of HunyuanVideo 1.5, enabling video generation on GPUs with as little as 6GB of VRAM.AI Search
  5. 0:510:36Configure Infinite Talk and Wan 2.1 models in ComfyUIThe user demonstrates loading the Infinite Talk model alongside the Wan 2.1 I2V 14B model within ComfyUI, including enabling block swap and torch compile for VRAM optimization.Olares
  6. 1:551:13Configure sampling and window settings for long video generationThe user walks through the Wan Video Wrapper sampling node, explaining how to set frame window size, motion frame overlap, and start steps for consistent video generation.Olares
  7. 0:310:46Generate cinematic video with LTX MSR workflowThe creator demonstrates using the LTX MSR workflow in ComfyUI to generate a video from multiple reference images and a prompt, highlighting the 3D camera movement and character consistency.Apex Artist
  8. 0:290:24Load source footage and models in ComfyUIThe user demonstrates importing source video footage and loading the necessary model nodes including WAN Video, VAE, and Clip Vision within the ComfyUI interface.ComfyUI
  9. 0:431:12Configure LTX-2.3 MSR LoRA and Prompt Relay in ComfyUIThe creator demonstrates setting up a ComfyUI workflow using the LTX-2.3 model with the MSR LoRA and Prompt Relay nodes to manage video generation on 8GB of VRAM.bigboss97
  10. 4:261:28Overview of the TensNodes Consistent Character Workflow in ComfyUIThe creator walks through a four-stage ComfyUI workflow utilizing TensNodes to process reference images and text for stable LTX video generation.SOTAI
  11. 3:411:25Configure LTX 2.3 foundational parametersA walkthrough of setting dimensions, frame counts, and loading core models including the LTX 2.3 distill model and audio VAE within a ComfyUI workflow.SOTAI
  12. 5:060:37Process visual and audio inputs in ComfyUIThe demo shows how to use the LTX V image-to-video condition node and empty latent audio node to prepare data for the generation engine.SOTAI