demobook

ComfyUI: Audio processing and vocal separation

Demo summary

The tutorial demonstrates the specialized audio nodes in the workflow that automatically filter background noise and separate vocals for accurate lip-syncing.

Step-by-step

  1. Locate the audio processing section in the workflow
  2. Upload your input audio file to the load node
  3. Keep all audio processing settings at their default values

Tips

  • Use this workflow to filter out background noise from songs or recordings to improve lip-syncing accuracy

Highlights

The beauty of this system is that you basically don't have to do anything here other than load your audio file

All demos from “Create UNLIMITED Talking Videos with InfiniteTalk! (ComfyUI Tutorial)

  1. 2:351:46Configure Infinite Talk models in ComfyUIThe creator demonstrates how to organize the necessary models within the ComfyUI workflow, including the Lightning LoRA, quantized Infinite Talk UNET models, and the Wan 2.1 VAE and Clip Vision nodes.ComfyUIAI Animation Generator
  2. 5:081:06Setting input image and frame parametersThe video shows how to load a source image into the ComfyUI workflow and adjust resolution and maximum frame settings based on GPU VRAM capacity.ComfyUIAI Image Generator
  3. 6:490:36Refining output with positive promptsThe demo shows how to use positive text prompts in ComfyUI to maintain visual consistency, such as fixing changing nail colors on the animated character.ComfyUIAI Image Generator
  4. 7:250:33Audio processing and vocal separationCurrentThe tutorial demonstrates the specialized audio nodes in the workflow that automatically filter background noise and separate vocals for accurate lip-syncing.ComfyUIAI Vocal Remover & Stem Splitter
  5. 7:580:38Generating the final talking videoThe creator shows the KSampler settings using Lightning LoRA for fast 7-step generation and displays the final 53-second talking head result.ComfyUIAI Avatar Video Generator
  6. Watch “Create UNLIMITED Talking Videos with InfiniteTalk! (ComfyUI Tutorial)” →

AI Vocal Remover & Stem Splitter

  1. 7:250:33Audio processing and vocal separationCurrentThe tutorial demonstrates the specialized audio nodes in the workflow that automatically filter background noise and separate vocals for accurate lip-syncing.Aiconomist