ComfyUI: Generate sound effects with Stable Audio
ComfyUIDemo summary
The creator demonstrates generating specific sound effects like 'creaky doors' and 'underwater fireworks' using the medium and small sound effects models.
Step-by-step
- Select the Stable Audio medium model for sound effect generation
- Enter a prompt for a specific sound effect like 'creaky doors'
- Generate the audio clip
- Switch to the small sound effects model to compare results
- Input a complex prompt such as 'fireworks exploding underwater' to test model capabilities
Options
- Use the medium sound effects model
- Use the small sound effects model
Watch out for
- The small sound effects model produces significantly quieter output compared to the medium model
Tips
- Expect the medium model to provide better quality and more distinct sound characteristics than the small model
Highlights
“I think that probably actually does sound like fireworks exploding underwater. Nice.”
All demos from “Make High Quality Music in ComfyUI - Low VRAM!”
- 1:191:36Generate music with Stable Audio 3 Medium in ComfyUIThe creator demonstrates loading the Stable Audio 3 medium model in ComfyUI, setting up a prompt for 'gothic techno', and configuring the audio duration to 95 seconds before generating the track.ComfyUI· AI Music Generator
- 3:330:34Low VRAM audio generation with Small modelThe user switches to the 2GB 'small' model in ComfyUI to demonstrate audio generation suitable for low-end GPUs.ComfyUI· AI Music Generator
- 6:311:11AI Prompt Generation with GemmaThe creator shows an 'audio to text to audio' pipeline using Gemma to describe an audio input and generate a new prompt for the music generation node.ComfyUI· AI Music Generator
- 7:421:39Audio-to-Audio VAE EncodingThe demo shows loading an existing audio file (beats from Ace Step) into ComfyUI using VAE encoding to influence the style of the generated output.ComfyUI· AI Song Remixer
- 10:170:59Audio conditioning with voice inputThe user demonstrates using a 30-second vocal recording as an input combined with a text prompt and a linear quadratic scheduler to generate a new track.ComfyUI· AI Music Generator
- 11:161:07Generate sound effects with Stable AudioCurrentThe creator demonstrates generating specific sound effects like 'creaky doors' and 'underwater fireworks' using the medium and small sound effects models.ComfyUI· AI Sound Effect Generator
- 12:232:02Multi-sampler audio modificationThe video shows a workflow using two samplers in sequence, where the first stops at step four and the second continues, allowing for variations in the final audio output.ComfyUI· AI Audio Editor
- Watch “Make High Quality Music in ComfyUI - Low VRAM!” →
AI Sound Effect Generator
- 11:161:07Generate sound effects with Stable AudioCurrentThe creator demonstrates generating specific sound effects like 'creaky doors' and 'underwater fireworks' using the medium and small sound effects models.Nerdy Rodent