demobook

Adjusting Classifier-Free Guidance scale in Stable Diffusion

Demo summary

The demonstration shows how increasing the guidance scale alpha from 0 to higher values causes a tree to physically grow and gain detail within a desert scene in Stable Diffusion.

Step-by-step

  1. Add classifier-free guidance to the model
  2. Increase the guidance scale alpha to approximately 2 to generate the initial subject
  3. Continue increasing the scaling factor alpha to improve the size and detail of the generated subject

Tips

  • Use guidance to point the model's vector field more directly toward the prompt

Highlights

The fact that this works so well is remarkable to me.

All demos from “But how do AI images and videos actually work? | Guest video by Welch Labs

  1. 10:170:20Comparing DDPM sampling with and without noise in Stable Diffusion 2The demo shows the difference in output quality when generating a 'tree in the desert' using Stable Diffusion 2, contrasting a sharp image with a blurry one when the noise step is removed.Stable DiffusionAI Image Generator
  2. 33:080:29Adjusting Classifier-Free Guidance scale in Stable DiffusionCurrentThe demonstration shows how increasing the guidance scale alpha from 0 to higher values causes a tree to physically grow and gain detail within a desert scene in Stable Diffusion.Stable DiffusionAI Image Generator
  3. Watch “But how do AI images and videos actually work? | Guest video by Welch Labs” →

AI Image Generator

  1. 10:170:20Comparing DDPM sampling with and without noise in Stable Diffusion 2The demo shows the difference in output quality when generating a 'tree in the desert' using Stable Diffusion 2, contrasting a sharp image with a blurry one when the noise step is removed.3Blue1Brown
  2. 33:080:29Adjusting Classifier-Free Guidance scale in Stable DiffusionCurrentThe demonstration shows how increasing the guidance scale alpha from 0 to higher values causes a tree to physically grow and gain detail within a desert scene in Stable Diffusion.3Blue1Brown