demobook

After Effects: Text-to-image generation with Diffusers

Demo summary

The user shows how to generate a new image of a horse directly inside After Effects using the DeepMake Diffusers plugin and seed adjustments.

Step-by-step

  1. Create a new project and a new composition
  2. Set the composition height and width to 512 by 512
  3. Create a new Solid layer
  4. Apply the Effect 'DeepMake AI plugin renderer'
  5. In Effect Controls, select 'diffusers' as the plugin
  6. Adjust the 'iterations' setting to define rendering quality
  7. Enter a simple description in the prompt field using commas for detail
  8. Change the 'seed' value to generate a different variation of the same prompt

Options

  • Set height and width to any custom dimensions
  • Adjust iterations (lower for speed, higher for quality)

Watch out for

  • Low iteration counts (e.g., 1) will render quickly but will not produce a full or high-quality image

Tips

  • Think of AI as a child; be very literal with your prompts
  • Use descriptions and commas in your prompt to improve the output
  • Change the seed to get a different image generation without having to change your prompt text

Highlights

easy next up I'm going to show you how to use the diffusers

All demos from “How to set up DeepMake AI plugins for After Effects and use them

  1. 1:241:50Masking objects with GSAM in After EffectsThe user demonstrates how to use the GSAM plugin within DeepMake to automatically mask out a supercar from stock footage using a text prompt.After EffectsAI Video Editor
  2. 3:141:32Text-to-image generation with DiffusersCurrentThe user shows how to generate a new image of a horse directly inside After Effects using the DeepMake Diffusers plugin and seed adjustments.After EffectsText to Image
  3. 4:461:06Image-to-image refinement with DiffusersThe user demonstrates the 'refine image' feature of the Diffusers plugin to transform a generated horse image into a zebra while maintaining the original composition.After EffectsImage to Image
  4. 7:040:18Upscaling images with Basic SRThe user demonstrates upscaling a generated image by 4x to fit composition dimensions using the Basic SR plugin.After EffectsAI Image Upscaler
  5. 7:220:28Face and body masking with BisenetThe user shows how to use the Bisenet plugin to select and mask specific human features like the face, hair, and clothes on a generated character.After EffectsAI Inpainting
  6. 9:010:48Loading custom Stable Diffusion modelsThe user demonstrates how to import a custom model path from CivitAI into the DeepMake plugin configuration to generate images using specific external models.After EffectsAI Image Generator
  7. Watch “How to set up DeepMake AI plugins for After Effects and use them” →

Text to Image

  1. 3:141:32Text-to-image generation with DiffusersCurrentThe user shows how to generate a new image of a horse directly inside After Effects using the DeepMake Diffusers plugin and seed adjustments.DeepMake