demobook

ComfyUI: Controlling character poses with ControlNet

ComfyUITry it →Watch full video →AI SearchAI Search·

Demo summary

Demonstrates using the OpenPose pre-processor and ControlNet Union model to force a generated princess character into a specific pose from a reference image.

Step-by-step

  1. Connect the uploaded image node to an AV ControlNet Preprocessor node.
  2. Select the desired pre-processor type, such as 'openpose', from the node dropdown.
  3. Set the SD version to 'sdxl' to match the checkpoint.
  4. Adjust the resolution to 768 or 1024.
  5. Connect the pre-processed image output to the image input of the ControlNet node.
  6. Set the ControlNet strength (e.g., 0.8 for high influence or 1.0 for full influence).
  7. Insert the ControlNet node between the positive prompt and the KSampler.
  8. Click Queue Prompt to generate the image.

Options

  • Choose between different pre-processors like depth, canny, or line art within the same node.
  • Adjust image dimensions to non-square aspect ratios.
  • Use a Preview Image node to see the processed pose before generating the final image.
  • Bypass nodes using Ctrl+B to test specific parts of the workflow.

Watch out for

  • The first run will take longer as it must download the specific pre-processor models from Hugging Face.
  • The ControlNet strength must be above 0 to have any effect on the final image.

Tips

  • Use the AV ControlNet Preprocessor node because it contains all necessary pre-processors in a single node.
  • For SDXL, it is best to use 1024x1024 resolution, though 768x768 can be used for faster generation.
  • Set the strength to 1.0 if you want the character to follow the reference pose completely.

Highlights

“that's one example of how to use control net to control the composition of your image”

All demos from “Master AI image generation - ComfyUI FULL TUTORIAL”

  1. 7:390:44Basic text-to-image generation in ComfyUIThe user demonstrates a basic text-to-image workflow using the RealVisXL model to generate an image of a castle in a forest.ComfyUIText to Image
  2. 8:418:40Building a ComfyUI workflow from scratchA step-by-step walkthrough of adding nodes (Checkpoint, CLIP Text Encode, KSampler, VAE Decode) and connecting them to build a custom image generation pipeline.ComfyUIAI Image Generator
  3. 19:571:09Generating a medieval warrior with batch processingDemonstrates generating multiple images of a medieval warrior by increasing the batch size in the Empty Latent Image node.ComfyUIAI Image Generator
  4. 25:330:32Importing workflows from image metadataShows how to drag an existing AI-generated image into the ComfyUI canvas to automatically reconstruct the entire node workflow used to create it.ComfyUIAI Image Generator
  5. 30:073:41Upscaling images using modelsDemonstrates upscaling a low-resolution 512x512 image using the 4X Ultra Sharp model to add clarity and detail.ComfyUIAI Image Upscaler
  6. 36:021:32Using Preview Chooser for selective upscalingShows how to use the Image Chooser node to generate a batch of images and selectively progress only one specific image to the upscaler.ComfyUIAI Image Upscaler
  7. 41:391:29Image-to-image generation with denoisingDemonstrates the image-to-image process by loading an existing photo and adjusting the denoising strength to create variations.ComfyUIImage to Image
  8. 43:496:52Tiled upscaling with Ultimate SD UpscaleA detailed demo of the Ultimate SD Upscale node, showing how tiled upscaling generates significantly higher facial detail than standard upscaling.ComfyUIAI Image Upscaler
  9. 58:094:05Controlling character poses with ControlNetCurrentDemonstrates using the OpenPose pre-processor and ControlNet Union model to force a generated princess character into a specific pose from a reference image.ComfyUIAI Image Generator
  10. 1:02:141:23Landscape composition control with Canny ControlNetShows how to use the Canny edge pre-processor to maintain the shape of mountains while changing the lighting to a sunset.ComfyUIAI Inpainting
  11. 1:09:444:55Face swapping with InstantIDDemonstrates the full setup and execution of InstantID to swap Will Smith's face onto a generated policeman character in both realistic and watercolor styles.ComfyUIAI Face Swap Generator
  12. Watch “Master AI image generation - ComfyUI FULL TUTORIAL” →

AI Image Generator

  1. 1:560:39Load a text-to-image workflow and download missing modelsThe user demonstrates how to load a default text-to-image template in ComfyUI and use the 'show missing models' feature to download required AI checkpoints.Kevin Stratvert
  2. 4:110:29Manage generated assets in ComfyUIThe presenter demonstrates how to access the assets panel using the 'A' shortcut to view, save, or delete previously generated images.Kevin Stratvert
  3. 15:005:45Generate image with Hermes Agent and ComfyUIThe host uses the Hermes Agent TUI to request a 1024x1024 image of a tree using the Zimage Turbo model, which the agent executes by generating and running a ComfyUI workflow.ComfyUI
  4. 6:420:59Configure Gemma 2B Text Encoder in ComfyUIThe creator shows how to load the Gemma 2B text encoder model into the ComfyUI workflow and select it from the node dropdown menu.AI Search
  5. 4:270:30Copying and replacing prompts in ComfyUIThe user demonstrates a custom node feature that allows hovering over prompt examples to copy and then replace the current prompt in the workflow with a single click.pixaroma
  6. 13:030:51Managing node colors with PixaRoma nodesThe video demonstrates UI updates for PixaRoma nodes in ComfyUI, including selecting color swatches, copying/pasting colors between nodes, and setting favorite colors.pixaroma
  7. 4:150:35Launch ComfyUI on WindowsThe creator demonstrates how to launch the portable version of ComfyUI by running the 'run_nvidia_gpu' batch file and accessing the interface via a web browser.WINBUSH
  8. 10:071:30Browse and load ComfyUI templatesThe creator demonstrates how to navigate the templates menu, filter for local models, and load a Flux 2 image generation workflow.WINBUSH
  9. 0:000:33Configuring MSR mode in LTX DirectorThe user demonstrates setting up the Director node in ComfyUI for MSR (Multiple Subject Reference) mode, including bypassing clean latent slices and enabling the MSR LoRA.RedShade
  10. 5:090:19Loading LTX Director V5 workflow templateThe video shows how to search for and load the LTX Director V5 template within ComfyUI and input prompts for character generation.RedShade
  11. 4:251:21Iterative rerolling at specific generation stagesThe video shows how to use the 'reroll' button at specific stages of the workflow to change motion or visual quality without re-generating the initial seed samples.Fox•Fur•Essence Films
  12. 9:173:04Install ComfyUI using Easy InstallThe instructor demonstrates how to download the ComfyUI Easy Install zip from GitHub, extract it, and run the BAT file to set up a portable local installation.pixaroma
demobook

Show, don’t tell.

Categories

LaunchesEmail MarketingImage Generation & EditingMusic & AudioSales TechVideo & Animation

Trends

AI Fruit Video

About

SubmitAboutPrivacyTermsContact

© demobook.co