ComfyUI: Landscape composition control with Canny ControlNet

ComfyUI Try it →Watch full video →AI Search · Aug 2024

Demo summary

Shows how to use the Canny edge pre-processor to maintain the shape of mountains while changing the lighting to a sunset.

Step-by-step

Upload the reference image to the ControlNet node
Select the Canny pre-processor from the dropdown menu
Connect the pre-processor output to the ControlNet input
Update the positive prompt to include 'mountains' and 'sunset'
Generate the image to apply the new lighting to the existing composition

Options

Use Depth pre-processor instead of Canny
Use Line Art pre-processor instead of Canny

Tips

Play around with different pre-processors to find which one gives you the specific level of control needed for your composition
Use Canny when you want the final image to match the specific shapes and edges of your original upload

Highlights

“how cool is that basically there are so many different options you can choose from for control net... to really give you maximum control over the composition”

All demos from “Master AI image generation - ComfyUI FULL TUTORIAL”

7:390:44Basic text-to-image generation in ComfyUIThe user demonstrates a basic text-to-image workflow using the RealVisXL model to generate an image of a castle in a forest.ComfyUI· Text to Image
8:418:40Building a ComfyUI workflow from scratchA step-by-step walkthrough of adding nodes (Checkpoint, CLIP Text Encode, KSampler, VAE Decode) and connecting them to build a custom image generation pipeline.ComfyUI· AI Image Generator
19:571:09Generating a medieval warrior with batch processingDemonstrates generating multiple images of a medieval warrior by increasing the batch size in the Empty Latent Image node.ComfyUI· AI Image Generator
25:330:32Importing workflows from image metadataShows how to drag an existing AI-generated image into the ComfyUI canvas to automatically reconstruct the entire node workflow used to create it.ComfyUI· AI Image Generator
30:073:41Upscaling images using modelsDemonstrates upscaling a low-resolution 512x512 image using the 4X Ultra Sharp model to add clarity and detail.ComfyUI· AI Image Upscaler
36:021:32Using Preview Chooser for selective upscalingShows how to use the Image Chooser node to generate a batch of images and selectively progress only one specific image to the upscaler.ComfyUI· AI Image Upscaler
41:391:29Image-to-image generation with denoisingDemonstrates the image-to-image process by loading an existing photo and adjusting the denoising strength to create variations.ComfyUI· Image to Image
43:496:52Tiled upscaling with Ultimate SD UpscaleA detailed demo of the Ultimate SD Upscale node, showing how tiled upscaling generates significantly higher facial detail than standard upscaling.ComfyUI· AI Image Upscaler
58:094:05Controlling character poses with ControlNetDemonstrates using the OpenPose pre-processor and ControlNet Union model to force a generated princess character into a specific pose from a reference image.ComfyUI· AI Image Generator
1:02:141:23Landscape composition control with Canny ControlNetCurrentShows how to use the Canny edge pre-processor to maintain the shape of mountains while changing the lighting to a sunset.ComfyUI· AI Inpainting
1:09:444:55Face swapping with InstantIDDemonstrates the full setup and execution of InstantID to swap Will Smith's face onto a generated policeman character in both realistic and watercolor styles.ComfyUI· AI Face Swap Generator
Watch “Master AI image generation - ComfyUI FULL TUTORIAL” →

AI Inpainting

1:02:141:23Landscape composition control with Canny ControlNetCurrentShows how to use the Canny edge pre-processor to maintain the shape of mountains while changing the lighting to a sunset.AI Search
6:360:29Adjust mask expansion settingsThe user demonstrates adjusting the 'Grow Mask with Blur' node's expand value to accommodate larger replacement characters.MDMZ
3:120:44Anime character replacement with MochaA demonstration of replacing one anime character with another using a reference image, highlighting the tool's performance on complex outfits and hair.AI Search
7:201:48Edit image details with Flux KontextThe user shows how to load a reference image and use a text prompt to change specific features, such as changing a cartoon bunny's eye color to red.pixaroma
19:191:08Modify hairstyles and facial featuresThe creator shows how to change a subject's hair color and style (e.g., to a blunt bob with bangs) while attempting to maintain facial consistency using Flux Kontext.pixaroma
21:030:26Edit text within an imageA demonstration of Flux Kontext's ability to change text on a 3D render from 'Welcome' to 'Pixaroma' while maintaining the original font style and perspective.pixaroma
23:191:55Remove objects using Mask Editor and InpaintingThe user demonstrates precisely removing a necklace from a portrait by painting a mask in the ComfyUI Mask Editor and using an inpainting prompt.pixaroma
16:571:43Generate composite image with Flux 2The creator demonstrates image-to-image generation by uploading two reference photos and using a text prompt to replace a logo on a coffee can with his own headshot using the Flux model.WINBUSH
20:010:28Text-to-image manipulation in ComfyUIThe video shows how to use a text prompt to attempt to rotate an object in an image within a specific node-based workflow.WINBUSH
15:063:12Transform 3D scenes with Qwen2-VL (Qwen-Edit)The creator uses the Qwen-Edit workflow to perform complex scene modifications, such as changing weather to rain or snow, while preserving the original 3D geometry and text.Matt Hallett Visual
20:221:07Fix text and faces using Crop and StitchA demonstration of a custom 'crop image' node to isolate specific areas like signs or faces, regenerate them at native resolution, and stitch them back into the high-res image.Matt Hallett Visual
8:230:24Change hairstyles with AIA demonstration of using an outfit change system to apply a new haircut to a character by using a hairstyle image as a reference.Yaroflasher