RunComfy: Testing prompt adherence in Flux
RunComfyDemo summary
A demonstration of complex prompt adherence by generating a high-quality image of a dog riding a dolphin at sunset.
Step-by-step
- Enter a descriptive prompt including specific subjects and environmental details
- Select the Flux model from the available options
- Click Queue Prompt to generate the image
- Review the generated output for prompt adherence
- Modify the prompt with a specific style tag like 'anime style' to iterate
Options
- Load the 'large' version of the model if system resources allow
- Use image-to-image workflows as an alternative to text-only prompts
Watch out for
- IP adapter models are not yet available for Flux
- ControlNet models are not yet available for Flux
- LoRA results for Flux are currently inconsistent or experimental
- Flux is a larger model and requires checking for sufficient loading capacity
Tips
- Experiment with spatial directions like 'something on the left' or 'something on the right' to test adherence
- Expect a wait of a few weeks to months for full training of auxiliary tools like ControlNet
Highlights
“I think I can like pretty convincingly say like this looks pretty damn good”
All demos from “Getting Started with Flux in RunComfy”
- 0:180:54Launching a Flux workflow in RunComfyThe user selects the 'comfy y flux' workflow from the RunComfy dashboard and configures the GPU instance size to launch the environment.RunComfy· AI Image Generator
- 1:313:07Configuring Flux nodes in ComfyUIA walkthrough of the Flux-specific nodes in ComfyUI, including the dual clip loaders, the basic guider, and the sampler custom advanced node used for Flux generation.ComfyUI· AI Image Generator
- 7:020:23Text-to-image generation with FluxThe user demonstrates Flux's prompt adherence by generating an image of an old TV with the word 'flux' on it in an abandoned workshop.ComfyUI· Text to Image
- 7:252:04Testing prompt adherence in FluxCurrentA demonstration of complex prompt adherence by generating a high-quality image of a dog riding a dolphin at sunset.RunComfy· Text to Image
- 9:314:03Image-to-image denoising with FluxThe user demonstrates how Flux handles image-to-image tasks by adjusting the denoise strength from 0.4 to 1.0 to show how it differs from Stable Diffusion.ComfyUI· Image to Image
- 13:342:35Fast image generation with Flux SchnellThe user switches to the Flux Schnell model and reduces the sampling steps to four to demonstrate high-speed image generation.ComfyUI· AI Image Generator
- Watch “Getting Started with Flux in RunComfy” →
Text to Image
- 7:252:04Testing prompt adherence in FluxCurrentA demonstration of complex prompt adherence by generating a high-quality image of a dog riding a dolphin at sunset.Artificial Images