Midjourney: Image Prompt vs. Style Reference

Midjourney Try it →Watch full video →@GregIsenberg · Nov 2024

Demo summary

A comparison of how Midjourney treats an image as a standard image prompt (pulling pixels/subject) versus a style reference (pulling aesthetic/vibe).

Step-by-step

Drag an image into the Midjourney interface
Leave the image as a standard image prompt to pull subject matter and pixels
Adjust the image weight to increase the importance of the image relative to the text prompt
Click the paperclip icon to switch the image from an image prompt to a style reference
Click Use to pull the previous prompt back into the input field

Options

Switch between image prompt and style reference modes
Adjust style weight when using style references
Increase image weight to pull in more specific elements like colors or shapes

Watch out for

High image weights can cause 'wonky' results where the subject of the image prompt conflicts with the text prompt (e.g., a hand-giraffe hybrid)
By default, dragged-in images are treated as image prompts rather than style references

Tips

Use image prompts when you want to pull in specific subjects, colors, or shapes like rainbows and text
Use style references when you want the aesthetic or vibe rather than the actual pixels or subject matter
Be aware that image prompts will try to pull in the actual 'subject' of the source image

Highlights

“there's a huge difference when click that little paper clip so this is this is very important”

All demos from “The ULTIMATE guide to Midjourney (AI Design Tutorial)”

6:332:28Navigating the Midjourney Web App and Explore TabNick demonstrates how to use the Midjourney web interface instead of Discord, showing how to use the Explore tab to find inspiration and use existing images as style references.Midjourney· AI Image Generator
13:503:13Using Style References in MidjourneyThe demonstrator uploads vintage posters and applies them as style references (using the paperclip icon) to influence the aesthetic of a simple 'giraffe' prompt.Midjourney· AI Style Transfer
17:032:29Adjusting Style Weight and Aspect RatioNick shows how to use the '--sw' (style weight) parameter to increase the influence of a reference image and the '--ar' parameter to change the output to a poster aspect ratio.Midjourney· AI Image Generator
19:572:44Image Prompt vs. Style ReferenceCurrentA comparison of how Midjourney treats an image as a standard image prompt (pulling pixels/subject) versus a style reference (pulling aesthetic/vibe).Midjourney· AI Image Generator
25:291:45Using the Midjourney Editor to Remove ElementsNick uses the Midjourney web editor's brush tool to mask out unwanted text from a generated image and uses the '--no' parameter to refine the result.Midjourney· AI Object Remover/Eraser
29:344:04Fine-tuning with Midjourney PersonalizationThe video demonstrates the 'Personalize' feature where rating images creates a unique aesthetic code that can be applied to prompts to move away from the 'default AI look'.Midjourney· AI Image Generator
37:222:36Prompting with SREF CodesNick demonstrates using specific '--sref' numeric codes to apply consistent, curated styles to new prompts without needing to upload a source image.Midjourney· AI Style Transfer
39:585:12Blending Multiple Style ReferencesA demonstration of blending two different SREF codes using weighted double colons (e.g., ::2) to mix aesthetics like 'paper cutout' and 'glazed ceramic'.Midjourney· AI Image Combiner
50:462:24Mocking up Art in a Gallery with the EditorUsing the Midjourney Editor's outpainting/expand feature to place a previously generated giraffe illustration into a framed mockup on a gallery wall.Midjourney· AI Outpainting
Watch “The ULTIMATE guide to Midjourney (AI Design Tutorial)” →

AI Image Generator

4:580:06Design characters with MidjourneyThe video shows the iterative process of using Midjourney to design the visual appearance of the 'Optimax 5000' robot character.The Wall Street Journal
2:251:20Midjourney Web Interface and OrganizationThe video demonstrates how to generate images using the 'Imagine' prompt bar on the Midjourney website and how to organize generations into smart folders using keywords.Futurepedia
7:261:32Using the Stylize ParameterA demonstration of how the --stylize (or --s) parameter affects artistic output, comparing low values for realistic 'child drawings' versus high values for complex aesthetics.Futurepedia
8:581:51Exploring Weirdness and Chaos ParametersThe video shows how the --weird parameter introduces unconventional aesthetics and how the chaos parameter creates diverse initial image grids.Futurepedia
14:320:17Negative Prompting with the No ParameterThe user demonstrates removing specific objects (like bananas) from a generated fruit bowl using the --no parameter.Futurepedia
14:490:57Using Seed Numbers for ConsistencyThe demo shows how to copy a seed number from a previous generation and reuse it to maintain composition across different prompts.Futurepedia
47:341:24Training Midjourney PersonalizationShows the process of ranking image pairs in the 'Tasks' tab to generate a unique personalization code (--p) for custom aesthetics.Futurepedia
3:410:25Generate aesthetic concepts in MidjourneyThe creator shows Midjourney's ability to produce polished, high-aesthetic single images for mood boards while noting the difficulty in maintaining exact character identity between generations.BlockChainWorld
6:332:28Navigating the Midjourney Web App and Explore TabNick demonstrates how to use the Midjourney web interface instead of Discord, showing how to use the Explore tab to find inspiration and use existing images as style references.@GregIsenberg
17:032:29Adjusting Style Weight and Aspect RatioNick shows how to use the '--sw' (style weight) parameter to increase the influence of a reference image and the '--ar' parameter to change the output to a poster aspect ratio.@GregIsenberg
19:572:44Image Prompt vs. Style ReferenceCurrentA comparison of how Midjourney treats an image as a standard image prompt (pulling pixels/subject) versus a style reference (pulling aesthetic/vibe).@GregIsenberg
29:344:04Fine-tuning with Midjourney PersonalizationThe video demonstrates the 'Personalize' feature where rating images creates a unique aesthetic code that can be applied to prompts to move away from the 'default AI look'.@GregIsenberg