Runway: Sketch-to-Image generation
RunwayDemo summary
The demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.
Step-by-step
- Select an image reference and give it a name
- Click the brush button to add a sketch
- Use the drawing tools at the bottom to paint directly on the image
- Click Export Sketch to use the drawing as a reference
- Update the name and add a supporting prompt
- Click Generate
Options
- Draw simple shapes
- Paint directly on the image
- Change the stroke color
Tips
- Use CTRL or CMD and Z to undo your action if you pick the wrong color
All demos from “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]”
- 1:150:51Generate and restyle images in Runway Chat ModeThe user demonstrates how to use Runway's Chat Mode to generate an image of a horse from a text prompt and then uses a follow-up suggestion to restyle it into a cartoon.Runway· Text to Image
- 2:482:06Video generation with Gen-4 TurboThe video shows the process of generating a 5-second cinematic video of a running horse using an image reference and a detailed text prompt in Runway's Gen-4 Turbo model.Runway· Image to Video
- 6:350:57Edit video with Runway AlephThe demonstrator uses the Aleph tool to modify a generated video by replacing a horse with a 'fire horse' using simple text instructions.Runway· Video to Video
- 7:320:59Portrait video generation with Gen-3 Alpha TurboThe user demonstrates uploading a portrait image and using a text prompt to generate a 10-second vertical video using the Gen-3 Alpha Turbo model.Runway· Image to Video
- 8:451:02Control video motion with KeyframesThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Runway· AI Animation Generator
- 9:530:25Change video aspect ratio with ExpandThe demonstrator uses the Expand Video feature to convert a portrait layout video into a landscape orientation.Runway· AI Video Editor
- 11:081:35Multi-reference image generation with @ symbolsThe user demonstrates generating a complex image by uploading multiple references (lion, jaguar pattern, volcano) and using @ symbols in the prompt to assign specific roles to each reference.Runway· AI Image Generator
- 14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Runway· AI Animation Generator
- 15:280:32Lip Sync Video with Generative AudioThe user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.Runway· AI Lip Sync Generator
- 16:000:46Sketch-to-Image generationCurrentThe demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.Runway· Image to Image
- 16:510:30Direct image editing with Sketch and LabelsThe user draws an arrow and adds a label to a reference image to instruct the AI to 'pull down a branch' in the final generation.Runway· AI Inpainting
- Watch “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]” →
Image to Image
- 16:000:46Sketch-to-Image generationCurrentThe demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.Skills Factory
1:370:42Generate custom character poses using reference imagesA step-by-step walkthrough of adding text and image reference nodes in Runway to apply a specific pose from a reference image to a generated character.Runway