Runway: Control video motion with Keyframes

Demo summary
The tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.
Step-by-step
- Define an image as the first keyframe
- Add up to two additional keyframes for the middle and end of the video
- Update the prompt description
- Click Camera Control at the bottom
- Adjust camera effects like panning or tilting
- Click Generate
Options
- Add a central keyframe and a final keyframe
- Describe camera movement directly in the text prompt instead of using camera controls
Watch out for
- Camera settings apply to the entire video, not just a single keyframe
Tips
- Use keyframes with similar content to prevent the generation from jumping to the last frame too quickly
- Use keyframes to maintain the same style as the first image throughout the video
All demos from “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]”
1:150:51Generate and restyle images in Runway Chat ModeThe user demonstrates how to use Runway's Chat Mode to generate an image of a horse from a text prompt and then uses a follow-up suggestion to restyle it into a cartoon.Runway· Text to Image
2:482:06Video generation with Gen-4 TurboThe video shows the process of generating a 5-second cinematic video of a running horse using an image reference and a detailed text prompt in Runway's Gen-4 Turbo model.Runway· Image to Video
6:350:57Edit video with Runway AlephThe demonstrator uses the Aleph tool to modify a generated video by replacing a horse with a 'fire horse' using simple text instructions.Runway· Video to Video
7:320:59Portrait video generation with Gen-3 Alpha TurboThe user demonstrates uploading a portrait image and using a text prompt to generate a 10-second vertical video using the Gen-3 Alpha Turbo model.Runway· Image to Video
8:451:02Control video motion with KeyframesCurrentThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Runway· AI Animation Generator
9:530:25Change video aspect ratio with ExpandThe demonstrator uses the Expand Video feature to convert a portrait layout video into a landscape orientation.Runway· AI Video Editor
11:081:35Multi-reference image generation with @ symbolsThe user demonstrates generating a complex image by uploading multiple references (lion, jaguar pattern, volcano) and using @ symbols in the prompt to assign specific roles to each reference.Runway· AI Image Generator
14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Runway· AI Animation Generator
15:280:32Lip Sync Video with Generative AudioThe user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.Runway· AI Lip Sync Generator
16:000:46Sketch-to-Image generationThe demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.Runway· Image to Image
16:510:30Direct image editing with Sketch and LabelsThe user draws an arrow and adds a label to a reference image to instruct the AI to 'pull down a branch' in the final generation.Runway· AI Inpainting- Watch “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]” →
AI Animation Generator
13:201:07Performance-driven animation with Runway Act OneThe creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.Emmanuel Crown
6:420:45Using Motion Brush in Gen-2The demo shows how to use the Motion Brush tool to select specific areas of a reference image and apply directional motion to them.Skills Factory
8:451:02Control video motion with KeyframesCurrentThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Skills Factory
14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Skills Factory
Runway