demobook

Runway: Control video motion with Keyframes

RunwayTry it →Watch full video →Skills Factory ·

Demo summary

The tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.

Step-by-step

  1. Define an image as the first keyframe
  2. Add up to two additional keyframes for the middle and end of the video
  3. Update the prompt description
  4. Click Camera Control at the bottom
  5. Adjust camera effects like panning or tilting
  6. Click Generate

Options

  • Add a central keyframe and a final keyframe
  • Describe camera movement directly in the text prompt instead of using camera controls

Watch out for

  • Camera settings apply to the entire video, not just a single keyframe

Tips

  • Use keyframes with similar content to prevent the generation from jumping to the last frame too quickly
  • Use keyframes to maintain the same style as the first image throughout the video

All demos from “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]

  1. 1:150:51Generate and restyle images in Runway Chat ModeThe user demonstrates how to use Runway's Chat Mode to generate an image of a horse from a text prompt and then uses a follow-up suggestion to restyle it into a cartoon.RunwayText to Image
  2. 2:482:06Video generation with Gen-4 TurboThe video shows the process of generating a 5-second cinematic video of a running horse using an image reference and a detailed text prompt in Runway's Gen-4 Turbo model.RunwayImage to Video
  3. 6:350:57Edit video with Runway AlephThe demonstrator uses the Aleph tool to modify a generated video by replacing a horse with a 'fire horse' using simple text instructions.RunwayVideo to Video
  4. 7:320:59Portrait video generation with Gen-3 Alpha TurboThe user demonstrates uploading a portrait image and using a text prompt to generate a 10-second vertical video using the Gen-3 Alpha Turbo model.RunwayImage to Video
  5. 8:451:02Control video motion with KeyframesCurrentThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.RunwayAI Animation Generator
  6. 9:530:25Change video aspect ratio with ExpandThe demonstrator uses the Expand Video feature to convert a portrait layout video into a landscape orientation.RunwayAI Video Editor
  7. 11:081:35Multi-reference image generation with @ symbolsThe user demonstrates generating a complex image by uploading multiple references (lion, jaguar pattern, volcano) and using @ symbols in the prompt to assign specific roles to each reference.RunwayAI Image Generator
  8. 14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.RunwayAI Animation Generator
  9. 15:280:32Lip Sync Video with Generative AudioThe user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.RunwayAI Lip Sync Generator
  10. 16:000:46Sketch-to-Image generationThe demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.RunwayImage to Image
  11. 16:510:30Direct image editing with Sketch and LabelsThe user draws an arrow and adds a label to a reference image to instruct the AI to 'pull down a branch' in the final generation.RunwayAI Inpainting
  12. Watch “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]” →

AI Animation Generator

  1. 13:201:07Performance-driven animation with Runway Act OneThe creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.Emmanuel Crown
  2. 6:420:45Using Motion Brush in Gen-2The demo shows how to use the Motion Brush tool to select specific areas of a reference image and apply directional motion to them.Skills Factory
  3. 8:451:02Control video motion with KeyframesCurrentThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Skills Factory
  4. 14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Skills Factory