Performance-driven animation with Runway Act One
RunwayDemo summary
The creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.
Step-by-step
- Navigate to Runway ML and select Act One
- Upload a character image or a video containing the character you want to animate
- Wait for the system to detect the face in your uploaded media
- Choose to either upload a pre-recorded video or record a live performance
- Adjust your camera to capture your face clearly
- Click record and perform the facial expressions and dialogue
Options
- Upload a character image instead of a video
- Use video generated from Runway or Kling AI as the character source
- Upload a pre-recorded video of a performance instead of recording live
Watch out for
- The system must successfully detect the face in the character video or image before proceeding
Tips
- Use a video for the character source if you want to preserve existing animations in the final output
Highlights
“gives you the ultimate best sort of lip sync whenever it works cuz it's very natural”
All demos from “How to Create Full Animated Stories Using ChatGPT Images”
- 2:102:18Generate animation scripts and prompts with Animation Script Builder GPTThe creator demonstrates using his custom 'Animation Script Builder' GPT in ChatGPT to generate a character list, scene-by-scene shot list, and specific text-to-image and image-to-video prompts.ChatGPT· AI Storyboard Generator
- 4:432:49Generate consistent characters and scenes in ChatGPT-4oThe user demonstrates how to use ChatGPT-4o to generate consistent character reference images and scene shots based on the previously generated script prompts.ChatGPT· AI Person Generator
- 8:032:02Animate images using Kling AIThe video shows the process of uploading a generated image to Kling AI and applying an image-to-video prompt to create a 3D-style animation.Kling AI· Image to Video
- 10:570:32Lip sync animation in Kling AIThe demonstration shows how to use the 'Lip Sync' feature in Kling AI by uploading a local audio file to match a character's mouth movements to the dialogue.Kling AI· AI Lip Sync Generator
- 12:171:01Animate and lip sync with Runway Gen-3 AlphaThe video shows the workflow in Runway ML for generating video from an image and using the lip sync action to align audio with the character's face.Runway· AI Lip Sync Generator
- 13:201:07Performance-driven animation with Runway Act OneCurrentThe creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.Runway· AI Animation Generator
- 15:130:28Assemble animated scenes in CapCutThe video demonstrates the final assembly of video clips, audio tracks, and sound design within the CapCut desktop video editor.CapCut· AI Video Editor
- Watch “How to Create Full Animated Stories Using ChatGPT Images” →
AI Animation Generator
- 13:201:07Performance-driven animation with Runway Act OneCurrentThe creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.Emmanuel Crown
6:420:45Using Motion Brush in Gen-2The demo shows how to use the Motion Brush tool to select specific areas of a reference image and apply directional motion to them.Skills Factory
8:451:02Control video motion with KeyframesThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Skills Factory- 14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Skills Factory