Motion capture with Runway Act-One

Runway Try it →Watch full video →TTao Prompts

Demo summary

The user demonstrates the 'Act-One' feature in Runway, uploading a video of himself to map his facial expressions and movements onto a 3D goblin character.

Step-by-step

Navigate to the Video Generator in Runway
Select the Act-One feature
Upload a driving performance video of yourself
Upload the image of the character you want to map movements onto
Adjust the level of expressiveness parameters
Enable the movements and gestures setting

Options

Adjust the level of expressiveness
Toggle inclusion of movements and gestures

Tips

Include movements and gestures in the settings for a better result

Highlights

“one of the most impressive video to video features where you can motion capture a video of yourself”

All demos from “The 5 Levels of Creating AI Videos (and How to Level Up)”

0:400:16Text-to-video generation with Google VEOThe creator demonstrates entering a text prompt into Google VEO 3 to generate a scene of a stormtrooper in action.Google Vids· Text to Video
2:040:35Image-to-video animation with Google VEOThe user uploads a personal photo to Google VEO, adjusts settings to 'frames to video', and provides a prompt to animate himself vlogging.Google Vids· Image to Video
4:541:21Character consistency with Nano BananaThe creator demonstrates uploading a character reference image into Nano Banana on the Higsfield platform and using a descriptive prompt to place the character in a sci-fi cockpit.Higsfield· AI Person Generator
8:410:47Style referencing in MidjourneyThe user demonstrates dragging an image into the Midjourney prompt bar to use as a style reference for generating a consistent polar bear scene.Midjourney· Image to Image
15:090:34Keyframe transitions with Kling AIThe creator demonstrates uploading a starting illustration and an end photo into Kling AI to generate a seamless transition between two frames.Kling AI· Image to Video
16:240:40Motion capture with Runway Act-OneCurrentThe user demonstrates the 'Act-One' feature in Runway, uploading a video of himself to map his facial expressions and movements onto a 3D goblin character.Runway· AI Animation Generator
18:310:27Video upscaling with Topaz AIThe creator shows the process of uploading an AI-generated video into Topaz AI and selecting 4K output to enhance resolution and detail.Topaz Video AI· AI Video Upscaler
Watch “The 5 Levels of Creating AI Videos (and How to Level Up)” →

AI Animation Generator

8:451:02Control video motion with KeyframesThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.Skills Factory
14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.Skills Factory
13:201:07Performance-driven animation with Runway Act OneThe creator demonstrates Runway's Act One tool, showing how a live camera recording of his own facial performance can drive the animation and expressions of a generated character.Emmanuel Crown
6:420:45Using Motion Brush in Gen-2The demo shows how to use the Motion Brush tool to select specific areas of a reference image and apply directional motion to them.Skills Factory
16:240:40Motion capture with Runway Act-OneCurrentThe user demonstrates the 'Act-One' feature in Runway, uploading a video of himself to map his facial expressions and movements onto a 3D goblin character.Tao Prompts