Transfer performance with Runway Act-One
Runway
Demo summary
The tutorial shows how to use Runway Act-One (referred to as Act Two) by uploading a 'driving video' of a person speaking and a target character video to transfer the facial performance and lip-sync.
Step-by-step
- Navigate to the Runway dashboard
- Go to the Generate Video section
- Select the Act-One (referred to as Act 2) button
- Drag and drop your performance video into the designated box
- Drag and drop your target character video into the character box
- Click Generate Character
Watch out for
- The tool cannot detect faces if they are obscured by hands or objects
- The subject in the driving video must be more or less facing the direction needed for the character composite
Tips
- Ensure the input video has a clear, unobstructed view of the face to avoid generation errors
Highlights
“it's a little picky with the type of video clip that you can use”
All demos from “The BEST AI Video Lip Sync Techniques (Pro Tutorial)”
- 3:410:41Upscale AI video with Topaz Video AIThe video shows the process of dragging 720p footage into Topaz Video AI, selecting the Proteus model, and exporting at 4K resolution to improve detail.Topaz Video AI· AI Video Upscaler
- 8:011:14Sync audio to image using HeyGen Photo to VideoThe user demonstrates uploading a Midjourney image and an ElevenLabs audio file to HeyGen's Avatar 4 tool, including using a text prompt for directorial control over the character's expression.HeyGen· AI Avatar Video Generator
- 9:481:36Smooth AI lip-sync jitter with Topaz Video AIA demonstration of using the Chronos model in Topaz Video AI for frame interpolation to fix jittery mouth movements in AI-generated lip-sync videos.Topaz Video AI· AI Video Interpolation
- 15:111:55Transfer performance with Runway Act-OneCurrentThe tutorial shows how to use Runway Act-One (referred to as Act Two) by uploading a 'driving video' of a person speaking and a target character video to transfer the facial performance and lip-sync.Runway· Video to Video
- Watch “The BEST AI Video Lip Sync Techniques (Pro Tutorial)” →
Video to Video
12:411:00Transform video scenes with Runway Gen-3 AlphaThe user demonstrates uploading a video of himself riding a bike into Runway and using text prompts to transform the environment into a blizzard and a heavy downpour.Kevin Stratvert- 15:111:55Transfer performance with Runway Act-OneCurrentThe tutorial shows how to use Runway Act-One (referred to as Act Two) by uploading a 'driving video' of a person speaking and a target character video to transfer the facial performance and lip-sync.Curious Refuge
9:080:39Stylize video into watercolor paintingThe video shows the stylization tool converting a standard video clip into a watercolor art style using a text prompt.Emma's Productivity Lab
9:570:45Change camera angles using Runway AlephThe creator demonstrates the model's ability to generate a completely different camera angle of a subject from a single original video shot.Joris Hermans
6:350:57Edit video with Runway AlephThe demonstrator uses the Aleph tool to modify a generated video by replacing a horse with a 'fire horse' using simple text instructions.Skills Factory
38:592:37Character animation with Runway Act OneA demonstration of Runway's Act One tool, where a driving video of the presenter is used to animate a static image of Nicolas Cage, matching facial expressions and lip movements.The FAIK Files
7:521:32Video-to-Video manipulation with Runway Gen-1The user demonstrates uploading a video to the Gen-1 interface to modify its style and content using presets and text prompts.Skills Factory- 10:050:26Animate characters with Runway Act-OneThe video demonstrates the Act-One tool, showing how a character image can follow the facial expressions and movements of a source video.Skills Factory
5:410:12Apply character styles with Runway ReStyleThe demonstration shows how a video of a human actor's performance is transformed into a stylized AI character using Runway ReStyle.The Wall Street Journal