demobook

Runway: Lip Sync Video with Generative Audio

RunwayTry it →Watch full video →Skills Factory ·

Demo summary

The user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.

Step-by-step

  1. Open Generative Audio and select Lip Sync Video
  2. Import your character video or select a template
  3. Upload an audio file or type the text you want spoken
  4. Click the microphone button to choose a voice
  5. Click Generate to create the final video

Options

  • Use a pre-made Runway template instead of importing a video
  • Upload an existing audio file instead of using text-to-speech

Watch out for

  • The tool mainly works on human faces

All demos from “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]

  1. 1:150:51Generate and restyle images in Runway Chat ModeThe user demonstrates how to use Runway's Chat Mode to generate an image of a horse from a text prompt and then uses a follow-up suggestion to restyle it into a cartoon.RunwayText to Image
  2. 2:482:06Video generation with Gen-4 TurboThe video shows the process of generating a 5-second cinematic video of a running horse using an image reference and a detailed text prompt in Runway's Gen-4 Turbo model.RunwayImage to Video
  3. 6:350:57Edit video with Runway AlephThe demonstrator uses the Aleph tool to modify a generated video by replacing a horse with a 'fire horse' using simple text instructions.RunwayVideo to Video
  4. 7:320:59Portrait video generation with Gen-3 Alpha TurboThe user demonstrates uploading a portrait image and using a text prompt to generate a 10-second vertical video using the Gen-3 Alpha Turbo model.RunwayImage to Video
  5. 8:451:02Control video motion with KeyframesThe tutorial shows how to define multiple image keyframes and use camera controls (panning/tilting) to guide the motion of a generated video.RunwayAI Animation Generator
  6. 9:530:25Change video aspect ratio with ExpandThe demonstrator uses the Expand Video feature to convert a portrait layout video into a landscape orientation.RunwayAI Video Editor
  7. 11:081:35Multi-reference image generation with @ symbolsThe user demonstrates generating a complex image by uploading multiple references (lion, jaguar pattern, volcano) and using @ symbols in the prompt to assign specific roles to each reference.RunwayAI Image Generator
  8. 14:240:51Motion transfer with Runway Act TwoThe video shows how to use a webcam recording or uploaded video to transfer facial and body gestures onto a character image (a lion) using the Act Two feature.RunwayAI Animation Generator
  9. 15:280:32Lip Sync Video with Generative AudioCurrentThe user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.RunwayAI Lip Sync Generator
  10. 16:000:46Sketch-to-Image generationThe demonstrator draws a 'cracked ground' sketch over a tree image reference to guide the AI in generating a specific environmental modification.RunwayImage to Image
  11. 16:510:30Direct image editing with Sketch and LabelsThe user draws an arrow and adds a label to a reference image to instruct the AI to 'pull down a branch' in the final generation.RunwayAI Inpainting
  12. Watch “Runway AI - Tutorial for Beginners in 17 MINUTES ! [ FULL GUIDE ]” →

AI Lip Sync Generator

  1. 12:171:01Animate and lip sync with Runway Gen-3 AlphaThe video shows the workflow in Runway ML for generating video from an image and using the lip sync action to align audio with the character's face.Emmanuel Crown
  2. 10:330:33Lip Sync Video with Generative AudioA demonstration of the Lip Sync tool where an animated character is synced to a dialogue track or typed text.Skills Factory
  3. 15:280:32Lip Sync Video with Generative AudioCurrentThe user demonstrates the Lip Sync tool by importing a character video and providing text-to-speech input to animate the character's mouth.Skills Factory
  4. 5:010:43Add AI lip-sync to video with Runway MLThe video shows the process of using Runway ML's lip-sync feature by typing a script and selecting an AI voice to make the generated character speak.How to Make Money with Aiukli