Runway: Animate characters to speak using text prompts
Runway
Demo summary
The demonstration shows feeding a character close-up into a video node with text prompts to generate lip-synced speech and character movement.
Step-by-step
- Feed a close-up image of a character into a video node
- Enter the desired speech text into the prompt box
- Add specific directions for character movement or expression within the prompt
- Generate the video to see the character speak the text
Options
- Use default generic information prompts
- Enter custom specific dialogue
Tips
- Include directions along with the speech text in the prompt box to control the character's performance
Highlights
“this character workflow is awesome”
All demos from “Character Creator Workflow | Runway Academy”
- 0:321:05Configure Character Creator workflow nodes in RunwayThe video demonstrates how to use LLM nodes to enhance character descriptions and image generation nodes to create consistent character sheets with T-poses and profile views in Runway.Runway· AI Avatar Generator
- 1:370:42Generate custom character poses using reference imagesA step-by-step walkthrough of adding text and image reference nodes in Runway to apply a specific pose from a reference image to a generated character.Runway· Image to Image
- 2:190:53Create dynamic zoom-in videos from character stillsThe demo shows how to use video keyframe nodes in Runway to transition between a wide shot and a close-up image to create a seamless expressive video.Runway· Image to Video
- 3:120:22Generate a 360-degree character rotation plateRunway's rotation plate node is shown generating a full turnaround of a character, allowing users to extract specific frames for different angles.Runway· AI Image Generator
- 3:340:33Animate characters to speak using text promptsCurrentThe demonstration shows feeding a character close-up into a video node with text prompts to generate lip-synced speech and character movement.Runway· AI Avatar Video Generator
- Watch “Character Creator Workflow | Runway Academy” →
AI Avatar Video Generator
- 3:340:33Animate characters to speak using text promptsCurrentThe demonstration shows feeding a character close-up into a video node with text prompts to generate lip-synced speech and character movement.Runway