DreamFace: Lip sync an AI avatar with custom audio
DreamFaceDemo summary
The tutorial walks through importing a custom voice recording into DreamFace to make the generated avatar lip-sync and speak naturally.
Step-by-step
- Click on the Lip Sync option on the right-hand side
- Select the input method for what the avatar wants to say
- Click on Import and select From Files
- Search for and select your recorded audio file
- Listen to the audio to ensure it is correct
- Click on Confirm
- Click on Animate to generate the lip-synced video
Options
- Choose from built-in voices (baby, adult, male, female, or 11 Labs)
- Clone your own voice by recording directly or importing a sample
- Type out text for the avatar to speak instead of importing audio
Watch out for
- The free version is limited to 30 seconds of audio
- The paid version is limited to 180 seconds of audio
Tips
- Record your voice on your phone's sound recorder first to ensure the avatar uses your exact voice and tone
All demos from “How to Create Talking & Moving AI Avatars with DreamFace (Free & Paid Versions Explained)”
- 3:031:39Generate an AI avatar image with DreamFaceThe creator demonstrates how to use a reference image and text prompts within the DreamFace app to generate a high-quality AI avatar with visible hands.DreamFace· AI Avatar Generator
- 4:471:27Animate avatar body movements using Video GenThe user shows how to use the 'Video Gen' feature in DreamFace to prompt an avatar to move its hands naturally while looking at the camera.DreamFace· AI Animation Generator
- 6:192:19Lip sync an AI avatar with custom audioCurrentThe tutorial walks through importing a custom voice recording into DreamFace to make the generated avatar lip-sync and speak naturally.DreamFace· AI Lip Sync Generator
- Watch “How to Create Talking & Moving AI Avatars with DreamFace (Free & Paid Versions Explained)” →
AI Lip Sync Generator
6:441:20Upload video source to DreamFace Avatar VideoThe user demonstrates how to upload a video file to the DreamFace web interface to serve as the visual base for a lip-sync animation.Excelerator- 9:220:33Uploading custom audio for lip-syncingThe user shows the process of selecting and attaching a custom audio file from a local computer to be used for the AI lip-sync generation.Excelerator
- 9:550:48Generating and previewing the final lip-sync videoThe clip shows the generation process in the creations tab and the final playback of a lip-synced video where the character's mouth movements match the uploaded audio.Excelerator
- 10:530:43Using the Pet Lip Sync tool in DreamFaceThe user walks through the Pet Lip Sync interface, showing how to select animal photos and choose between songs or text-to-speech for the animation.Excelerator
- 6:192:19Lip sync an AI avatar with custom audioCurrentThe tutorial walks through importing a custom voice recording into DreamFace to make the generated avatar lip-sync and speak naturally.Halimat Ismail
5:082:57Generate AI lip-sync video with DreamFaceThe creator demonstrates selecting an avatar, using the built-in AI script generator to write a script, and choosing a default voice to generate a lip-synced video on the DreamFace web platform.Winston Wee
2:301:14Lip-sync custom audio to AI video with Dreamface AIThe creator demonstrates uploading a pre-generated character video and a custom voice recording to Dreamface AI to synchronize mouth movements.Everyday AI with Jayne