demobook

Gemini: Animate AI avatar with VO 3.1 lip-syncing

Demo summary

The user demonstrates generating a talking video of the AI influencer by inputting text and an image into the VO 3.1 lip-syncing tool.

Step-by-step

  1. Navigate to Tools and select Lip Syncing
  2. Upload the target image of the character
  3. Input the text prompt for the speech
  4. Select the resolution (e.g., 1080p) and duration (e.g., 8 seconds)
  5. Click Generate
  6. To use a custom voice, upload a source audio file to the Enhancer V1 or V2 lip syncing models

Options

  • Use VO 3.1 for text-to-speech lip syncing
  • Use Enhancer V1 or V2 models for audio-to-speech lip syncing
  • Use Eleven Labs to generate and download custom audio files

Watch out for

  • VO 3.1 does not allow you to upload a custom source audio file directly; it generates audio from text

Tips

  • Use VO 3.1 to achieve the most realistic results for lip syncing
  • Use the voice changer feature in external apps to personalize your influencer's voice
  • Keep text prompts simple and uncomplicated for better results

Highlights

Super simple, nothing complicated.

All demos from “She Isn’t Real (The DEFINITIVE AI Influencer Tutorial)

  1. 4:591:35Generate hyper-realistic base images in Kora ProThe user pastes prompts into Kora Pro to generate high-resolution, realistic base images of a Mediterranean man and an Eastern European woman.KORA ProAI Realistic Image Generator
  2. 6:341:05Create a 360 character sheet with Nano Banana ProUsing the image editing tools in Enhancer, the creator uses the Nano Banana Pro model to generate four different views of a single character for consistency.EnhancorAI Person Generator
  3. 7:392:21Refine skin texture with Enhancer V3 Skin FixThe video demonstrates using Enhancer V3's 'imperfect skin' and 'hyper realism' toggles to add realistic skin details like pores and freckles to an AI-generated face.Kora RealityAI Image/Photo Enhancer
  4. 10:292:50Generate consistent character scenes with Nano BananaThe creator demonstrates how to place the consistent AI character in new scenarios, such as cooking in a kitchen or wearing specific brand clothing, using Nano Banana.KORA ProAI Person Generator
  5. 13:190:57Animate AI avatar with VO 3.1 lip-syncingCurrentThe user demonstrates generating a talking video of the AI influencer by inputting text and an image into the VO 3.1 lip-syncing tool.GeminiAI Lip Sync Generator
  6. 14:161:01Compare lip-syncing models V1 and V2The video shows a side-by-side comparison of Enhancer's V1 and V2 lip-syncing models using a custom audio file and the previously generated AI character image.Kora RealityAI Lip Sync Generator
  7. Watch “She Isn’t Real (The DEFINITIVE AI Influencer Tutorial)” →

AI Lip Sync Generator

  1. 4:220:36Generate AI video with lip-sync using Google Veo 3The creator demonstrates how to use the Video button in Google Gemini to input a detailed prompt for a battlefield reporter, showing Google Veo 3 generating a video with synchronized speech.How To In 5 Minutes
  2. 13:190:57Animate AI avatar with VO 3.1 lip-syncingCurrentThe user demonstrates generating a talking video of the AI influencer by inputting text and an image into the VO 3.1 lip-syncing tool.Sirio