AI Lip-sync music video workflow in Dreamina

Dreamina Try it →Watch full video →AI for Real Life: Redefining Filmmaking · May 2026

Demo summary

The creator walks through the process of uploading character pose sheets, location images, and a song clip (exported as video) into Omni Reference to generate a lip-synced character performance.

Step-by-step

Navigate to the Dreamina platform and click AI video
Select Omni Reference and choose Dreamina Seedance 2.0
Upload character pose sheets, a location image, and the song clip (exported as a video file)
Enter a descriptive prompt in the text field
Tag the uploaded character sheets, reference image, and song clip within the prompt interface
Click Generate

Options

Choose between the regular model or the fast model

Watch out for

The song clip must be exported as a video file to be used as a reference

Tips

Use the regular model instead of the fast model for higher quality results
Keep the text prompt straightforward and simple

Highlights

“the result, the lip-sync was dead on. The cuts felt like a basic music video. ... honestly, I didn't think it would work, but then I hit generate, it kind of blew my mind.”

All demos from “Dreamina Seedance 2.0: I Found a Hidden Music Video Workflow”

3:540:46Image to video generation with Dreamina Seedance 2.0The creator demonstrates the standard image-to-video workflow in Dreamina by uploading a still image, setting the aspect ratio, and using a ChatGPT-generated prompt to generate an 8-second video.Dreamina· Image to Video
4:400:24Using Omni Reference for starting frames in DreaminaThe user shows how to use the Omni Reference tool to tag a specific image as a starting frame reference within the prompt interface.Dreamina· Image to Image
6:450:51AI Lip-sync music video workflow in DreaminaCurrentThe creator walks through the process of uploading character pose sheets, location images, and a song clip (exported as video) into Omni Reference to generate a lip-synced character performance.Dreamina· AI Lip Sync Generator
8:180:33Scene continuation using video referencesThe demonstration shows how to maintain story consistency by uploading a previously generated clip as a video reference in Dreamina to chain scenes together.Dreamina· AI Video Extender
Watch “Dreamina Seedance 2.0: I Found a Hidden Music Video Workflow” →

AI Lip Sync Generator

8:220:39Create AI avatars with DreaminaThe demonstration shows how to use CapCut's Dreamina tool to upload an image and audio to generate a lip-synced AI avatar video.Emmanuel Crown
0:501:38Lip-sync an image with Dreamina OmnihumanThe creator demonstrates how to upload a character image and an ElevenLabs audio file to Dreamina's AI Avatar tool to generate a lip-synced video.Tao Prompts
6:450:51AI Lip-sync music video workflow in DreaminaCurrentThe creator walks through the process of uploading character pose sheets, location images, and a song clip (exported as video) into Omni Reference to generate a lip-synced character performance.AI for Real Life: Redefining Filmmaking
8:020:20Create talking AI avatars with DreaminaThe user demonstrates the AI avatar feature in Dreamina by uploading a character image and adding audio to create a lip-synced talking video.Brain Project