demobook

fal.ai: Character replacement with reference images

Demo summary

The user demonstrates replacing two skydivers in a video with specific characters defined by frontal and reference images using Kling 03 video editing.

Step-by-step

  1. Upload a video of the subjects you wish to replace as the input
  2. Upload a frontal image for the first character as Element 1
  3. Upload a reference image for Element 1 to help the model understand the character
  4. Repeat the frontal and reference image uploads for Element 2
  5. Write a prompt that refers to the elements directly (e.g., 'replace both characters with element one and element two')
  6. Run the Kling 1.0 video editing model to generate the result

Tips

  • Use both a frontal image and a reference image for each element so the model understands the character better

All demos from “Introducing Kling 3.0 - A New Frontier for AI Video | fal Academy

  1. 0:120:41Text-to-video generation with Kling 3.0The user demonstrates generating a multi-shot action movie scene from a single text prompt using the Kling 03 text-to-video playground on fal.fal.aiText to Video
  2. 1:310:28Complex motion generation in Kling 3.0A demonstration of Kling 3.0 handling complex physical interactions and character dialogue in a basketball scene using a detailed multi-step prompt.fal.aiText to Video
  3. 2:170:59Image-to-video with character consistencyThe user demonstrates Kling 03 image-to-video by providing a starting frame and a dialogue prompt to generate a cinematic scene with consistent character styling and camera cuts.fal.aiImage to Video
  4. 4:210:23Cinematic camera and lighting controlA demonstration of precise camera control using a 'dolly zoom' prompt and a blue lighting shift to reflect character emotion in Kling 3.0.fal.aiAI Animation Generator
  5. 5:280:52AI Video Editing with Image ElementsThe video shows how to edit an existing video by referencing an external image element (Popeye) to replace a character while maintaining the original video's structure.fal.aiVideo to Video
  6. 6:290:40Character replacement with reference imagesCurrentThe user demonstrates replacing two skydivers in a video with specific characters defined by frontal and reference images using Kling 03 video editing.fal.aiVideo to Video
  7. 7:090:49Reference-to-video with high controllabilityA demonstration of the Kling 03 reference-to-video model, combining a start image, a character element, and a text prompt to generate a specific scene.fal.aiImage to Video
  8. Watch “Introducing Kling 3.0 - A New Frontier for AI Video | fal Academy” →

Video to Video

  1. 5:280:52AI Video Editing with Image ElementsThe video shows how to edit an existing video by referencing an external image element (Popeye) to replace a character while maintaining the original video's structure.fal
  2. 6:290:40Character replacement with reference imagesCurrentThe user demonstrates replacing two skydivers in a video with specific characters defined by frontal and reference images using Kling 03 video editing.fal