demobook

Imagine.art: Motion transfer between video and illustration

Imagine.artTry it →Watch full video →ImagineArt ·

Demo summary

A demonstration of extracting dance movements from a source video and applying them to a static character illustration using the Move and Replace nodes.

Step-by-step

  1. Upload a source video containing the motion you want to capture
  2. Upload a character reference image or illustration
  3. Add a motion transfer node to the workspace
  4. Select the desired motion method (Replace, Move, Runway Act-Two, or Moon Valley)
  5. Connect the character image and reference video to the node
  6. Click Run to generate the animation

Options

  • Use 'Replace' to keep the original video structure while applying the character's style
  • Use 'Move' to make the static illustration perform the motion from the reference video
  • Use 'Runway Act-Two' or 'Moon Valley' as alternative motion transfer engines

Watch out for

  • The 'Replace' node does not alter the original video much and functions more like a style transfer

Tips

  • Use a trimmed video of the specific motion to ensure timings are hit correctly
  • The 'Move' node is generally more effective than 'Runway Act-Two' for maintaining character coherence

Highlights

“It's quite quite impressive.”

All demos from “ImagineArt Workflows [Advance Tutorial]: The Ultimate Guide To Create Professional AI Art (Part 5)”

  1. 0:490:37Uploading and connecting assets in ImagineArtThe demonstrator shows how to use the Upload node to bring images into the canvas and connect them to downstream generation nodes.Imagine.artAI Image Generator
  2. 2:040:36Generating images with Nano Banana ProA demonstration of connecting a prompt and reference image to an image node using the Nano Banana Pro model to generate a landscape artwork.Imagine.artImage to Image
  3. 4:070:57Building an AI Co-Pilot workflowThe user demonstrates chaining a Gemini 3.0 AI Co-Pilot node to an image generation node to create a fantasy environment from a refined prompt.Imagine.artAI Image Generator
  4. 5:140:46Image-to-image style transferThe video shows how to chain two image nodes to transform an existing image into a dystopian techno landscape.Imagine.artAI Style Transfer
  5. 6:000:47Adding subjects to images with Nano Banana ProA demonstration of using an image node and prompt to seamlessly add a hooded figure into an existing generated scene.Imagine.artAI Inpainting
  6. 7:081:42Upscaling images with ImagineArt Subtle UpscalerThe demonstrator compares original images with upscaled versions using the Subtle and Creative upscalers to improve resolution and detail.Imagine.artAI Image Upscaler
  7. 8:540:49Cropping and resizing imagesA walkthrough of using utility nodes to crop a specific area of an image and resize it for different aspect ratios.Imagine.artAI Crop Image
  8. 9:430:43Adjusting image levels and filtersThe user demonstrates using histogram sliders and filter nodes to adjust shadows, brightness, and color temperature on the canvas.Imagine.artAI Photo Editor
  9. 10:481:03Text-to-video generation with Vidu 1.1A demonstration of generating a cinematic drone shot of a forest using a text prompt and the Vidu 1.1 video model.Imagine.artText to Video
  10. 11:511:01Image-to-video animationThe demonstrator uses an existing asset and a prompt to animate a still image into a video clip with environmental motion.Imagine.artImage to Video
  11. 13:350:43Extending video duration with PixverseThe video shows how to use the Pixverse Extend node to add 5 seconds of continuous motion to an existing 4-second clip.PPixverse AIAI Video Editor
  12. 14:202:00Motion transfer between video and illustrationCurrentA demonstration of extracting dance movements from a source video and applying them to a static character illustration using the Move and Replace nodes.Imagine.artVideo to Video
  13. 16:201:20AI Lip Sync with 11 Labs and Cling AIThe user generates speech via 11 Labs and uses the Cling AI Avatar Pro node to synchronize an image's mouth movements to the audio.Imagine.artAI Lip Sync Generator
  14. Watch “ImagineArt Workflows [Advance Tutorial]: The Ultimate Guide To Create Professional AI Art (Part 5)” →

Video to Video

  1. 14:202:00Motion transfer between video and illustrationCurrentA demonstration of extracting dance movements from a source video and applying them to a static character illustration using the Move and Replace nodes.ImagineArt
demobook

Show, don’t tell.

Categories

Video & AnimationImage Generation & EditingSales TechEmail Marketing

About

SubmitAboutPrivacyTermsContact

© demobook.co