Video-to-Video Editing with Google Omni
Demo summary
The demonstration shows Google Omni performing video-to-video tasks, such as replacing a physical object with a laptop, turning a piece of paper into a Pokémon card, and changing a character's clothing or species while maintaining motion.
Step-by-step
- Upload your source footage to Google Omni
- Enter a text prompt to specify the desired change (e.g., 'change to a laptop' or 'put him in swimwear')
- Review the generated video to ensure motion and likeness are maintained
Options
- Replace physical objects with different items
- Change character clothing or remove equipment (e.g., removing a parachute)
- Transform characters into different species (e.g., turning a person into a dog)
- Modify the entire environment while keeping the original motion
Watch out for
- Users in Europe may experience connectivity issues and may require a VPN to access the tool effectively
- Complex scene changes can occasionally 'break' or produce visual glitches
- Omitting a reference image can lead to imperfections in specific details like logos
Tips
- Add a reference image alongside your prompt to improve the accuracy of specific objects
- Use the tool to mix AI-generated footage with real footage for higher customizability in client work
Highlights
“allows you as an editor to have a way more customizability when it comes to editing videos”
All demos from “I Tried AI Video Editing for 8 Days - Here’s what DOES work”
- 1:202:35Using Higgsfield Plugin in Premiere ProThe creator demonstrates the Higgsfield plugin integrated directly into Premiere Pro, showing how to reframe clips for social media, upscale footage to 4K, and generate new scenes without leaving the editing timeline.Adobe Firefly· AI Video Editor
- 3:552:16Generating B-roll and Assets with Higgsfield SupercomputerThe video shows how to use Higgsfield Supercomputer to create a consistent character from a reference image and generate an 'explainer video toolkit' of animated motion graphics and B-roll from text instructions.Higgsfield· AI Stock Video Generator
- 6:272:27Creating Motion Graphics with Claude and HyperFramesThe creator demonstrates using Claude with the HyperFrames extension to generate complex motion graphics, UI animations, and text pop-ups by simply describing the desired visual changes in natural language.Claude· Text to Video
- 8:581:51Video-to-Video Editing with Google OmniCurrentThe demonstration shows Google Omni performing video-to-video tasks, such as replacing a physical object with a laptop, turning a piece of paper into a Pokémon card, and changing a character's clothing or species while maintaining motion.GGoogle Omni· Video to Video
- Watch “I Tried AI Video Editing for 8 Days - Here’s what DOES work” →
Video to Video
20:350:10Iterative object replacement in Google OmniA demonstration of turn-based video editing where a user changes a butterfly into a bee and then into fireflies using simple natural language commands while preserving the rest of the scene.AI Samson
6:410:17Iterative video editing with Gemini OmniGoogle demonstrates Gemini Omni transforming a sculpture into bubbles and creating an alphabet-themed video with consistent physics and character coherence.AI Revolution
4:400:25Remixing video environments and characters with Google OmniA demonstration shows a single clip of a person running transformed into different environments (track, gallery, beach) and changing the character's gender and likeness using Google Omni.AI Samson- 8:581:51Video-to-Video Editing with Google OmniCurrentThe demonstration shows Google Omni performing video-to-video tasks, such as replacing a physical object with a laptop, turning a piece of paper into a Pokémon card, and changing a character's clothing or species while maintaining motion.Dan Kieft
5:561:11Simulating physics and terrain in OmniThe creator demonstrates how changing the terrain prompt (e.g., to ice or dust) affects the physical behavior and visual effects of the vehicle in the generated video.TheAIGRID- 7:180:45One-to-one background replacementA demonstration of using Google Omni as a VFX tool to swap a standard racetrack background for a castle-style track while maintaining the original car's motion.TheAIGRID
- 8:340:31Applying custom logos to video objectsThe creator uploads a custom logo and prompts the model to apply it as a theme across the car in an existing video clip while keeping the camera angle consistent.TheAIGRID
- 10:220:31Changing camera angles and removing objectsThe video shows how to modify an existing clip of a violinist by changing the environment, removing objects, and shifting the camera angle to an over-the-shoulder view.TheAIGRID
- 11:230:27Object replacement in videoA demonstration of swapping a spaceship for other objects like a walnut, a clock, or a raven while maintaining the original flight path.TheAIGRID
6:271:22Apply visual style presets in Gemini OmniThe user demonstrates various style templates including Noir, 80s music video, Origami, and Pixelate to transform the look of generated video clips.AI Master- 13:340:57Rerender and extend real footageThe user imports handheld footage and uses Gemini Omni to apply a cinematic color grade and extend the camera motion logic.AI Master