demobook

Style and character reference matching in GPT-2

Demo summary

The user demonstrates how to upload both a character reference and a style reference image to GPT-2 to generate a consistent cinematic shot in a new environment.

Step-by-step

  1. Upload the character reference image to the character section
  2. Drag and drop the style reference image into the regular image upload section
  3. Write a prompt referencing 'character one' and 'image two'
  4. Specify the new environment and desired actions in the prompt
  5. Adjust the resolution and quality settings as needed for the project
  6. Click generate

Options

  • Pre-train on characters to avoid repeated drag-and-drop
  • Use any image aggregator or tool like Freepik or Midjourney for source images
  • Change the output resolution and quality

Tips

  • Go into post-production to tweak contrast if the background feels too perfect or lacks dynamic range
  • Explicitly tell the AI to use the same color grading and lighting as the style reference image

Highlights

for a single shot generation, I think it did a really good job

All demos from “This New AI Lip Sync Workflow is Insane

  1. 1:562:33Generate photorealistic images with GPT-2 via FreepikThe host demonstrates using the GPT-2 model inside the Freepik interface to generate a 1990s shopping mall image, adjusting parameters like aspect ratio and fidelity.FreepikText to Image
  2. 6:220:41Character likeness and background replacement in GPT-2A reference image of a person is uploaded to GPT-2 to test character consistency while changing the background to a coniferous forest.Gpt-2AI Background Generator
  3. 12:561:52Style and character reference matching in GPT-2CurrentThe user demonstrates how to upload both a character reference and a style reference image to GPT-2 to generate a consistent cinematic shot in a new environment.Gpt-2AI Image Generator
  4. 25:191:31Generating 1080p AI video in RunwayThe host demonstrates selecting the 1080p resolution setting in Runway's credit mode to generate high-definition video from a Midjourney reference image.RunwayImage to Video
  5. Watch “This New AI Lip Sync Workflow is Insane” →

AI Image Generator

  1. 12:561:52Style and character reference matching in GPT-2CurrentThe user demonstrates how to upload both a character reference and a style reference image to GPT-2 to generate a consistent cinematic shot in a new environment.Curious Refuge