The Generative Canvas: A Matte Painter's Perspective

I decided to take screenshots of one of my favourite animated movies, The Road to El Dorado, and create some live action styleframes out of them. --- Process: To get an initial image out, I'm using Leonardo AI. It's workflow helps me quickly establish the style and composition I'm looking for. In this case, I have a screenshot to match to: Quick definition before continuing: Control Nets These are AI tools that guide image generation by providing additional structural input, such as sketches, depth maps, or edge detection. They help maintain consistency in composition, pose, or perspective while still allowing for creative freedom in generating an output image. Since I want to match my image as closely as possible to the screenshot, I'm using a combination of ControlNets with the screenshot as my input image. The Edge to image ensures my  generated images follow the specific structure. The Depth to image acts as my depth map. Image Prompt Adapter IP Adapters  extract sp...

In MidJourney, I've been using mainly Text to Image prompts for personal interests in fashion and art. I've been visualizing concepts and experimenting with colors, textures and forms. It's incredibly fun, and I've spent countless hours generating images for my projects!  For the full collection please visit my instagram:   https://www.instagram.com/wallflowers_ballad  

I n very simple terms, AI generation is when an AI model takes user inputs, such as a text prompt, and transforms latent noise into a meaningful output based on trained data . Latent noise is a random pattern of numbers that an AI model refines step by step.  The model is guided by learned patterns, until it forms a coherent output.  This process is called denoising diffusion or latent space decoding.