My very simplified representation of how it works.

By -

In very simple terms, AI generation is when an AI model takes user inputs, such as a text prompt, and transforms latent noise into a meaningful output based on trained data.

Latent noise is a random pattern of numbers that an AI model refines step by step. 
The model is guided by learned patterns, until it forms a coherent output. This process is called denoising diffusion or latent space decoding.





Comments

Post a Comment

Popular posts from this blog

DMP plate rework with GenAI

By -
Image
I have been reworking plates with GenAI to complete DMP tasks such as season changes and time of day changes. --- Process: I start with my plate, making sure it's cleaned up and ready to work with. My plate will be the starting raster layer in InvokeAI: I would like to change the overall overcast lighting to a brighter sky and warm sunlight with long cast shadows. I am using an image to image approach, together with ControlNets and IP adapters, which allows me to preserve the plate as much as possible while controlling the changes I want to make to the plate.  For example, using a canny edge detection and depth map will retain the structure. After some tweaking and finding a good balance between the denoising strength value, the weight of each ControlNet and my prompt, I was happy with my result: A season change to autumn: A season change to winter: Quick note that the style referencing takes into account the mood and texture of the image reference. You can add more than one refere...
Read more

ComfyUI IC-Light relighting exploration

By -
Image
I've started using  ComfyUI  to gain more control over my workflow.  Its  node-based system  is similar to InvokeAI. I'm exploring IC-Light (image relighting) and it's a great tool in visual development for composition, lighting, mood and style. Since it runs on an SD1.5 model, it's not quite ready for a final DMP output yet, but I see lots of potential for visual development. For example, it is quick at giving you a location with different lighting scenarios. I was also able to exactly control the direction of the lighting, the colour and intensity. Using my own photos, I'm able to quickly create multiple different moods for art direction. For my workflow, I mixed different colour gradients with my image, controlling the light direction and tone of the scene. Original photo: My IC-Light generations: Original photo: My IC-Light generations: Example of light direction control with a spline: Adding some colour to the gradient: Output example: Original photo: My IC...
Read more

Creating Styleframes with LeonardoAI and InvokeAI

By -
Image
I decided to take screenshots of one of my favourite animated movies, The Road to El Dorado, and create some live action styleframes out of them. --- Process: To get an initial image out, I'm using Leonardo AI. It's workflow helps me quickly establish the style and composition I'm looking for. In this case, I have a screenshot to match to: Quick definition before continuing: Control Nets These are AI tools that guide image generation by providing additional structural input, such as sketches, depth maps, or edge detection. They help maintain consistency in composition, pose, or perspective while still allowing for creative freedom in generating an output image. Since I want to match my image as closely as possible to the screenshot, I'm using a combination of ControlNets with the screenshot as my input image. The Edge to image ensures my  generated images follow the specific structure. The Depth to image acts as my depth map. Image Prompt Adapter IP Adapters  extract sp...
Read more