r/StableDiffusion Sep 11 '22

A better (?) way of doing img2img by finding the noise which reconstructs the original image Img2Img

Post image
892 Upvotes

View all comments

16

u/Adreitz7 Sep 11 '22

This is great! I like to see these innovations that dive into the inner workings of SD. This looks like a powerful feature. In your example mosaic, is the second image meant to be the base reconstruction, and the following images modifications of it? I’m asking because the second image looks most like the first, but I noticed that it is more vivid — the saturation has increased. It’s a minor thing here, but could cause problems if it is a general effect of your technique. Any idea why this happened?

15

u/Adreitz7 Sep 11 '22

It’s also fascinating how perfect the reconstruction is. The biggest changes I can see are the shape of the right eyebrow and the profile of the left cheek. Your technique reproduced individual strands of hair!

16

u/Aqwis Sep 11 '22

It's very likely that the reconstruction isn't actually as good as it could be – I used 50 sampler steps to create the noise tensor for this example and 50 to generate each of the images from the noise tensor, but I'd previously noticed that the reconstructions seemed to be even better if I used a few hundred sampler steps to create the noise tensor.