A better (?) way of doing img2img by finding the noise which reconstructs the original image

r/StableDiffusion • u/Aqwis • Sep 11 '22

A better (?) way of doing img2img by finding the noise which reconstructs the original image Img2Img

913 Upvotes

99% Upvoted

So this might be a dumb idea, but let's say you have two images (image A and image B).

You use this technique in order to back-form images of random noise (noise A and noise B) which will generate close approximations of image A and image B when given the same prompt (prompt P)

Can we interpolate between noise A and noise B, and feed these intermediate noises into stable diffusion with prompt P, and morph between image A and image B?

1

u/ExponentialCookie Sep 12 '22

I don't see why not. Given a latent representation of an image, you should be able to latent walk through as many of them as you wish.

1

u/BrandonSimpsons Sep 12 '22

I guess my question is more 'is the space organized enough for this to work feasibly', which probably can only be found experimentally.

1

u/[deleted] Sep 12 '22

[deleted]

1

u/BrandonSimpsons Sep 13 '22

oh yeah artbreeder is great, and being able to have similar tools with SD would be fantastic