r/StableDiffusion Sep 11 '22

A better (?) way of doing img2img by finding the noise which reconstructs the original image Img2Img

Post image
892 Upvotes

View all comments

11

u/Aqwis Sep 12 '22 edited Sep 12 '22

Made a few incremental updates to the Gist over the past few hours. Happy to see that a few SD forks/UIs are implementing something like this – they're better situated than me to make something that's useable by non-coders. :)

It seems that the results are quite often best when cond_scale is set to 0.0 – exactly why this is, I don't know. If anyone has an idea, I would love an explanation. With cond_scale at zero, the given prompt has no effect.

In the meantime, I've got to see my share of extremely creepy pictures while experimenting with other cond_scales. Run this on a portrait with cond_scale set to 5.0 and use the resulting noise to generate a picture (also with scale > 2.0) ... or don't. I wouldn't advise doing so personally, especially if you have a superstitious bent. (Or maybe you're going to get completely different results than I got, who knows?)

2

u/NotModusPonens Sep 12 '22

In what way are the pictures creepy?

5

u/Aqwis Sep 12 '22

To be a bit vague: a combination of "photos" of very seriously messed up human-like figures and "drawings" of symbols that if they meant anything would have been the equivalent of these messages for the human psyche.

2

u/NotModusPonens Sep 12 '22

Ooof.

... we'll soon have to disable images in social media and email by default in order to avoid being "trolled" by someone with one of these, won't we?

3

u/Lirezh Sep 15 '22

Anyone with photoshop can troll you already for more than a decade, it does not seem to be a big concern.

1

u/NotModusPonens Sep 15 '22

Sure, but this lowers time and effort barriers. Quantity has a quality all of its own