[Feature Request] outpainting on an infinite canvas.

[itsWinwin]

Absolutely love this web ui. =) The only thing missing for me, is the ability to use the art generation as a brush and 'paint' on an infinite canvas like with stabilitydiffusion-infinite and dall-e 2. I use it to make large expansive wallpapers, and having this feature in Automatic1111 would make me very happy camper. ;)

Keep up the amazing work! You're a hero. =)

[TKoestlerx]

The same here ;)

And now with the amazing 1.5 inpainting checkpoint i spent the entire day to get a poor-mans version running.
Its really just the basics, but its a fun experiment.
It will probably break with any bigger ui-update (since the canvas is really hacked in), but i had so much fun expanding my images that i decided to upload it anyway.
Its tested on exactly one machine with one browser, so.... expect anything.

https://github.com/TKoestlerx/sdexperiments

[aniketgore]

looks promising. Will try. Do you have any version for mk2?

[TKoestlerx]

you mean in the sense that you can expand in all directions at the same time like mk2?
In that case, no. You can only expand one region at a time. Then you have to add another region via send to image2image and repeating the process.

[cyan2k]

This is amazing! Thank you!

Any ideas how to fix "hard edges"/edge artifacts? Would fuzzying/blurirng the edges help?

[TKoestlerx]

Can you check if the source Image allready had some kind of edge-"defect" on the border where the artifacts appear?

Maybe adding an option do discard the outer layer of the image(1px or so) when doing the expansion?

It can also be fixed with inpainting (set the cfg very low to prevent it from creating new stuff, and keep the area your fixing below 512x512 to prevent blurring.) But it would obviously be better if they didnt appear in the first place.

[TKoestlerx]

What I found out when I tried around:
If the outpainting consistently gives bad results, it's worth taking a closer look at the src image. Sometimes the edges of generated images have artifacts:

In the case cutting of the arm at the bottom.
You have to edit the src image manually to get success.

[TKoestlerx]

I have updated the outpainting windows to be slighty less ugly.

The div has now a titlebar and can be dragged.
The div is now resizeable.
The div has update & close buttons added.

It is currently under a different branch: "windowedcanvas" because i havent tested it a lot.

[TKoestlerx]

And one (final?) update.
You can now switch the positioning of the window between fixed (has been that way) and absolute.
What position:absolute allows you to do is to drag the outpainting window to a position in the page. And it will stay there, scrolling with the content.
So its the perfect way to fill that empty space on the right side of the img2img tab:

[TKoestlerx]

It turns out. Not the final update ;)

I have completly changed the way the script works. Now it supports Outpainting (infinity) and Inpainting Selection.
A Basic HSL Slider allows for Color Correction when merging the results back in.

Just played around with some Images and.. .it seems to work.

I have uploaded it in the alphacanvas branch at:
https://github.com/TKoestlerx/sdexperiments

[ClashSAN]

looks great, congrats!
any thoughts on the PR? #3693

I have completly changed the way the script works. Now it supports Outpainting (infinity) and Inpainting Selection.
A Basic HSL Slider allows for Color Correction when merging the results back in.

I haven't tested the PR by @Symbiomatrix Yours seems to be the most feature rich, I'm excited to see them both, but idk if the two of them will be colliding

[TKoestlerx]

Thanks :)

In my eyes, there are no conflicts there. Symbiomatrix's idea to use the built-in element for the expansion I find ingenious, since it is already present in the UI.

The last update of me is rather justified in the fact that you cant really use the inpaint marker at sizes of 2048x1536 and above, and i wanted to seperate the regions before hitting the gradio interface.