WebUI integration as a Photoshop Plugin

[mashonoid]

Would it be possible to have the WebUI somehow communicate with photoshop via a plugin or API? Using the power of photoshop's masking and the in/out painting capabilities of Automatic1111's WebUI, it will truly become an artist's dream come true.
I know a plugin for photoshop already exists, made by Christian Cantrell, but it uses Dreamstudio's inpainting, which is TBH really trash. Another possible solution is that somehow Christain's plugin can communicate with Automatic1111's WebUI? I don't know I am just throwing out ideas.
Let me know what you guys think.

[aniketgore]

Christina has released the local ui option, but I wish someone can build a wraper around automatic webui so it would be best of both worlds.

[GitHub1712]

How would you sample a basic txt2img(".... based on this webui script without any gradio?
This is not trivial because everything is initilaized with and called from gradio.
At the moment I am trying to figure out a simple script with webui´s features but without gradio to make it useable in any other context, by example as a photoshop plugin.

[aniketgore]

Try compviz repository. It has command line calls.

https://github.com/CompVis/stable-diffusion

python scripts/txt2img.py --prompt "a photograph of an astronaut riding a horse" --plms

What cristian is doing is to create a wrapper with flask around these calls to convert them into rest api. I think if we trace back to the first version of automatic, we may find the actual files that do that. Right now there are 1000+ commits and its impossible to trace back.

[GitHub1712]

thank you, from the compviz repro it is no problem but this webui seems to be moch more optimized and it has additional features like the upscalers integrated I would like to use but without gradio...

[papersplease]

Aren't there several plugins for Krita and Photoshop already? I think this one https://github.com/Interpause/auto-sd-krita claims to have better inpainting and periodically updates to a latest version of this repo (although it's for Krita, not PS)

(also Interpause#15)

[aniketgore]

Thanks. I will check this.

[GitHub1712]

more thanks, this also pointed me to the basic txt2image call I was looking for, modules.txt2img.txt2img(... in app.py

[Interpause]

There is currently work on an official API: #3040

I imagine once its done, there will probably be many more new plugins

[TinyBeeman]

It's not very hard to wrap most the functionality of this repo in something a plug-in could use. It only took me an hour or two to put a flask API wrapper around it, for instance, for a project I was working on, and then to call txt2img and img2img from those APIs. You basically just need to do all the stuff that launch.py does, and you're pretty much good to go, from what I remember (this was a few weeks ago).