Real time diffusion [BETA]

Collection of real-time diffusion tools and comfy wrappers.

Installation

Simply clone this repository into your custom_nodes subfolder in your comfyUI installation.

git clone https://github.com/lunarring/rtd_comfy

Next, navigate into the lunar_tools_comfy folder and install the requirements.

cd ComfyUI/custom_nodes/rtd_comfy
pip install -r requirements.txt

After restarting comfyUI, you should be able to see "Lunar Ring" after a rightclick/Add Node, or find the below nodes directly.

Workflow examples

We provide .json for all workflow examples in https://github.com/lunarring/rtd_comfy/tree/main/workflows

You can also drag and drop the below screenshots of the examples.

Generally, to run the workflows in a continuous way, you will have to select auto queuing (instant) in ComfyUI.

Webcam live transformation

With this workflow, the webcam image is transformed using real time feed from the cam.

Infinite Zoom with automatic prompt cycling

Here we zoom infinitely into the last generated image.

Blending of decoder embeddings

We only modify the decoder embeddings selectively ("dirty" and "clean"), which leaves the overall structure of the image intact ("photo of a room").