ControlNet comes to Deforum (SD animations extension)

[kabachuha]

So, after being asked a dozen of times on Deforum's Discord server, I finally tackled this issue and made the inter-extension interaction to make ControlNet work for every animation frame. It's still heavily WIP and a lot of code is hacky, but at least it broke the ice and hopefully I together with our team will merge it during the upcoming week.

Some of the first results (2D mode, with only CN init):

20230219231227.mp4

20230220001437.mp4

If you want to get into details or help its development and testing, the pull request is located at deforum-art/sd-webui-deforum#361

[kabachuha]

Fixed the issue of it using only the first CN-fed frame. Now it's working properly in all modes: 2D, 3D, Video Input and Hybrid mode

I know, keyframes are absolutely off for this one particular video, but it's just a POC 😅

jindex.mp4

[kabachuha]

Fixed the rest of the visible issues and merged it into Deforum 🥳. Now it is available with the extension