[Dev List About SOTA]New Preprocesser and Model

[sdbds]

Preprocesser

Canny

• [ BoundaryAttention ]

HED:

• [ TEED DexiNed preprocessor for SargeZT's SoftEdge controlnet model #2093 [DONE] ]

Openpose:

• [ RTMW [Feature Request] Would you like support RTMW for wholebody pose estimator? #2344 ]

• [ PoseAnything ]

• [ AnimalPose [1.1.424] Animal openpose support added #2351 Add Animal Pose Preprocessor (RTMPose AP-10K) #2293 [DONE] ]

• [ DensePose Add Densepose (TorchScript) #2314 [DONE] ]

Depth:

• [ HandRefiner [Feature Request] MeshGraphormer Hand Refiner Preprocessor #2382 [DONE] ]

• [ Marigold [Feature Request]: Marigold depth - high-quality diffusion-based monocular depth estimation #2330 [DONE] in forge]

• [ LooseControl Support for LooseControl? #2320 ]

• [ PatchFusion PatchFusion looking amazing and should be implemented #2319 ]

• [ Depth Anything [DevTask] Support new Depth Controlnet Depth Anything #2542 [DONE] ]

Normal

• [ Dsine [Feature Request]: New normal preprocesser:DSINE #2676 [DONE] ]

Reference:

• [ FaceID adapter [Bug]: FaceID adapter support #2354 ] [DONE]

• [ PhotoMaker [DevTask] Port TencentARC/PhotoMaker #2478 ]

• [ Instant ID ✨ Instant ID #2580 [DONE] ]

Model

HandRefiner

https://huggingface.co/hr16/ControlNet-HandRefiner-pruned

LooseControl

https://huggingface.co/AIRDGempoll/LooseControlNet

AnimalPose

https://huggingface.co/huchenlei/animal_openpose

IP-adapter-FaceID

https://huggingface.co/h94/IP-Adapter-FaceID

DensePose

https://civitai.com/models/120149/controlnet-for-densepose

Depth Anything

https://huggingface.co/spaces/LiheYoung/Depth-Anything/resolve/main/checkpoints_controlnet/

TEED

https://huggingface.co/SargeZT/controlnet-sd-xl-1.0-softedge-dexined

InstantID

https://huggingface.co/InstantX/InstantID/resolve/main/ip-adapter.bin
https://huggingface.co/InstantX/InstantID/resolve/main/ControlNetModel/diffusion_pytorch_model.safetensors