Extension for ComfyUI-AdvancedLivePortrait in sd-webui (Works with forge as well).
You can edit the facial expression from the image.
Demo.mov
If you want to try it in a dedicated webui rather than as an extension:
- Place this extension into
your-webui-path/extension
git clone https://github.com/jhj0517/sd-webui-AdvancedLivePortrait.git
- LivePortrait paper comes from
@article{guo2024liveportrait,
title = {LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control},
author = {Guo, Jianzhu and Zhang, Dingyun and Liu, Xiaoqiang and Zhong, Zhizhou and Zhang, Yuan and Wan, Pengfei and Zhang, Di},
journal = {arXiv preprint arXiv:2407.03168},
year = {2024}
}
- The models are safetensors that have been converted by kijai. : https://github.com/kijai/ComfyUI-LivePortraitKJ
- ultralytics is used to detect the face.
- This started from ComfyUI-AdvancedLivePortrait, various facial expressions like AAA, EEE, Eyebrow, Wink are found by PowerHouseMan.