ComfyUI PhotoMaker Plus

ComfyUI implementation for PhotoMaker.

PhotoMaker implementation that follows the ComfyUI way of doing things. The code is memory efficient, fast, and shouldn't break with Comfy updates.

<div align="center"> <img width="1261" alt="example workflow" src="https://github.com/shiimizu/ComfyUI-PhotoMaker/assets/54494639/a8320460-a8e0-46df-9780-66a70631e989"> <p>Example workflow that you can load in ComfyUI.</p> </div> <br>

Installation

1. Install ComfyUI.
2. Install through ComfyUI Manager or clone this repo into custom_nodes by running the following commands in a terminal:

   cd ComfyUI/custom_nodes
   git clone https://github.com/shiimizu/ComfyUI-PhotoMaker-Plus.git
   

3. Download the model from Hugging Face and place it in a photomaker folder in your models folder such as ComfyUI/models/photomaker.

Features of this Plus version

• Better face resemblance by using CLIPImageProcessor like in the original code.
• Automatic PhotoMaker LoRA detection and loading in the LoraLoader nodes.
• Customizable trigger word
• Allows multiple trigger words in the prompt
• Extra nodes such as PhotoMakerStyles and PrepImagesForClipVisionFromPath

Important news

2024-01-24

• Official support for PhotoMaker landed in ComfyUI. Therefore, this repo's name has been changed. The PhotoMakerEncode node is also now PhotoMakerEncodePlus.

2024-01-21

• Due to various node updates and changes, you may have to recreate the node.
• Removed ref_images_path input. Added a PrepImagesForClipVisionFromPath node.

2024-01-18

• No need to manually extract the LoRA that's inside the model anymore.

Citation

@article{li2023photomaker,
  title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
  author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
  booktitle={arXiv preprint arxiv:2312.04461},
  year={2023}
}