ComfyUI Extension: ComfyUI DenseDiffusion
a/DenseDiffusion custom node for ComfyUI.
Custom Nodes (2)
README
Update
2024/12/27 Changed to allow multiple masks to be entered in batches.
2024/12/26 If there is no mask input, a solid mask is used instead.
ComfyUI_densediffusion
DenseDiffusion custom node for ComfyUI. Implements the DenseDiffusion-like method for regional prompt used in Omost project.
What this repo implements
Normal attention calculation can be written as y=softmax(q@k)@v
. DenseDiffusion introduces the method of attention manipulation on q@k
, which makes the expression look like y=softmax(modify(q@k))@v
.
The original DenseDiffusion's implementation does not perform very well according to my testing so here I only implemented the version used in Omost repo. Refer to https://github.com/lllyasviel/Omost#regional-prompter for other regional prompt methods.
How to use
Limitation [IMPORTANT]
Currently ComfyUI's attention replacements do not compose with each other, so this regional prompt method does not compose with IPAdapter. I am currently working on a universal model patcher to solve this issue.