ComfyUI Extension: ComfyUI-Attention-Distillation
Non-native a/AttentionDistillation for ComfyUI. Official ComfyUI demo for the paper AttentionDistillation, implemented as an extension of ComfyUI. Note that this extension incorporates AttentionDistillation using diffusers.
Custom Nodes (6)
README
ComfyUI-Attention-Distillation
Non-native AttentionDistillation for ComfyUI.
Official ComfyUI demo for the paper AttentionDistillation, implemented as an extension of ComfyUI. Note that this extension incorporates AttentionDistillation using diffusers
.
The official code for AttentionDistillation can be found here.
🔥🔥 News
- 2025/03/10: Workflows for style-specific T2I generation using SDXL and Flux(beta) have been released.
- 2025/02/27: We release the ComfyUI implementation of Attention Distillation and two workflows for style transfer and style-specific text-to-image generation using Stable Diffusion 1.5.
- 2025/02/27: The official code for AttentionDistillation has been released here.
🛒 Installation
Download or git clone
this repository into the ComfyUI/custom_nodes/
directory, or use the Manager for a streamlined setup.
Install manually
cd custom_nodes
git clone ...
cd custom_nodes/ComfyUI-AttentionDistillation
pip install -r requirements.txt
- restart ComfyUI
📒 How to Use
Download T2I diffusion models
This implementation utilizes checkpoints for diffusers
. Download the required models and place them in the ComfyUI/models/diffusers
directory:
|Model|Model Name and Link|
|:---:|:---:|
| Stable Diffusion (v1.5, v2.1) | stable-diffusion-v1-5/stable-diffusion-v1-5 <br> stabilityai/stable-diffusion-2-1 |
| SDXL | stabilityai/stable-diffusion-xl-base-1.0 |
| Flux (dev) | black-forest-labs/FLUX.1-dev |
~~Note: Currently, only Stable Diffusion v1.5 is required.~~
Load the workflow
Workflows for various tasks are available in ComfyUI/custom_nodes/Comfy-Attention-Distillation/workflows
. Simply load them to get started. Additionally, we've included usage examples in the Examples section for your reference.
🔍 Examples
Style-specific text-to-image generation
style_t2i_generation_sd15.json
style_t2i_generation_sdxl.json
style_t2i_generation_flux.json
(beta)
Style Transfer
style_transfer_sd15.json
📃 TODOs
- [x] Workflow for style-specific text-to-image generation using SDXL.
- [x] Workflow for style-specific text-to-image generation using Flux.
- [ ] Workflow for texture synthesis.