ComfyUI Node
Fast Attention Patch (Plan)
Plans a fast-attention kernel patch (flash/sage/sdpa/auto) for a model.
Fast Attention Patch (Plan)
- patch_plan_json
- feasible
- reason
◄backendauto►
◄sm80►
◄available_packages{}►
◄head_dim64►
◄batch_size1►
◄seq_len1024►
CategoryParametric/Sampling
Inputs (6)
| Name | Type | Default | Description |
|---|---|---|---|
| backend | COMBO | auto | Backend. One of 4 choices. Default auto. |
| sm | INT | 800–120 | Sm. From 0 to 120. Default 80. |
| available_packagesopt | STRING | {} | Available packages. Default {}. |
| head_dimopt | INT | 641–512 | Head dim. From 1 to 512. Default 64. |
| batch_sizeopt | INT | 11–1024 | How many to make at once. From 1 to 1024. Default 1. |
| seq_lenopt | INT | 10241–65536 | Seq len. From 1 to 65536. Default 1024. |
Outputs (3)
| Name | Type | Description |
|---|---|---|
| patch_plan_json | STRING | — |
| feasible | BOOLEAN | — |
| reason | STRING | — |