ComfyUI Node
Krea 2 TileMix Attention (FP16/INT8 tiles)
Patch only Krea 2's gated joint image/text attention with bidirectional TileMix (FP16/INT8 tile routing). Projections, QK norm, RoPE, sigmoid gate, and output projection remain stock.
Krea 2 TileMix Attention (FP16/INT8 tiles)
- model
- MODEL
◄enabledtrue►
◄patternband►
◄percentage0.50►
◄min_tokens1024►
◄smooth_ktrue►
◄qk_fp32_accumulatefalse►
◄strictfalse►
Categorymodel_patches/attention
Inputs (8)
| Name | Type | Default | Description |
|---|---|---|---|
| model | MODEL | — | |
| enabled | BOOLEAN | true | — |
| pattern | COMBO | band | Which image-image score tiles compute in INT8. band keeps a diagonal window FP16; one routes every image tile to INT8; zero is an FP16-only sanity mode. |
| percentage | FLOAT | 0.500–1 | Fraction of image-image tiles routed to INT8 (text tiles always stay FP16). |
| min_tokens | INT | 1024256–131072 | Keep Krea's original attention below this joint text+image token count. |
| smooth_k | BOOLEAN | true | Mean-centre K per head before INT8 quantisation (exact for softmax; improves INT8 accuracy). |
| qk_fp32_accumulate | BOOLEAN | false | Accumulate FP16-tile scores in fp32: SDPA-level accuracy for very sharp attention, about 25% slower FP16 tiles. |
| strict | BOOLEAN | false | Raise TileMix errors instead of falling back to Krea's original attention. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| MODEL | MODEL | — |