ComfyUI Node
Ptn Multihead Attention
A ComfyUI node in Training with 9 inputs and 1 output.
Ptn Multihead Attention
- PTMODEL
◄embed_dim512►
◄num_heads8►
◄dropout0.00►
◄biastrue►
◄add_bias_kvfalse►
◄add_zero_attnfalse►
◄kdim512►
◄vdim512►
◄batch_firsttrue►
CategoryTraining
Inputs (9)
| Name | Type | Default | Description |
|---|---|---|---|
| embed_dim | INT | 5121–1000000 | — |
| num_heads | INT | 81–256 | — |
| dropout | FLOAT | 0.000–1 | — |
| bias | BOOLEAN | true | — |
| add_bias_kv | BOOLEAN | false | — |
| add_zero_attn | BOOLEAN | false | — |
| kdim | INT | 5121–1000000 | — |
| vdim | INT | 5121–1000000 | — |
| batch_first | BOOLEAN | true | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| PTMODEL | PTMODEL | — |