ComfyUI Node
NNT Define TransformerXL Attention
A ComfyUI node in NNT Neural Network Toolkit/Transformers with 8 inputs and 1 output.
NNT Define TransformerXL Attention
- LAYER_STACK
- LIST
◄d_model512►
◄num_heads8►
◄mem_len512►
◄same_lengthFalse►
◄clamp_len-1►
◄dropout0.1►
◄batch_firstTrue►
CategoryNNT Neural Network Toolkit/Transformers
Inputs (8)
| Name | Type | Default | Description |
|---|---|---|---|
| d_model | INT | 51264–2048 | — |
| num_heads | INT | 81–32 | — |
| mem_len | INT | 5120–2048 | — |
| same_length | COMBO | False | 2 options: True, False |
| clamp_len | INT | -1-1–2048 | — |
| dropout | FLOAT | 0.10–0.9 | — |
| batch_first | COMBO | True | 2 options: True, False |
| LAYER_STACKopt | LIST | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| LIST | LIST | — |