ComfyUI Node
NNT DefineReformer Attention
A ComfyUI node in NNT Neural Network Toolkit/Transformers with 9 inputs and 1 output.
NNT DefineReformer Attention
- LAYER_STACK
- LIST
◄embed_dim512►
◄num_heads8►
◄num_buckets32►
◄bucket_size64►
◄num_hashes8►
◄causalFalse►
◄dropout0.1►
◄batch_firstTrue►
CategoryNNT Neural Network Toolkit/Transformers
Inputs (9)
| Name | Type | Default | Description |
|---|---|---|---|
| embed_dim | INT | 51264–2048 | — |
| num_heads | INT | 81–32 | — |
| num_buckets | INT | 328–128 | — |
| bucket_size | INT | 6416–256 | — |
| num_hashes | INT | 81–16 | — |
| causal | COMBO | False | 2 options: True, False |
| dropout | FLOAT | 0.10–0.9 | — |
| batch_first | COMBO | True | 2 options: True, False |
| LAYER_STACKopt | LIST | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| LIST | LIST | — |