ComfyUI Node
Ptn Embedding Transformer Linear
A ComfyUI node in Training with 14 inputs and 1 output.
Ptn Embedding Transformer Linear
- PTMODEL
◄num_layers6►
◄vocabulary_size10000►
◄hidden_size512►
◄nhead8►
◄dim_feedforward2048►
◄dropout0.10►
◄nonlinearity▾►
◄layer_norm_eps0►
◄batch_firsttrue►
◄norm_firstfalse►
◄biastrue►
◄max_length512►
◄linear_output_size1►
◄linear_biastrue►
CategoryTraining
Inputs (14)
| Name | Type | Default | Description |
|---|---|---|---|
| num_layers | INT | 61–256 | — |
| vocabulary_size | INT | 100001–1000000 | — |
| hidden_size | INT | 5121–1000000 | — |
| nhead | INT | 81–32 | — |
| dim_feedforward | INT | 20481–1000000 | — |
| dropout | FLOAT | 0.100–1 | — |
| nonlinearity | COMBO | 2 options: gelu, relu | |
| layer_norm_eps | FLOAT | 01e-9–0.1 | — |
| batch_first | BOOLEAN | true | — |
| norm_first | BOOLEAN | false | — |
| bias | BOOLEAN | true | — |
| max_length | INT | 5121–1000000 | — |
| linear_output_size | INT | 11–1000000 | — |
| linear_bias | BOOLEAN | true | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| PTMODEL | PTMODEL | — |