Nodes/ComfyUI Neural Network Toolkit NNT /NNT Define Transformer Encoder Layer
ComfyUI Node

NNT Define Transformer Encoder Layer

A ComfyUI node in NNT Neural Network Toolkit/Transformers with 8 inputs and 1 output.

By inventorado·Created 2 years ago·Updated 2 years ago· 69
NNT Define Transformer Encoder Layer
  • LAYER_STACK
  • LIST
d_model512
nhead8
dim_feedforward2048
dropout0.1
activationrelu
batch_firstTrue
norm_firstFalse
CategoryNNT Neural Network Toolkit/Transformers

Inputs (8)

NameTypeDefaultDescription
d_modelINT51264–2048
nheadINT81–32
dim_feedforwardINT2048128–8192
dropoutFLOAT0.10–0.9
activationCOMBOrelu4 options: relu, gelu, silu, tanh
batch_firstCOMBOTrue2 options: True, False
norm_firstCOMBOFalse2 options: True, False
LAYER_STACKoptLIST

Outputs (1)

NameTypeDescription
LISTLIST