NNT Define Linear Attention is a ComfyUI node in the NNT Neural Network Toolkit/Transformers category from ComfyUI Neural Network Toolkit NNT . Inputs…

Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.

ComfyUI Neural Network Toolkit NNT 

embed_dim

num_heads

feature_map

causal

dropout

batch_first

LAYER_STACK

NntDefineLinearAttention

LIST

NNT Define Linear Attention

Name	Type	Default	Description
embed_dim	INT	51264–2048	—
num_heads	INT	81–32	—
feature_map	COMBO	elu	3 options: elu, relu, softmax
eps	FLOAT	0.00001e-12–0.001	—
causal	COMBO	False	2 options: True, False
dropout	FLOAT	0.10–0.9	—
batch_first	COMBO	True	2 options: True, False
LAYER_STACKopt	LIST		—

NNT Define Linear Attention

Inputs (8)

Outputs (1)