NNT Define Vanilla Attention is a ComfyUI node in the NNT Neural Network Toolkit/Transformers category from ComfyUI Neural Network Toolkit NNT . Inputs…

Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.

ComfyUI Neural Network Toolkit NNT 

embed_dim

attention_type

dropout

use_bias

add_zero_attn

batch_first

LAYER_STACK

NntDefineVanillaAttention

LIST

NNT Define Vanilla Attention

Name	Type	Default	Description
embed_dim	INT	51264–2048	—
attention_type	COMBO	scaled_dot_product	5 options: dot_product, additive, scaled_dot_product, relative, local
dropout	FLOAT	0.10–0.9	—
use_bias	COMBO	True	2 options: True, False
add_zero_attn	COMBO	False	2 options: True, False
batch_first	COMBO	True	2 options: True, False
LAYER_STACKopt	LIST		—

NNT Define Vanilla Attention

Inputs (7)

Outputs (1)