ComfyUI Node: NNT Define Vanilla Attention
Category
NNT Neural Network Toolkit/Transformers
Inputs
embed_dim INT
attention_type
- dot_product
- additive
- scaled_dot_product
- relative
- local
dropout FLOAT
use_bias
- True
- False
add_zero_attn
- True
- False
batch_first
- True
- False
LAYER_STACK LIST
Outputs
LIST
Extension: ComfyUI Neural Network Toolkit NNT
Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.
Authored by inventorado
Run ComfyUI workflows in the Cloud!
No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues
Learn more