ComfyUI Node: NNT Define Vanilla Attention
Run ComfyUI workflows without the setup
No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.
Category
NNT Neural Network Toolkit/Transformers
Inputs
embed_dim INT
attention_type
- dot_product
- additive
- scaled_dot_product
- relative
- local
dropout FLOAT
use_bias
- True
- False
add_zero_attn
- True
- False
batch_first
- True
- False
LAYER_STACK LIST
Outputs
LIST
Extension: ComfyUI Neural Network Toolkit NNT
Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.
Authored by inventorado
Looking for a different node?
More nodes in ComfyUI Neural Network Toolkit NNT
Other NNT Neural Network Toolkit/Transformers nodes
Run ComfyUI workflows without the setup
No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.