ComfyUI Node: NNT Define Multihead Attention
Category
NNT Neural Network Toolkit/Transformers
Inputs
embed_dim INT
num_heads INT
dropout FLOAT
bias
- True
- False
add_bias_kv
- True
- False
add_zero_attn
- True
- False
batch_first
- True
- False
kdim INT
vdim INT
LAYER_STACK LIST
Outputs
LIST
Extension: ComfyUI Neural Network Toolkit NNT
Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.
Authored by inventorado
Run ComfyUI workflows in the Cloud!
No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues
Learn more