ComfyUI Node: NNT Define Multihead Attention

Authored by inventorado

Created

Updated

67 stars

Category

NNT Neural Network Toolkit/Transformers

Inputs

embed_dim INT
num_heads INT
dropout FLOAT
bias
  • True
  • False
add_bias_kv
  • True
  • False
add_zero_attn
  • True
  • False
batch_first
  • True
  • False
kdim INT
vdim INT
LAYER_STACK LIST

Outputs

LIST

Extension: ComfyUI Neural Network Toolkit NNT

Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.

Authored by inventorado

View Nodes

Run ComfyUI workflows in the Cloud!

No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

Learn more