ComfyUI Node: Ptn Multihead Attention

Authored by HowToSD

Created

Updated

7 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

Training

Inputs

embed_dim INT
num_heads INT
dropout FLOAT
bias BOOLEAN
add_bias_kv BOOLEAN
add_zero_attn BOOLEAN
kdim INT
vdim INT
batch_first BOOLEAN

Outputs

PTMODEL

Extension: ComfyUI-Pt-Wrapper

PyTorch extension for ComfyUI featuring extensive PyTorch wrapper nodes for seamless tensor operations and PyTorch model training.

Authored by HowToSD

Looking for a different node?

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more