ComfyUI Node: NNT Define Linear Attention
Category
NNT Neural Network Toolkit/Transformers
Inputs
embed_dim INT
num_heads INT
feature_map
- elu
- relu
- softmax
eps FLOAT
causal
- True
- False
dropout FLOAT
batch_first
- True
- False
LAYER_STACK LIST
Outputs
LIST
Extension: ComfyUI Neural Network Toolkit NNT
Neural Network Toolkit (NNT) for ComfyUI is an extensive set of custom ComfyUI nodes for designing, training, and fine-tuning neural networks. This toolkit allows defining models, layers, training workflows, transformers, and tensor operations in a visual manner using nodes.
Authored by inventorado
Run ComfyUI workflows in the Cloud!
No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues
Learn more