Nodes/ComfyUI Neural Network Toolkit NNT /NNT DefineLocal Attention
ComfyUI Node

NNT DefineLocal Attention

A ComfyUI node in NNT Neural Network Toolkit/Transformers with 9 inputs and 1 output.

By inventorado·Created 2 years ago·Updated 2 years ago· 69
NNT DefineLocal Attention
  • LAYER_STACK
  • LIST
embed_dim512
num_heads8
window_size128
look_behind64
look_ahead0
dropout0.1
autopadTrue
batch_firstTrue
CategoryNNT Neural Network Toolkit/Transformers

Inputs (9)

NameTypeDefaultDescription
embed_dimINT51264–2048
num_headsINT81–32
window_sizeINT12816–512
look_behindINT640–256
look_aheadINT00–256
dropoutFLOAT0.10–0.9
autopadCOMBOTrue2 options: True, False
batch_firstCOMBOTrue2 options: True, False
LAYER_STACKoptLIST

Outputs (1)

NameTypeDescription
LISTLIST