Nodes/Flex Attention/Flex Attention (torch.compile)
ComfyUI Node

Flex Attention (torch.compile)

Patch attention to use PyTorch Flex Attention (torch.compile). No extra dependencies — works on any GPU supported by torch.compile. Falls back to PyTorch SDPA when masks are present.

By sorryhyun·Created 4 months ago·Updated 4 months ago· 1
Flex Attention (torch.compile)
  • model
  • MODEL
Categoryattention

Inputs (1)

NameTypeDefaultDescription
modelMODEL

Outputs (1)

NameTypeDescription
MODELMODEL