Nodes/ComfyUI-H3-SGLang-Pack/Patch Sage Attention KJ (SGLang)
ComfyUI Node

Patch Sage Attention KJ (SGLang)

Worker-native replacement for Patch Sage Attention KJ.

By TensorClay·Created 11 days ago·Updated a day ago· 6
Patch Sage Attention KJ (SGLang)
  • model
  • MODEL
sage_attentionfalse
allow_compilefalse
CategorySGLang/MiniMax H3

Inputs (3)

NameTypeDefaultDescription
modelMODEL
sage_attentionCOMBOfalsePatch the attention of the model passing through this node to use sageattn. To revert, run this node again with the disabled option. Requires the sageattention library to be installed.
allow_compileoptBOOLEANfalseAllow the use of torch.compile for the sage attention function, requires latest sageattn 2.2.0 or higher.

Outputs (1)

NameTypeDescription
MODELMODEL