ComfyUI Node
BSAI Prism Turbo Optimizer (torch.compile)
A ComfyUI node in BSAI/Prism/Turbo with 10 inputs and 2 outputs.
BSAI Prism Turbo Optimizer (torch.compile)
- prism_model
- prism_model
- status
◄enable_torch_compilefalse►
◄compile_modedefault►
◄compile_dynamicfalse►
◄enable_cache_dittrue►
◄cache_dit_fn1►
◄cache_dit_bn1►
◄cache_dit_rdt0.24►
◄cache_dit_mc3►
◄quantize_modenone►
CategoryBSAI/Prism/Turbo
Inputs (10)
| Name | Type | Default | Description |
|---|---|---|---|
| prism_model | BSAI_PRISM_MODEL | — | |
| enable_torch_compile | BOOLEAN | false | torch.compile on the transformer forward. Note: the custom BSA Triton kernels may fail to compile on PyTorch 2.13 + sm_120. Off by default; rely on Cache-DiT + CFG Rescale instead. |
| compile_mode | COMBO | default | default = no CUDA graphs (compatible with cudaMallocAsync); reduce-overhead = CUDA graphs, fastest but conflicts with --cuda-malloc; max-autotune = most aggressive optimization. |
| compile_dynamic | BOOLEAN | false | dynamic=True supports variable shapes (slower but more flexible); False compiles for a fixed shape (fastest). Choose False when the resolution is fixed. |
| enable_cache_dit | BOOLEAN | true | Cache-DiT block-level caching (validated 7.4x speedup by SGLang). Skips block recomputation when the input changes little. |
| cache_dit_fn | INT | 10–10 | Always compute the first N blocks (cache disabled). Default 1. |
| cache_dit_bn | INT | 10–10 | Always compute the last N blocks. Default 1. |
| cache_dit_rdt | FLOAT | 0.240.05–1 | Residual difference threshold. Smaller = stricter (more recompute, better quality); larger = more aggressive (more skips, faster). Default 0.24. |
| cache_dit_mc | INT | 31–10 | Maximum consecutive cached steps; after that a recompute is forced. Default 3. |
| quantize_mode | COMBO | none | float8_dynamic = W8A8 fp8, halves VRAM; int4_weight_only = W4A16, 4-bit weights use 1/4 VRAM, activations uncompressed, best quality; int4_float8_dynamic = W4A8, 4-bit weights + fp8 activations, maximum Blackwell speedup. |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| prism_model | BSAI_PRISM_MODEL | — |
| status | STRING | — |