Extensions/ComfyUI_Patches_ll
ComfyUI Extension Runs on cloud

ComfyUI_Patches_ll

Some patches for Flux|HunYuanVideo|LTXVideo etc, support TeaCache, PuLID, First Block Cache.

By lldacing·Created 2 years ago·Updated 7 months ago· 124
lldacing/ComfyUI_Patches_ll
Nodes7
On cloudRunnable
Categorypatches/speed, patches/dit
Stars124
Updated7 months ago

Nodes (7)

ApplyFirstBlockCachePatch

One dial, big speedup

patches/speed
ApplyFirstBlockCachePatchAdvanced

Flux at 1.8x

patches/speed
ApplyTeaCachePatch

Near-free 1.5-2x speed on Flux and the video models

patches/speed
ApplyTeaCachePatchAdvanced

TeaCache with a start/end window for the aggressive middle

patches/speed
DitForwardOverrider

One overrider to rule Flux and every video model

patches/dit
FluxForwardOverrider

The quiet node that makes TeaCache and First Block Cache work on Flux

patches/dit
VideoForwardOverrider

Hunyuan, LTX, Mochi, and Wan

patches/dit
Readme

中文文档

Add some hooks method. Such as: TeaCache and First Block Cache for PuLID-Flux Flux HunYuanVideo LTXVideo MochiVideo WanVideo.

Need upgrade ComfyUI Version>=0.3.17

Preview (Image with WorkFlow)

save api extended

Working with PuLID (need my other custom nodes ComfyUI_PuLID_Flux_ll) save api extended

Install

  • Manual
    cd custom_nodes
    git clone https://github.com/lldacing/ComfyUI_Patches_ll.git
    # restart ComfyUI

Nodes

  • FluxForwardOverrider
    • Add some hooks method support to the Flux model
  • VideoForwardOverrider
    • Add some hooks method support to the video model. Support HunYuanVideo, LTXVideo, MochiVideo, WanVideo
  • DitForwardOverrider
    • Auto add some hooks method for model (automatically identify model type). Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
  • ApplyTeaCachePatch
    • Use the hooks provided in *ForwardOverrider to support TeaCache acceleration. Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
    • In my test results, the video quality is not good after acceleration for MochiVideo
  • ApplyTeaCachePatchAdvanced
    • Support start_at and end_at
  • ApplyFirstBlockCachePatch
    • Use the hooks provided in *ForwardOverrider to support First Block Cache acceleration. Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
    • In my test results, the video quality is not good after acceleration for MochiVideo
  • ApplyFirstBlockCachePatchAdvanced
    • Support start_at and end_at

SpeedUp reference

TeaCache (rel_l1_thresh value)

| | Original | 1.5x | 1.8x | 2.0x | |--------------|----------|------|------|------| | Flux | 0 | 0.25 | 0.4 | 0.6 | | HunYuanVideo | 0 | 0.1 | - | 0.15 | | LTXVideo | 0 | 0.03 | - | 0.05 | | MochiVideo | 0 | 0.06 | - | 0.09 | | WanVideo | 0 | - | - | - |

Note: "-" indicates small speedup, low quality or untested. WanVideo's different models have different acceleration effects.

First Block Cache (residual_diff_threshold value)

| | Original | 1.2x | 1.5x | 1.8x | |--------------|----------|------|------|------| | Flux | 0 | - | - | 0.12 | | HunYuanVideo | 0 | - | 0.1 | - | | LTXVideo | 0 | 0.05 | - | - | | MochiVideo | 0 | - | 0.03 | - | | WanVideo | 0 | - | 0.05 | - |

Note: "-" indicates small speedup, low quality or untested.

Thanks

TeaCache
ParaAttention
Comfy-WaveSpeed