ComfyUI Node: MergeFluxLoRAsQuantizeAndLoaddMultiGPU

Authored by pollockjj

Created

Updated

195 stars

Category

multigpu

Inputs

unet_name
    switch_1
    • Off
    • On
    lora_name_1
    • None
    lora_weight_1 FLOAT
    switch_2
    • Off
    • On
    lora_name_2
    • None
    lora_weight_2 FLOAT
    switch_3
    • Off
    • On
    lora_name_3
    • None
    lora_weight_3 FLOAT
    switch_4
    • Off
    • On
    lora_name_4
    • None
    lora_weight_4 FLOAT
    quantization
    • Q2_K
    • Q3_K_S
    • Q4_0
    • Q4_1
    • Q4_K_S
    • Q5_0
    • Q5_1
    • Q5_K_S
    • Q6_K
    • Q8_0
    • FP16
    delete_final_gguf BOOLEAN
    new_model_name STRING
    device
    • cpu
    • cuda:0

    Outputs

    MODEL

    Extension: ComfyUI-MultiGPU

    This extension adds CUDA device selection to supported loader nodes in ComfyUI. By monkey-patching ComfyUI’s memory management, each model component (like UNet, Clip, or VAE) can be loaded on a specific GPU. Examples included are multi-GPU workflows for SDXL, FLUX, LTXVideo, and Hunyuan Video for both standard and GGUF loader nodes.

    Authored by pollockjj

    Run ComfyUI workflows in the Cloud!

    No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

    Learn more