Nodes/ComfyUi-MpiNodes/Mpi LoRA Extract
ComfyUI Node

Mpi LoRA Extract

Extracts a LoRA from the difference between a finetuned and an original model (or CLIP) and saves it under output/.

By MadPonyInteractive·Created about a year ago·Updated a day ago· 4
Mpi LoRA Extract
  • finetuned
  • original
    ◄filename_prefixloras/ComfyUI_extracted_lora►
    ◄rank64►
    ◄lora_type▾►
    ◄algorithmsvd_lowrank►
    ◄lowrank_iters7►
    ◄output_dtypefp16►
    ◄bias_difftrue►
    ◄adaptive_param0.15►
    ◄clamp_quantilefalse►
    CategoryMpiNodes/KJ

    Inputs (11)

    NameTypeDefaultDescription
    finetunedMODEL,CLIPThe finetuned model or clip to extract LoRA from.
    originalMODEL,CLIPThe original base model or clip to diff against.
    filename_prefixSTRINGloras/ComfyUI_extracted_lora—
    rankINT641–4096The rank for a standard LoRA, or the maximum rank for adaptive methods.
    lora_typeCOMBO6 options: standard, full, adaptive_ratio, adaptive_quantile, adaptive_energy, adaptive_fro
    algorithmCOMBOsvd_lowrankSVD algorithm; svd_lowrank is faster but less accurate.
    lowrank_itersINT71–100Subspace iterations for the lowrank SVD algorithm.
    output_dtypeCOMBOfp163 options: fp16, bf16, fp32
    bias_diffBOOLEANtrue—
    adaptive_paramFLOAT0.150–1ratio mode: fraction of the largest singular value. quantile mode: the quantile of the singular values. fro mode: Frobenius norm retention.
    clamp_quantileBOOLEANfalse—

    Outputs (0)

    No outputs