ComfyUI Node
PM Ties (Mergekit)
Concept: Builds on Task Arithmetic by sparsifying task vectors and applying a sign consensus algorithm. This helps to resolve interference when merging multiple models and retain more of their individual strengths. Use Cases: Merging a larger number of models effectively Reducing parameter interference and negative synergy between merged models Inputs: Requires 2 or more models. Key Parameters: - weight (per-model): Weight for each model's task vector - density (per-model): Fraction of weights to retain in each sparsified task vector - lambda (global): As in Task Arithmetic
PM Ties (Mergekit)
- MergeMethod
◄rescale_normdefault►
◄normalizetrue►
◄density0.90►
CategoryLoRA PowerMerge/Task Arithmetic
Inputs (3)
| Name | Type | Default | Description |
|---|---|---|---|
| rescale_norm | COMBO | default | Rescaling strategy: • default: Auto-select (L1 for methods needing it, none otherwise) • l1: L1 norm preservation (precise, preserves magnitude sum) • l2: L2 norm preservation (precise, preserves Euclidean norm) • linf: L-infinity norm (preserves max absolute value, prevents amplification) • none: No rescaling (may reduce merge strength) |
| normalize | BOOLEAN | true | If true, the weights of all models contributing to a tensor will be normalized. Default behavior. |
| density | FLOAT | 0.900–1 | Fraction of weights in differences from the base model to retain. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| MergeMethod | MergeMethod | — |