Nodes/HaDeS Anima Suite/Anima Multi-Model Merger
ComfyUI Node

Anima Multi-Model Merger

A ComfyUI node in HaDeS/Anima Mergers with 14 inputs and 2 outputs.

By Devildonia·Created 6 days ago·Updated about 11 hours ago· 0
Anima Multi-Model Merger
  • model_1
  • model_2
  • base_model
  • model_3
  • model_4
  • MODEL
  • info
◄methodTIES►
◄density0.50►
◄scale1.00►
◄seed0►
◄weight_11.00►
◄weight_21.00►
◄weight_31.00►
◄weight_41.00►
◄protect_llm_adaptertrue►
CategoryHaDeS/Anima Mergers

Inputs (14)

NameTypeDefaultDescription
model_1MODEL—
model_2MODEL—
methodCOMBOTIESTIES: trim each task vector to its largest entries, elect a sign per entry, average the agreeing ones. DARE: randomly drop entries and rescale the rest (DARE-TIES then elects signs like TIES). Task Arithmetic: weighted average of the task vectors. Model Stock: average pulled toward base_model by the angle between the task vectors (ignores weights, density and scale). SLERP: spherical blend of model_1 and model_2 only, t = weight_2 / (weight_1 + weight_2); needs no base_model.
densityFLOAT0.500.05–1TIES: fraction of each task vector kept (largest entries). DARE: probability of keeping each entry.
scaleFLOAT1.000–2Strength of the merged task vector on top of base_model. 1.0 has the strength of an average; above 1.0 extrapolates.
seedINT00–18446744073709550000DARE drop mask. The same seed gives the same merge on the same kind of device.
weight_1FLOAT1.000–2Relative weight of model_1 (normalized by the sum of the connected models' weights).
weight_2FLOAT1.000–2Relative weight of model_2 (normalized by the sum of the connected models' weights).
base_modeloptMODELThe checkpoint the models were finetuned from (e.g. anima-base-v1.0). Required by every method except SLERP.
model_3optMODEL—
model_4optMODEL—
weight_3optFLOAT1.000–2Relative weight of model_3 (normalized by the sum of the connected models' weights).
weight_4optFLOAT1.000–2Relative weight of model_4 (normalized by the sum of the connected models' weights).
protect_llm_adapteroptBOOLEANtrueKeep the llm_adapter from base_model (from model_1 for SLERP), per Anima's llm_adapter_lr=0 rule.

Outputs (2)

NameTypeDescription
MODELMODEL—
infoSTRING—