ComfyUI Node: Optimizer Config Adafactor

Authored by kijai

Created

Updated

870 stars

Category

FluxTrainer

Inputs

max_grad_norm FLOAT
lr_scheduler
  • constant
  • cosine
  • cosine_with_restarts
  • polynomial
  • constant_with_warmup
  • adafactor
lr_warmup_steps INT
lr_scheduler_num_cycles INT
lr_scheduler_power FLOAT
relative_step BOOLEAN
scale_parameter BOOLEAN
warmup_init BOOLEAN
clip_threshold FLOAT
min_snr_gamma FLOAT
extra_optimizer_args STRING

Outputs

ARGS

Extension: ComfyUI Flux Trainer

Currently supports LoRA training, and untested full finetune with code from kohya's scripts: a/https://github.com/kohya-ss/sd-scripts

Authored by kijai

View Nodes

Run ComfyUI workflows in the Cloud!

No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

Learn more