ComfyUI Node: Optimizer Config Adafactor
Category
FluxTrainer
Inputs
max_grad_norm FLOAT
lr_scheduler
- constant
- cosine
- cosine_with_restarts
- polynomial
- constant_with_warmup
- adafactor
lr_warmup_steps INT
lr_scheduler_num_cycles INT
lr_scheduler_power FLOAT
relative_step BOOLEAN
scale_parameter BOOLEAN
warmup_init BOOLEAN
clip_threshold FLOAT
min_snr_gamma FLOAT
extra_optimizer_args STRING
Outputs
ARGS
Extension: ComfyUI Flux Trainer
Currently supports LoRA training, and untested full finetune with code from kohya's scripts: a/https://github.com/kohya-ss/sd-scripts
Authored by kijai
Run ComfyUI workflows in the Cloud!
No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues
Learn more