ComfyUI Extension: ComfyUI_Wan2_1_lora_trainer

<div align="center"><h1>ComfyUI MUSUBI-TUNNER WAN LORA TRAINER</h1></div>

2025: June 25 Update version 1.1.0:

• Added Sampler node to generate images every n steps or epochs (Images are in the folder "sample" in your output Lora path).
• BlockSwap node fix triggering it to the launcher.
• Network weights fix triggering the assigned path (now you are able to train from a previous lora assigning her's path location).
• Network args trigger fix.
• Optimizer args trigger fix.
• Tom argument image extension setted up to ".txt" as default.
• Enable bucket no upscale setting trigger fix. (no works correctly to prevent upscale).
• Max train step setted up to 2048 as default (taking in account this set is multiplied by epochs and images).
• Setted up timestep_sampling to "shift" as default.
• Setted up epoch to 128 as default.
• Added 2 example workflows for 14B and 1.3B models, (located in the folder "workflows", you can also download form the website).
• Code improvements.
• Code mods for full compatibility with the last version of ComfyUi.
• Added 6 nodes for training.
• Added Example Workflow in the custom node folder.
• Made for ComfyUi windows portable package.
• Automated process for the creation of the TOM file, cache latents, cache texts & trainning run (Nodes triggered by this order to do the complete process in one shot).
• You can skip latents and text caches if you need to restart the training (taking into account data has not changed vae, clipvision, text models).
• For more info about setting up correctly parameters you can check the Wan Doc on https://github.com/kohya-ss/musubi-tuner/blob/main/docs/wan.md

About max_train_epochs: The max train epochs is an equations that takes into account several arguments as gradients, number of images etc. This must be set up between 16/128 depending of the number of images you want to train. To ensure a little package of 30 images, set up it as maximum (128) to train more than 5000 steps. Take into account network dropout to not overfitting, also dim and alpha. All is relative but for sure you will find you custom setting depending of your purpose. For the moment max train epochs have a limit to 128, but if is needed to add a bigger max value i can update it.

Performances test with 312 images with default settings (spda) :

Instructions:

1. Clone this repository into your custom node folder.
2. install requirements.txt from custom_nodes\ComfyUI_Wan2_1_lora_trainer :

 ..\..\..\python_embeded\python -m pip install -r requirements.txt

3. run comfyUi
4. Enjoy training.

If you want to use musubi compile setting you must to create your custom bat and run ComfyUi from it (with you desired configs for ComfyUI) Example:

@echo off
REM Load Visual Studio Build Tools for the Wan subprocess environment (Optional to use max pow with the musubi compile settings and memory nodes)
call "C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\Build\vcvarsall.bat" amd64
REM Start ComfyUI
.\python_embeded\python.exe -s ComfyUI\main.py --windows-standalone-build --use-sage-attention --fast fp16_accumulation
pause

NOTE : The reason of adding this windows call is because the Trainer runs in a new sub process inheriting the ComfyUI environment, but is needed to setup ComfyUI as root path to work with.

CLIP VISION : Clip vision is just setted up for I2V models, for training T2V Models, set clip to None.

NOTE : The reason of adding this windows call is because the Trainer runs in a new sub process inheriting the ComfyUI environment, but needs its own Visual Studio environment to work.

CLIP VISION : Clip vision is just setted up for I2V models, for training T2V Models, set clip to None.

if you don't have any of this modules you can disconnect the musubi compile settings node.

• Path into an empty folder for the cache (use different folders for each lora to not mix you cache data (cleaner and probably faster). Then conect the compiler and memory nodes and choose the attention [SPDA, XFORMERS] (Sage seems to burn the Lora, avoid it for the moment):

if you don't have any of this modules you can bypass the musubi compile settings node and memory (not need for 1.3B models in most cases, but necesary if you have very low VRAM):

• Image data input are not exclusive to videos! you can train just with images as the following example (path to your images and text captions):

• Image data input are not exclusive to videos! you can train just with images as the following example (path to your images and text captions):

• Performances test with 312 images with default settings (spda) :

And the results :

https://github.com/user-attachments/assets/41b439ee-6e90-49ac-83dd-d1ba21fd1d63

For any concern no doubt to contact me.