ComfyUI Node
MinusZone - HYDiTAdvConfig
A ComfyUI node in MinusZone - TrainTools/HYDiT_native with 17 inputs and 1 output.
MinusZone - HYDiTAdvConfig
- advanced_config
◄lr1e-5►
◄rope_realenable►
◄target_modules_Wqkvenable►
◄target_modules_q_projenable►
◄target_modules_kv_projenable►
◄target_modules_out_projenable►
◄warmup_min_lr1e-6►
◄weight_decay0.00►
◄warmup_num_steps0.00►
◄uncond_p0.20►
◄uncond_p_t50.20►
◄use_flash_attndisable►
◄use_zero_stage2►
◄grad_accu_steps1►
◄extra_fp16enable►
◄qk_normenable►
◄normlayer►
CategoryMinusZone - TrainTools/HYDiT_native
Inputs (17)
| Name | Type | Default | Description |
|---|---|---|---|
| lr | STRING | 1e-5 | — |
| rope_real | COMBO | enable | 2 options: enable, disable |
| target_modules_Wqkv | COMBO | enable | 2 options: enable, disable |
| target_modules_q_proj | COMBO | enable | 2 options: enable, disable |
| target_modules_kv_proj | COMBO | enable | 2 options: enable, disable |
| target_modules_out_proj | COMBO | enable | 2 options: enable, disable |
| warmup_min_lr | STRING | 1e-6 | — |
| weight_decay | FLOAT | 0.00 | — |
| warmup_num_steps | FLOAT | 0.00 | — |
| uncond_p | FLOAT | 0.20 | — |
| uncond_p_t5 | FLOAT | 0.20 | — |
| use_flash_attn | COMBO | disable | 2 options: enable, disable |
| use_zero_stage | INT | 2 | — |
| grad_accu_steps | INT | 1 | — |
| extra_fp16 | COMBO | enable | 2 options: enable, disable |
| qk_norm | COMBO | enable | 2 options: enable, disable |
| norm | COMBO | layer | 2 options: rms, layer |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| advanced_config | MZ_TT_HYDiT_AdvConfig | — |