DIT Deep Debiaser (Z-Image Sub-Component)
174 controls inside Z-Image, below block level
- model
- model
- info
The pack's Z-Image Model Layer Editor lets you scale whole layers of the base model. This node goes further: inside each of those layers, attention, feed-forward, and normalization are separate, individually addressable pieces - 174 of them across the whole DiT - for when a block-level edit is too blunt an instrument.
What it is and why you'd reach for it
Z-Image's DiT is built from a context_refiner, 30 main transformer layers, and a noise_refiner, and this node splits every one of them into functional sub-components rather than treating a layer as one knob. Main layers get five: adaLN (timestep and conditioning modulation), attn (self-attention: qkv, output projection, norms), attn_norm, ffn (the SwiGLU feed-forward network), and ffn_norm. The context_refiner and noise_refiner blocks get four each (no adaLN). Add five embedders (cap_embedder, t_embedder, x_embedder, cap_pad_token, x_pad_token) and one final_layer, and you land at 174 total controls.
This is the deepest edit available in the pack for Z-Image's diffusion transformer - deeper than the block-level Model Layer Editor, and operating on the base checkpoint rather than a LoRA, so whatever you do here applies to every LoRA and every prompt afterward. The pack's own author has used this level of granularity productively in public: block-level community testing on this same pack found an anatomical feature concentrated in a narrow layer band (17-21) rather than where the trainer expected, and sub-component control is the natural next step once block-level analysis has told you roughly where to look and you need finer resolution than "the whole layer."
Inputs and outputs that matter
- model - the Z-Image checkpoint to edit.
- preset - 15 built-in options (Weaken ALL attn 90/85/80%, Weaken ALL ffn 90/85%, Weaken ALL adaLN 90/85%, Weaken ALL attn+ffn, Weaken ALL attn_norm+ffn_norm 90%, and more) as a starting point instead of hand-setting 174 sliders.
- cap_embedder, t_embedder, x_embedder, cap_pad_token, x_pad_token - the 5 embedder controls.
- cr0_attn/cr0_attn_norm/cr0_ffn/cr0_ffn_norm, cr1_* - the context_refiner's two blocks, 4 controls each.
- l0_adaLN/l0_attn/l0_attn_norm/l0_ffn/l0_ffn_norm through l29_* - the 30 main layers, 5 controls each (150 total).
- nr0_* / nr1_* - the noise_refiner's two blocks, 5 controls each (10 total, since these do have
adaLN). - final_layer - the last control.
- Every one of the 174 has its own toggle and a -5 to 5 strength slider.
- save_model / save_mode / filename (optional) - export the modified checkpoint.
save_modegivesfull_model(a complete, loadable checkpoint),diff_only(just the changes, applied as a patch), orboth. - Outputs: model (patched, feed to your sampler or a LoRA loader downstream), info (a text report of what changed).
Installing it
ComfyUI Manager: search "Realtime LoRA Trainer." Manual:
cd ComfyUI/custom_nodes
git clone https://github.com/ShootTheSound/comfyUI-Realtime-Lora
Restart ComfyUI. No additional install needed - the Deep Debiaser suite works out of the box, same as the pack's loaders and analyzers, and Z-Image's smaller size (6B parameters, quantizable down to 4GB) means this is one of the more approachable models in the pack to experiment on without a huge VRAM budget.
Troubleshooting
Set a sub-component to 0.0 for a clean removal and got noise. Expected - the pack's own warning applies here too: 0.0 tends to produce noise or artifacts rather than "no contribution," and the recommended working range is 0.5-1.5.
Not sure where to even start among 174 controls. Run the pack's block-level Model Layer Editor or one of its LoRA analyzers first to narrow down which of the 30 main layers is actually relevant to your problem, then come here and use this node's sub-component controls only on that narrower range instead of guessing across all 174 cold.
Edited ffn on several layers hoping to fix a style leak and likeness broke instead. The feed-forward network and attention do different jobs - attention tends to carry more of the relational/positional information (what's next to what), while the feed-forward network processes each token's features independently. If likeness degraded, you may have hit a layer where ffn was actually load-bearing for identity, not just style; walk the change back to a single layer at a time before applying it broadly.
Inputs (353)
| Name | Type | Default | Description |
|---|---|---|---|
| model | MODEL | Z-Image Turbo model | |
| preset | COMBO | Default | 15 options: Custom, Default, Weaken ALL attn 90%, Weaken ALL attn 85%, Weaken ALL attn 80%, Weaken ALL ffn 90%, +9 |
| save_model | BOOLEAN | false | Save the modified model to disk when enabled |
| save_mode | COMBO | full_model | full_model = complete safetensors (~12GB). diff_only = only changed weights (small). both = save both files. |
| filename | STRING | auto | Filename (no extension). 'auto' = generate from settings. |
| cap_embedder | BOOLEAN | true | — |
| cap_embedder_str | FLOAT | 1.00-5–5 | — |
| t_embedder | BOOLEAN | true | — |
| t_embedder_str | FLOAT | 1.00-5–5 | — |
| x_embedder | BOOLEAN | true | — |
| x_embedder_str | FLOAT | 1.00-5–5 | — |
| cap_pad_token | BOOLEAN | true | — |
| cap_pad_token_str | FLOAT | 1.00-5–5 | — |
| x_pad_token | BOOLEAN | true | — |
| x_pad_token_str | FLOAT | 1.00-5–5 | — |
| cr0_attn | BOOLEAN | true | — |
| cr0_attn_str | FLOAT | 1.00-5–5 | — |
| cr0_attn_norm | BOOLEAN | true | — |
| cr0_attn_norm_str | FLOAT | 1.00-5–5 | — |
| cr0_ffn | BOOLEAN | true | — |
| cr0_ffn_str | FLOAT | 1.00-5–5 | — |
| cr0_ffn_norm | BOOLEAN | true | — |
| cr0_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| cr1_attn | BOOLEAN | true | — |
| cr1_attn_str | FLOAT | 1.00-5–5 | — |
| cr1_attn_norm | BOOLEAN | true | — |
| cr1_attn_norm_str | FLOAT | 1.00-5–5 | — |
| cr1_ffn | BOOLEAN | true | — |
| cr1_ffn_str | FLOAT | 1.00-5–5 | — |
| cr1_ffn_norm | BOOLEAN | true | — |
| cr1_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l0_adaLN | BOOLEAN | true | — |
| l0_adaLN_str | FLOAT | 1.00-5–5 | — |
| l0_attn | BOOLEAN | true | — |
| l0_attn_str | FLOAT | 1.00-5–5 | — |
| l0_attn_norm | BOOLEAN | true | — |
| l0_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l0_ffn | BOOLEAN | true | — |
| l0_ffn_str | FLOAT | 1.00-5–5 | — |
| l0_ffn_norm | BOOLEAN | true | — |
| l0_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l1_adaLN | BOOLEAN | true | — |
| l1_adaLN_str | FLOAT | 1.00-5–5 | — |
| l1_attn | BOOLEAN | true | — |
| l1_attn_str | FLOAT | 1.00-5–5 | — |
| l1_attn_norm | BOOLEAN | true | — |
| l1_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l1_ffn | BOOLEAN | true | — |
| l1_ffn_str | FLOAT | 1.00-5–5 | — |
| l1_ffn_norm | BOOLEAN | true | — |
| l1_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l2_adaLN | BOOLEAN | true | — |
| l2_adaLN_str | FLOAT | 1.00-5–5 | — |
| l2_attn | BOOLEAN | true | — |
| l2_attn_str | FLOAT | 1.00-5–5 | — |
| l2_attn_norm | BOOLEAN | true | — |
| l2_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l2_ffn | BOOLEAN | true | — |
| l2_ffn_str | FLOAT | 1.00-5–5 | — |
| l2_ffn_norm | BOOLEAN | true | — |
| l2_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l3_adaLN | BOOLEAN | true | — |
| l3_adaLN_str | FLOAT | 1.00-5–5 | — |
| l3_attn | BOOLEAN | true | — |
| l3_attn_str | FLOAT | 1.00-5–5 | — |
| l3_attn_norm | BOOLEAN | true | — |
| l3_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l3_ffn | BOOLEAN | true | — |
| l3_ffn_str | FLOAT | 1.00-5–5 | — |
| l3_ffn_norm | BOOLEAN | true | — |
| l3_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l4_adaLN | BOOLEAN | true | — |
| l4_adaLN_str | FLOAT | 1.00-5–5 | — |
| l4_attn | BOOLEAN | true | — |
| l4_attn_str | FLOAT | 1.00-5–5 | — |
| l4_attn_norm | BOOLEAN | true | — |
| l4_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l4_ffn | BOOLEAN | true | — |
| l4_ffn_str | FLOAT | 1.00-5–5 | — |
| l4_ffn_norm | BOOLEAN | true | — |
| l4_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l5_adaLN | BOOLEAN | true | — |
| l5_adaLN_str | FLOAT | 1.00-5–5 | — |
| l5_attn | BOOLEAN | true | — |
| l5_attn_str | FLOAT | 1.00-5–5 | — |
| l5_attn_norm | BOOLEAN | true | — |
| l5_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l5_ffn | BOOLEAN | true | — |
| l5_ffn_str | FLOAT | 1.00-5–5 | — |
| l5_ffn_norm | BOOLEAN | true | — |
| l5_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l6_adaLN | BOOLEAN | true | — |
| l6_adaLN_str | FLOAT | 1.00-5–5 | — |
| l6_attn | BOOLEAN | true | — |
| l6_attn_str | FLOAT | 1.00-5–5 | — |
| l6_attn_norm | BOOLEAN | true | — |
| l6_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l6_ffn | BOOLEAN | true | — |
| l6_ffn_str | FLOAT | 1.00-5–5 | — |
| l6_ffn_norm | BOOLEAN | true | — |
| l6_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l7_adaLN | BOOLEAN | true | — |
| l7_adaLN_str | FLOAT | 1.00-5–5 | — |
| l7_attn | BOOLEAN | true | — |
| l7_attn_str | FLOAT | 1.00-5–5 | — |
| l7_attn_norm | BOOLEAN | true | — |
| l7_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l7_ffn | BOOLEAN | true | — |
| l7_ffn_str | FLOAT | 1.00-5–5 | — |
| l7_ffn_norm | BOOLEAN | true | — |
| l7_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l8_adaLN | BOOLEAN | true | — |
| l8_adaLN_str | FLOAT | 1.00-5–5 | — |
| l8_attn | BOOLEAN | true | — |
| l8_attn_str | FLOAT | 1.00-5–5 | — |
| l8_attn_norm | BOOLEAN | true | — |
| l8_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l8_ffn | BOOLEAN | true | — |
| l8_ffn_str | FLOAT | 1.00-5–5 | — |
| l8_ffn_norm | BOOLEAN | true | — |
| l8_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l9_adaLN | BOOLEAN | true | — |
| l9_adaLN_str | FLOAT | 1.00-5–5 | — |
| l9_attn | BOOLEAN | true | — |
| l9_attn_str | FLOAT | 1.00-5–5 | — |
| l9_attn_norm | BOOLEAN | true | — |
| l9_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l9_ffn | BOOLEAN | true | — |
| l9_ffn_str | FLOAT | 1.00-5–5 | — |
| l9_ffn_norm | BOOLEAN | true | — |
| l9_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l10_adaLN | BOOLEAN | true | — |
| l10_adaLN_str | FLOAT | 1.00-5–5 | — |
| l10_attn | BOOLEAN | true | — |
| l10_attn_str | FLOAT | 1.00-5–5 | — |
| l10_attn_norm | BOOLEAN | true | — |
| l10_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l10_ffn | BOOLEAN | true | — |
| l10_ffn_str | FLOAT | 1.00-5–5 | — |
| l10_ffn_norm | BOOLEAN | true | — |
| l10_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l11_adaLN | BOOLEAN | true | — |
| l11_adaLN_str | FLOAT | 1.00-5–5 | — |
| l11_attn | BOOLEAN | true | — |
| l11_attn_str | FLOAT | 1.00-5–5 | — |
| l11_attn_norm | BOOLEAN | true | — |
| l11_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l11_ffn | BOOLEAN | true | — |
| l11_ffn_str | FLOAT | 1.00-5–5 | — |
| l11_ffn_norm | BOOLEAN | true | — |
| l11_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l12_adaLN | BOOLEAN | true | — |
| l12_adaLN_str | FLOAT | 1.00-5–5 | — |
| l12_attn | BOOLEAN | true | — |
| l12_attn_str | FLOAT | 1.00-5–5 | — |
| l12_attn_norm | BOOLEAN | true | — |
| l12_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l12_ffn | BOOLEAN | true | — |
| l12_ffn_str | FLOAT | 1.00-5–5 | — |
| l12_ffn_norm | BOOLEAN | true | — |
| l12_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l13_adaLN | BOOLEAN | true | — |
| l13_adaLN_str | FLOAT | 1.00-5–5 | — |
| l13_attn | BOOLEAN | true | — |
| l13_attn_str | FLOAT | 1.00-5–5 | — |
| l13_attn_norm | BOOLEAN | true | — |
| l13_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l13_ffn | BOOLEAN | true | — |
| l13_ffn_str | FLOAT | 1.00-5–5 | — |
| l13_ffn_norm | BOOLEAN | true | — |
| l13_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l14_adaLN | BOOLEAN | true | — |
| l14_adaLN_str | FLOAT | 1.00-5–5 | — |
| l14_attn | BOOLEAN | true | — |
| l14_attn_str | FLOAT | 1.00-5–5 | — |
| l14_attn_norm | BOOLEAN | true | — |
| l14_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l14_ffn | BOOLEAN | true | — |
| l14_ffn_str | FLOAT | 1.00-5–5 | — |
| l14_ffn_norm | BOOLEAN | true | — |
| l14_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l15_adaLN | BOOLEAN | true | — |
| l15_adaLN_str | FLOAT | 1.00-5–5 | — |
| l15_attn | BOOLEAN | true | — |
| l15_attn_str | FLOAT | 1.00-5–5 | — |
| l15_attn_norm | BOOLEAN | true | — |
| l15_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l15_ffn | BOOLEAN | true | — |
| l15_ffn_str | FLOAT | 1.00-5–5 | — |
| l15_ffn_norm | BOOLEAN | true | — |
| l15_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l16_adaLN | BOOLEAN | true | — |
| l16_adaLN_str | FLOAT | 1.00-5–5 | — |
| l16_attn | BOOLEAN | true | — |
| l16_attn_str | FLOAT | 1.00-5–5 | — |
| l16_attn_norm | BOOLEAN | true | — |
| l16_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l16_ffn | BOOLEAN | true | — |
| l16_ffn_str | FLOAT | 1.00-5–5 | — |
| l16_ffn_norm | BOOLEAN | true | — |
| l16_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l17_adaLN | BOOLEAN | true | — |
| l17_adaLN_str | FLOAT | 1.00-5–5 | — |
| l17_attn | BOOLEAN | true | — |
| l17_attn_str | FLOAT | 1.00-5–5 | — |
| l17_attn_norm | BOOLEAN | true | — |
| l17_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l17_ffn | BOOLEAN | true | — |
| l17_ffn_str | FLOAT | 1.00-5–5 | — |
| l17_ffn_norm | BOOLEAN | true | — |
| l17_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l18_adaLN | BOOLEAN | true | — |
| l18_adaLN_str | FLOAT | 1.00-5–5 | — |
| l18_attn | BOOLEAN | true | — |
| l18_attn_str | FLOAT | 1.00-5–5 | — |
| l18_attn_norm | BOOLEAN | true | — |
| l18_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l18_ffn | BOOLEAN | true | — |
| l18_ffn_str | FLOAT | 1.00-5–5 | — |
| l18_ffn_norm | BOOLEAN | true | — |
| l18_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l19_adaLN | BOOLEAN | true | — |
| l19_adaLN_str | FLOAT | 1.00-5–5 | — |
| l19_attn | BOOLEAN | true | — |
| l19_attn_str | FLOAT | 1.00-5–5 | — |
| l19_attn_norm | BOOLEAN | true | — |
| l19_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l19_ffn | BOOLEAN | true | — |
| l19_ffn_str | FLOAT | 1.00-5–5 | — |
| l19_ffn_norm | BOOLEAN | true | — |
| l19_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l20_adaLN | BOOLEAN | true | — |
| l20_adaLN_str | FLOAT | 1.00-5–5 | — |
| l20_attn | BOOLEAN | true | — |
| l20_attn_str | FLOAT | 1.00-5–5 | — |
| l20_attn_norm | BOOLEAN | true | — |
| l20_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l20_ffn | BOOLEAN | true | — |
| l20_ffn_str | FLOAT | 1.00-5–5 | — |
| l20_ffn_norm | BOOLEAN | true | — |
| l20_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l21_adaLN | BOOLEAN | true | — |
| l21_adaLN_str | FLOAT | 1.00-5–5 | — |
| l21_attn | BOOLEAN | true | — |
| l21_attn_str | FLOAT | 1.00-5–5 | — |
| l21_attn_norm | BOOLEAN | true | — |
| l21_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l21_ffn | BOOLEAN | true | — |
| l21_ffn_str | FLOAT | 1.00-5–5 | — |
| l21_ffn_norm | BOOLEAN | true | — |
| l21_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l22_adaLN | BOOLEAN | true | — |
| l22_adaLN_str | FLOAT | 1.00-5–5 | — |
| l22_attn | BOOLEAN | true | — |
| l22_attn_str | FLOAT | 1.00-5–5 | — |
| l22_attn_norm | BOOLEAN | true | — |
| l22_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l22_ffn | BOOLEAN | true | — |
| l22_ffn_str | FLOAT | 1.00-5–5 | — |
| l22_ffn_norm | BOOLEAN | true | — |
| l22_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l23_adaLN | BOOLEAN | true | — |
| l23_adaLN_str | FLOAT | 1.00-5–5 | — |
| l23_attn | BOOLEAN | true | — |
| l23_attn_str | FLOAT | 1.00-5–5 | — |
| l23_attn_norm | BOOLEAN | true | — |
| l23_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l23_ffn | BOOLEAN | true | — |
| l23_ffn_str | FLOAT | 1.00-5–5 | — |
| l23_ffn_norm | BOOLEAN | true | — |
| l23_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l24_adaLN | BOOLEAN | true | — |
| l24_adaLN_str | FLOAT | 1.00-5–5 | — |
| l24_attn | BOOLEAN | true | — |
| l24_attn_str | FLOAT | 1.00-5–5 | — |
| l24_attn_norm | BOOLEAN | true | — |
| l24_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l24_ffn | BOOLEAN | true | — |
| l24_ffn_str | FLOAT | 1.00-5–5 | — |
| l24_ffn_norm | BOOLEAN | true | — |
| l24_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l25_adaLN | BOOLEAN | true | — |
| l25_adaLN_str | FLOAT | 1.00-5–5 | — |
| l25_attn | BOOLEAN | true | — |
| l25_attn_str | FLOAT | 1.00-5–5 | — |
| l25_attn_norm | BOOLEAN | true | — |
| l25_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l25_ffn | BOOLEAN | true | — |
| l25_ffn_str | FLOAT | 1.00-5–5 | — |
| l25_ffn_norm | BOOLEAN | true | — |
| l25_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l26_adaLN | BOOLEAN | true | — |
| l26_adaLN_str | FLOAT | 1.00-5–5 | — |
| l26_attn | BOOLEAN | true | — |
| l26_attn_str | FLOAT | 1.00-5–5 | — |
| l26_attn_norm | BOOLEAN | true | — |
| l26_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l26_ffn | BOOLEAN | true | — |
| l26_ffn_str | FLOAT | 1.00-5–5 | — |
| l26_ffn_norm | BOOLEAN | true | — |
| l26_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l27_adaLN | BOOLEAN | true | — |
| l27_adaLN_str | FLOAT | 1.00-5–5 | — |
| l27_attn | BOOLEAN | true | — |
| l27_attn_str | FLOAT | 1.00-5–5 | — |
| l27_attn_norm | BOOLEAN | true | — |
| l27_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l27_ffn | BOOLEAN | true | — |
| l27_ffn_str | FLOAT | 1.00-5–5 | — |
| l27_ffn_norm | BOOLEAN | true | — |
| l27_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l28_adaLN | BOOLEAN | true | — |
| l28_adaLN_str | FLOAT | 1.00-5–5 | — |
| l28_attn | BOOLEAN | true | — |
| l28_attn_str | FLOAT | 1.00-5–5 | — |
| l28_attn_norm | BOOLEAN | true | — |
| l28_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l28_ffn | BOOLEAN | true | — |
| l28_ffn_str | FLOAT | 1.00-5–5 | — |
| l28_ffn_norm | BOOLEAN | true | — |
| l28_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| l29_adaLN | BOOLEAN | true | — |
| l29_adaLN_str | FLOAT | 1.00-5–5 | — |
| l29_attn | BOOLEAN | true | — |
| l29_attn_str | FLOAT | 1.00-5–5 | — |
| l29_attn_norm | BOOLEAN | true | — |
| l29_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l29_ffn | BOOLEAN | true | — |
| l29_ffn_str | FLOAT | 1.00-5–5 | — |
| l29_ffn_norm | BOOLEAN | true | — |
| l29_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| nr0_adaLN | BOOLEAN | true | — |
| nr0_adaLN_str | FLOAT | 1.00-5–5 | — |
| nr0_attn | BOOLEAN | true | — |
| nr0_attn_str | FLOAT | 1.00-5–5 | — |
| nr0_attn_norm | BOOLEAN | true | — |
| nr0_attn_norm_str | FLOAT | 1.00-5–5 | — |
| nr0_ffn | BOOLEAN | true | — |
| nr0_ffn_str | FLOAT | 1.00-5–5 | — |
| nr0_ffn_norm | BOOLEAN | true | — |
| nr0_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| nr1_adaLN | BOOLEAN | true | — |
| nr1_adaLN_str | FLOAT | 1.00-5–5 | — |
| nr1_attn | BOOLEAN | true | — |
| nr1_attn_str | FLOAT | 1.00-5–5 | — |
| nr1_attn_norm | BOOLEAN | true | — |
| nr1_attn_norm_str | FLOAT | 1.00-5–5 | — |
| nr1_ffn | BOOLEAN | true | — |
| nr1_ffn_str | FLOAT | 1.00-5–5 | — |
| nr1_ffn_norm | BOOLEAN | true | — |
| nr1_ffn_norm_str | FLOAT | 1.00-5–5 | — |
| final_layer | BOOLEAN | true | — |
| final_layer_str | FLOAT | 1.00-5–5 | — |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| model | MODEL | Model with per-sub-component modifications (LoRA-safe) |
| info | STRING | Text summary of modifications |