Text Encoder Deep Debiaser (Qwen3-4B)
Tune what the LLM text encoder pays attention to
- clip
- clip
- info
Z-Image and Flux 2 Klein 4B both hand your prompt to a Qwen3-4B language model instead of CLIP, and that model isn't a flat bag of tokens - it's 36 transformer layers, each doing something a little different to your prompt before it ever reaches the diffusion model. This node lets you turn individual pieces of those layers up or down, rather than accepting the encoder's behavior as fixed.
What it is and why you'd reach for it
Where the pack's LoRA loaders work on blocks of the diffusion model, this works on the text encoder - the component that turns your written prompt into the conditioning vectors everything downstream reacts to. Because Qwen3-4B is a proper language model, your prompt isn't read as a bag of CLIP-style tags; it's wrapped in a chat template and processed layer by layer like an instruction. That means a layer that's over-weighting one token, or under-attending to spatial relationships you wrote, is a real, addressable thing rather than folklore - and this node is the tool for addressing it directly instead of fighting it with prompt phrasing tricks.
It's one of five Deep Debiaser nodes in ShootTheSound/comfyUI-Realtime-Lora's newer sub-component suite, alongside a matching Qwen3-8B version (for Klein 9B) and DiT/VAE debiasers for the diffusion side.
How it works
Qwen3-4B's 36 layers each split into five addressable parts: input_norm, attn (self-attention), attn_norm, mlp (the feed-forward block), and post_norm - 180 controls total, plus a single embed_tokens control and a final_norm, for 182 sub-components. Each gets its own strength multiplier, 1.0 unchanged, working below and above that to weaken or boost that specific piece.
The one quantization caveat worth knowing before you start: this only modifies float tensors - norms and some weights. Quantized layers, if your text encoder is loaded in a quantized format (U8, F8_E4M3), are preserved unchanged rather than patched, because you can't cleanly scale a quantized weight the same way. If a strength change on a quantized-heavy layer does nothing, that's why.
Inputs and outputs that matter
- clip - the Qwen3-4B text encoder to edit (used by Z-Image and Klein 4B).
- preset - 13 built-in options (Weaken ALL attn 90/85/80%, Weaken ALL mlp, Weaken ALL attn+mlp, Weaken ALL norms, Global 95%/90%, and more) rather than hand-setting 182 sliders from a blank state.
- embed_tokens, l0_input_norm through l35_post_norm (the full 36-layer × 5-part grid), and final_norm - each with a toggle and a -5 to 5 strength slider.
- save_model / save_mode / filename (optional) - export the modified encoder.
save_modeoffersfull_model,diff_only, orboth. - Outputs: clip (patched, feed to your text-encode node), info (a text report of what changed).
Installing it
ComfyUI Manager: search "Realtime LoRA Trainer." Manual:
cd ComfyUI/custom_nodes
git clone https://github.com/ShootTheSound/comfyUI-Realtime-Lora
Restart ComfyUI. No further install needed - the Deep Debiaser suite runs out of the box, same as the rest of the pack's non-training nodes. You need a Qwen3-4B text encoder already loaded, which Z-Image and Klein 4B workflows already require regardless of this node.
Troubleshooting
Set a sub-component to 0.0 and prompt following broke entirely. Same warning as the pack's other debiasers: 0.0 tends to produce noise or a broken result rather than a clean absence, and the sane working range is 0.5-1.5. Zero is a stress test, not a normal setting.
Boosted embed_tokens to fix weak prompt adherence and nothing changed. Check whether your text encoder is loaded quantized - embed_tokens is float and should be modifiable regardless, but if the layer you actually needed to touch is one of the quantized attention or MLP weights, the change silently doesn't apply. The node's own tip is that boosting embed_tokens to 1.5-2.0 helps prompt adherence, which is worth trying first since it's the one control least likely to be quantization-locked.
Trying to fix an anatomy or color problem and nothing here helps. This node only touches the text encoder - it changes how your prompt gets interpreted, not how the diffusion model renders or how the VAE decodes. Anatomy issues on Klein live in the DiT; color-shift issues live in the VAE. Both have their own dedicated debiaser nodes in this pack.
Inputs (369)
| Name | Type | Default | Description |
|---|---|---|---|
| clip | CLIP | CLIP/Text Encoder model (Qwen3-4B) | |
| preset | COMBO | Default | 13 options: Custom, Default, Weaken ALL attn 90%, Weaken ALL attn 85%, Weaken ALL attn 80%, Weaken ALL mlp 90%, +7 |
| save_model | BOOLEAN | false | Save the modified model to disk when enabled |
| save_mode | COMBO | full_model | full_model = complete safetensors. diff_only = only changed weights (small). both = save both files. |
| filename | STRING | auto | Filename (no extension). 'auto' = generate from settings. |
| embed_tokens | BOOLEAN | true | — |
| embed_tokens_str | FLOAT | 1.00-5–5 | — |
| l0_input_norm | BOOLEAN | true | — |
| l0_input_norm_str | FLOAT | 1.00-5–5 | — |
| l0_attn | BOOLEAN | true | — |
| l0_attn_str | FLOAT | 1.00-5–5 | — |
| l0_attn_norm | BOOLEAN | true | — |
| l0_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l0_mlp | BOOLEAN | true | — |
| l0_mlp_str | FLOAT | 1.00-5–5 | — |
| l0_post_norm | BOOLEAN | true | — |
| l0_post_norm_str | FLOAT | 1.00-5–5 | — |
| l1_input_norm | BOOLEAN | true | — |
| l1_input_norm_str | FLOAT | 1.00-5–5 | — |
| l1_attn | BOOLEAN | true | — |
| l1_attn_str | FLOAT | 1.00-5–5 | — |
| l1_attn_norm | BOOLEAN | true | — |
| l1_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l1_mlp | BOOLEAN | true | — |
| l1_mlp_str | FLOAT | 1.00-5–5 | — |
| l1_post_norm | BOOLEAN | true | — |
| l1_post_norm_str | FLOAT | 1.00-5–5 | — |
| l2_input_norm | BOOLEAN | true | — |
| l2_input_norm_str | FLOAT | 1.00-5–5 | — |
| l2_attn | BOOLEAN | true | — |
| l2_attn_str | FLOAT | 1.00-5–5 | — |
| l2_attn_norm | BOOLEAN | true | — |
| l2_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l2_mlp | BOOLEAN | true | — |
| l2_mlp_str | FLOAT | 1.00-5–5 | — |
| l2_post_norm | BOOLEAN | true | — |
| l2_post_norm_str | FLOAT | 1.00-5–5 | — |
| l3_input_norm | BOOLEAN | true | — |
| l3_input_norm_str | FLOAT | 1.00-5–5 | — |
| l3_attn | BOOLEAN | true | — |
| l3_attn_str | FLOAT | 1.00-5–5 | — |
| l3_attn_norm | BOOLEAN | true | — |
| l3_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l3_mlp | BOOLEAN | true | — |
| l3_mlp_str | FLOAT | 1.00-5–5 | — |
| l3_post_norm | BOOLEAN | true | — |
| l3_post_norm_str | FLOAT | 1.00-5–5 | — |
| l4_input_norm | BOOLEAN | true | — |
| l4_input_norm_str | FLOAT | 1.00-5–5 | — |
| l4_attn | BOOLEAN | true | — |
| l4_attn_str | FLOAT | 1.00-5–5 | — |
| l4_attn_norm | BOOLEAN | true | — |
| l4_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l4_mlp | BOOLEAN | true | — |
| l4_mlp_str | FLOAT | 1.00-5–5 | — |
| l4_post_norm | BOOLEAN | true | — |
| l4_post_norm_str | FLOAT | 1.00-5–5 | — |
| l5_input_norm | BOOLEAN | true | — |
| l5_input_norm_str | FLOAT | 1.00-5–5 | — |
| l5_attn | BOOLEAN | true | — |
| l5_attn_str | FLOAT | 1.00-5–5 | — |
| l5_attn_norm | BOOLEAN | true | — |
| l5_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l5_mlp | BOOLEAN | true | — |
| l5_mlp_str | FLOAT | 1.00-5–5 | — |
| l5_post_norm | BOOLEAN | true | — |
| l5_post_norm_str | FLOAT | 1.00-5–5 | — |
| l6_input_norm | BOOLEAN | true | — |
| l6_input_norm_str | FLOAT | 1.00-5–5 | — |
| l6_attn | BOOLEAN | true | — |
| l6_attn_str | FLOAT | 1.00-5–5 | — |
| l6_attn_norm | BOOLEAN | true | — |
| l6_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l6_mlp | BOOLEAN | true | — |
| l6_mlp_str | FLOAT | 1.00-5–5 | — |
| l6_post_norm | BOOLEAN | true | — |
| l6_post_norm_str | FLOAT | 1.00-5–5 | — |
| l7_input_norm | BOOLEAN | true | — |
| l7_input_norm_str | FLOAT | 1.00-5–5 | — |
| l7_attn | BOOLEAN | true | — |
| l7_attn_str | FLOAT | 1.00-5–5 | — |
| l7_attn_norm | BOOLEAN | true | — |
| l7_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l7_mlp | BOOLEAN | true | — |
| l7_mlp_str | FLOAT | 1.00-5–5 | — |
| l7_post_norm | BOOLEAN | true | — |
| l7_post_norm_str | FLOAT | 1.00-5–5 | — |
| l8_input_norm | BOOLEAN | true | — |
| l8_input_norm_str | FLOAT | 1.00-5–5 | — |
| l8_attn | BOOLEAN | true | — |
| l8_attn_str | FLOAT | 1.00-5–5 | — |
| l8_attn_norm | BOOLEAN | true | — |
| l8_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l8_mlp | BOOLEAN | true | — |
| l8_mlp_str | FLOAT | 1.00-5–5 | — |
| l8_post_norm | BOOLEAN | true | — |
| l8_post_norm_str | FLOAT | 1.00-5–5 | — |
| l9_input_norm | BOOLEAN | true | — |
| l9_input_norm_str | FLOAT | 1.00-5–5 | — |
| l9_attn | BOOLEAN | true | — |
| l9_attn_str | FLOAT | 1.00-5–5 | — |
| l9_attn_norm | BOOLEAN | true | — |
| l9_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l9_mlp | BOOLEAN | true | — |
| l9_mlp_str | FLOAT | 1.00-5–5 | — |
| l9_post_norm | BOOLEAN | true | — |
| l9_post_norm_str | FLOAT | 1.00-5–5 | — |
| l10_input_norm | BOOLEAN | true | — |
| l10_input_norm_str | FLOAT | 1.00-5–5 | — |
| l10_attn | BOOLEAN | true | — |
| l10_attn_str | FLOAT | 1.00-5–5 | — |
| l10_attn_norm | BOOLEAN | true | — |
| l10_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l10_mlp | BOOLEAN | true | — |
| l10_mlp_str | FLOAT | 1.00-5–5 | — |
| l10_post_norm | BOOLEAN | true | — |
| l10_post_norm_str | FLOAT | 1.00-5–5 | — |
| l11_input_norm | BOOLEAN | true | — |
| l11_input_norm_str | FLOAT | 1.00-5–5 | — |
| l11_attn | BOOLEAN | true | — |
| l11_attn_str | FLOAT | 1.00-5–5 | — |
| l11_attn_norm | BOOLEAN | true | — |
| l11_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l11_mlp | BOOLEAN | true | — |
| l11_mlp_str | FLOAT | 1.00-5–5 | — |
| l11_post_norm | BOOLEAN | true | — |
| l11_post_norm_str | FLOAT | 1.00-5–5 | — |
| l12_input_norm | BOOLEAN | true | — |
| l12_input_norm_str | FLOAT | 1.00-5–5 | — |
| l12_attn | BOOLEAN | true | — |
| l12_attn_str | FLOAT | 1.00-5–5 | — |
| l12_attn_norm | BOOLEAN | true | — |
| l12_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l12_mlp | BOOLEAN | true | — |
| l12_mlp_str | FLOAT | 1.00-5–5 | — |
| l12_post_norm | BOOLEAN | true | — |
| l12_post_norm_str | FLOAT | 1.00-5–5 | — |
| l13_input_norm | BOOLEAN | true | — |
| l13_input_norm_str | FLOAT | 1.00-5–5 | — |
| l13_attn | BOOLEAN | true | — |
| l13_attn_str | FLOAT | 1.00-5–5 | — |
| l13_attn_norm | BOOLEAN | true | — |
| l13_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l13_mlp | BOOLEAN | true | — |
| l13_mlp_str | FLOAT | 1.00-5–5 | — |
| l13_post_norm | BOOLEAN | true | — |
| l13_post_norm_str | FLOAT | 1.00-5–5 | — |
| l14_input_norm | BOOLEAN | true | — |
| l14_input_norm_str | FLOAT | 1.00-5–5 | — |
| l14_attn | BOOLEAN | true | — |
| l14_attn_str | FLOAT | 1.00-5–5 | — |
| l14_attn_norm | BOOLEAN | true | — |
| l14_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l14_mlp | BOOLEAN | true | — |
| l14_mlp_str | FLOAT | 1.00-5–5 | — |
| l14_post_norm | BOOLEAN | true | — |
| l14_post_norm_str | FLOAT | 1.00-5–5 | — |
| l15_input_norm | BOOLEAN | true | — |
| l15_input_norm_str | FLOAT | 1.00-5–5 | — |
| l15_attn | BOOLEAN | true | — |
| l15_attn_str | FLOAT | 1.00-5–5 | — |
| l15_attn_norm | BOOLEAN | true | — |
| l15_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l15_mlp | BOOLEAN | true | — |
| l15_mlp_str | FLOAT | 1.00-5–5 | — |
| l15_post_norm | BOOLEAN | true | — |
| l15_post_norm_str | FLOAT | 1.00-5–5 | — |
| l16_input_norm | BOOLEAN | true | — |
| l16_input_norm_str | FLOAT | 1.00-5–5 | — |
| l16_attn | BOOLEAN | true | — |
| l16_attn_str | FLOAT | 1.00-5–5 | — |
| l16_attn_norm | BOOLEAN | true | — |
| l16_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l16_mlp | BOOLEAN | true | — |
| l16_mlp_str | FLOAT | 1.00-5–5 | — |
| l16_post_norm | BOOLEAN | true | — |
| l16_post_norm_str | FLOAT | 1.00-5–5 | — |
| l17_input_norm | BOOLEAN | true | — |
| l17_input_norm_str | FLOAT | 1.00-5–5 | — |
| l17_attn | BOOLEAN | true | — |
| l17_attn_str | FLOAT | 1.00-5–5 | — |
| l17_attn_norm | BOOLEAN | true | — |
| l17_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l17_mlp | BOOLEAN | true | — |
| l17_mlp_str | FLOAT | 1.00-5–5 | — |
| l17_post_norm | BOOLEAN | true | — |
| l17_post_norm_str | FLOAT | 1.00-5–5 | — |
| l18_input_norm | BOOLEAN | true | — |
| l18_input_norm_str | FLOAT | 1.00-5–5 | — |
| l18_attn | BOOLEAN | true | — |
| l18_attn_str | FLOAT | 1.00-5–5 | — |
| l18_attn_norm | BOOLEAN | true | — |
| l18_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l18_mlp | BOOLEAN | true | — |
| l18_mlp_str | FLOAT | 1.00-5–5 | — |
| l18_post_norm | BOOLEAN | true | — |
| l18_post_norm_str | FLOAT | 1.00-5–5 | — |
| l19_input_norm | BOOLEAN | true | — |
| l19_input_norm_str | FLOAT | 1.00-5–5 | — |
| l19_attn | BOOLEAN | true | — |
| l19_attn_str | FLOAT | 1.00-5–5 | — |
| l19_attn_norm | BOOLEAN | true | — |
| l19_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l19_mlp | BOOLEAN | true | — |
| l19_mlp_str | FLOAT | 1.00-5–5 | — |
| l19_post_norm | BOOLEAN | true | — |
| l19_post_norm_str | FLOAT | 1.00-5–5 | — |
| l20_input_norm | BOOLEAN | true | — |
| l20_input_norm_str | FLOAT | 1.00-5–5 | — |
| l20_attn | BOOLEAN | true | — |
| l20_attn_str | FLOAT | 1.00-5–5 | — |
| l20_attn_norm | BOOLEAN | true | — |
| l20_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l20_mlp | BOOLEAN | true | — |
| l20_mlp_str | FLOAT | 1.00-5–5 | — |
| l20_post_norm | BOOLEAN | true | — |
| l20_post_norm_str | FLOAT | 1.00-5–5 | — |
| l21_input_norm | BOOLEAN | true | — |
| l21_input_norm_str | FLOAT | 1.00-5–5 | — |
| l21_attn | BOOLEAN | true | — |
| l21_attn_str | FLOAT | 1.00-5–5 | — |
| l21_attn_norm | BOOLEAN | true | — |
| l21_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l21_mlp | BOOLEAN | true | — |
| l21_mlp_str | FLOAT | 1.00-5–5 | — |
| l21_post_norm | BOOLEAN | true | — |
| l21_post_norm_str | FLOAT | 1.00-5–5 | — |
| l22_input_norm | BOOLEAN | true | — |
| l22_input_norm_str | FLOAT | 1.00-5–5 | — |
| l22_attn | BOOLEAN | true | — |
| l22_attn_str | FLOAT | 1.00-5–5 | — |
| l22_attn_norm | BOOLEAN | true | — |
| l22_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l22_mlp | BOOLEAN | true | — |
| l22_mlp_str | FLOAT | 1.00-5–5 | — |
| l22_post_norm | BOOLEAN | true | — |
| l22_post_norm_str | FLOAT | 1.00-5–5 | — |
| l23_input_norm | BOOLEAN | true | — |
| l23_input_norm_str | FLOAT | 1.00-5–5 | — |
| l23_attn | BOOLEAN | true | — |
| l23_attn_str | FLOAT | 1.00-5–5 | — |
| l23_attn_norm | BOOLEAN | true | — |
| l23_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l23_mlp | BOOLEAN | true | — |
| l23_mlp_str | FLOAT | 1.00-5–5 | — |
| l23_post_norm | BOOLEAN | true | — |
| l23_post_norm_str | FLOAT | 1.00-5–5 | — |
| l24_input_norm | BOOLEAN | true | — |
| l24_input_norm_str | FLOAT | 1.00-5–5 | — |
| l24_attn | BOOLEAN | true | — |
| l24_attn_str | FLOAT | 1.00-5–5 | — |
| l24_attn_norm | BOOLEAN | true | — |
| l24_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l24_mlp | BOOLEAN | true | — |
| l24_mlp_str | FLOAT | 1.00-5–5 | — |
| l24_post_norm | BOOLEAN | true | — |
| l24_post_norm_str | FLOAT | 1.00-5–5 | — |
| l25_input_norm | BOOLEAN | true | — |
| l25_input_norm_str | FLOAT | 1.00-5–5 | — |
| l25_attn | BOOLEAN | true | — |
| l25_attn_str | FLOAT | 1.00-5–5 | — |
| l25_attn_norm | BOOLEAN | true | — |
| l25_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l25_mlp | BOOLEAN | true | — |
| l25_mlp_str | FLOAT | 1.00-5–5 | — |
| l25_post_norm | BOOLEAN | true | — |
| l25_post_norm_str | FLOAT | 1.00-5–5 | — |
| l26_input_norm | BOOLEAN | true | — |
| l26_input_norm_str | FLOAT | 1.00-5–5 | — |
| l26_attn | BOOLEAN | true | — |
| l26_attn_str | FLOAT | 1.00-5–5 | — |
| l26_attn_norm | BOOLEAN | true | — |
| l26_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l26_mlp | BOOLEAN | true | — |
| l26_mlp_str | FLOAT | 1.00-5–5 | — |
| l26_post_norm | BOOLEAN | true | — |
| l26_post_norm_str | FLOAT | 1.00-5–5 | — |
| l27_input_norm | BOOLEAN | true | — |
| l27_input_norm_str | FLOAT | 1.00-5–5 | — |
| l27_attn | BOOLEAN | true | — |
| l27_attn_str | FLOAT | 1.00-5–5 | — |
| l27_attn_norm | BOOLEAN | true | — |
| l27_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l27_mlp | BOOLEAN | true | — |
| l27_mlp_str | FLOAT | 1.00-5–5 | — |
| l27_post_norm | BOOLEAN | true | — |
| l27_post_norm_str | FLOAT | 1.00-5–5 | — |
| l28_input_norm | BOOLEAN | true | — |
| l28_input_norm_str | FLOAT | 1.00-5–5 | — |
| l28_attn | BOOLEAN | true | — |
| l28_attn_str | FLOAT | 1.00-5–5 | — |
| l28_attn_norm | BOOLEAN | true | — |
| l28_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l28_mlp | BOOLEAN | true | — |
| l28_mlp_str | FLOAT | 1.00-5–5 | — |
| l28_post_norm | BOOLEAN | true | — |
| l28_post_norm_str | FLOAT | 1.00-5–5 | — |
| l29_input_norm | BOOLEAN | true | — |
| l29_input_norm_str | FLOAT | 1.00-5–5 | — |
| l29_attn | BOOLEAN | true | — |
| l29_attn_str | FLOAT | 1.00-5–5 | — |
| l29_attn_norm | BOOLEAN | true | — |
| l29_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l29_mlp | BOOLEAN | true | — |
| l29_mlp_str | FLOAT | 1.00-5–5 | — |
| l29_post_norm | BOOLEAN | true | — |
| l29_post_norm_str | FLOAT | 1.00-5–5 | — |
| l30_input_norm | BOOLEAN | true | — |
| l30_input_norm_str | FLOAT | 1.00-5–5 | — |
| l30_attn | BOOLEAN | true | — |
| l30_attn_str | FLOAT | 1.00-5–5 | — |
| l30_attn_norm | BOOLEAN | true | — |
| l30_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l30_mlp | BOOLEAN | true | — |
| l30_mlp_str | FLOAT | 1.00-5–5 | — |
| l30_post_norm | BOOLEAN | true | — |
| l30_post_norm_str | FLOAT | 1.00-5–5 | — |
| l31_input_norm | BOOLEAN | true | — |
| l31_input_norm_str | FLOAT | 1.00-5–5 | — |
| l31_attn | BOOLEAN | true | — |
| l31_attn_str | FLOAT | 1.00-5–5 | — |
| l31_attn_norm | BOOLEAN | true | — |
| l31_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l31_mlp | BOOLEAN | true | — |
| l31_mlp_str | FLOAT | 1.00-5–5 | — |
| l31_post_norm | BOOLEAN | true | — |
| l31_post_norm_str | FLOAT | 1.00-5–5 | — |
| l32_input_norm | BOOLEAN | true | — |
| l32_input_norm_str | FLOAT | 1.00-5–5 | — |
| l32_attn | BOOLEAN | true | — |
| l32_attn_str | FLOAT | 1.00-5–5 | — |
| l32_attn_norm | BOOLEAN | true | — |
| l32_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l32_mlp | BOOLEAN | true | — |
| l32_mlp_str | FLOAT | 1.00-5–5 | — |
| l32_post_norm | BOOLEAN | true | — |
| l32_post_norm_str | FLOAT | 1.00-5–5 | — |
| l33_input_norm | BOOLEAN | true | — |
| l33_input_norm_str | FLOAT | 1.00-5–5 | — |
| l33_attn | BOOLEAN | true | — |
| l33_attn_str | FLOAT | 1.00-5–5 | — |
| l33_attn_norm | BOOLEAN | true | — |
| l33_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l33_mlp | BOOLEAN | true | — |
| l33_mlp_str | FLOAT | 1.00-5–5 | — |
| l33_post_norm | BOOLEAN | true | — |
| l33_post_norm_str | FLOAT | 1.00-5–5 | — |
| l34_input_norm | BOOLEAN | true | — |
| l34_input_norm_str | FLOAT | 1.00-5–5 | — |
| l34_attn | BOOLEAN | true | — |
| l34_attn_str | FLOAT | 1.00-5–5 | — |
| l34_attn_norm | BOOLEAN | true | — |
| l34_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l34_mlp | BOOLEAN | true | — |
| l34_mlp_str | FLOAT | 1.00-5–5 | — |
| l34_post_norm | BOOLEAN | true | — |
| l34_post_norm_str | FLOAT | 1.00-5–5 | — |
| l35_input_norm | BOOLEAN | true | — |
| l35_input_norm_str | FLOAT | 1.00-5–5 | — |
| l35_attn | BOOLEAN | true | — |
| l35_attn_str | FLOAT | 1.00-5–5 | — |
| l35_attn_norm | BOOLEAN | true | — |
| l35_attn_norm_str | FLOAT | 1.00-5–5 | — |
| l35_mlp | BOOLEAN | true | — |
| l35_mlp_str | FLOAT | 1.00-5–5 | — |
| l35_post_norm | BOOLEAN | true | — |
| l35_post_norm_str | FLOAT | 1.00-5–5 | — |
| final_norm | BOOLEAN | true | — |
| final_norm_str | FLOAT | 1.00-5–5 | — |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| clip | CLIP | CLIP with per-sub-component modifications (LoRA-safe) |
| info | STRING | Text summary of modifications |