Model Scale ERNIE Image
Zero out or amplify specific ERNIE-Image layers, down to the attention heads
- model
- MODEL
ERNIE-Image is Baidu's 8B Apache-2.0 model - the one that genuinely impressed people with structured layout and text-in-image before the community's attention moved on. If you're one of the people still using it, Model Scale ERNIE Image is the fine-grained scaler for it: one slider per layer and per attention component, covering all 36 transformer blocks of ernie-image.safetensors. This is the most granular scaler in the pack, and it exists because ERNIE-Image's strength - following structured prompts - isn't spread evenly across its weights.
The mechanism is the same as every scale node here: clone the model, match each weight to the longest matching widget prefix, and scale by weight × scale via add_patches. 1.0 leaves a layer untouched, 0.0 zeroes it out, values above 1.0 amplify. All sliders default to 1.0, so the node is inert until you move something. Input is a model, output is a single scaled MODEL for your sampler.
The inputs, grouped
The schema is huge - hundreds of floats - because every layer is expanded into its sub-components. But they organize cleanly:
layers.N- the per-block master slider. Start here; the sub-sliders are for when you need finer control.layers.N.self_attention.to_q/.to_k/.to_v/.to_out- the individual attention projection matrices inside each block. This is the rare level of control: you can weaken the query projections across all blocks without touching the MLPs, which is a very different surgical move than scaling whole blocks.layers.N.mlp.gate_proj/.up_proj/.linear_fc2- the feed-forward path, the part most responsible for factual/layout recall in these architectures.layers.N.adaLN_mlp_ln/.adaLN_sa_ln- the adaptive normalization layers that modulate each block.- Top-level:
x_embedder,text_proj,time_embedding,adaLN_modulation,final_norm,final_linear.
What to actually try
If you're chasing ERNIE-Image's text-rendering quality, the community's finding is that its competence is real but front-loaded - the mid-to-late blocks and the MLP path carry a lot of it. A reasonable first experiment: amplify mlp sub-components in the middle third (layers ~12–24) slightly above 1.0 and see if layout fidelity sharpens, then dial back to taste. Zeroing whole late blocks usually just degrades output. And if the grid-pattern artifact that people noted with ERNIE-Image is bothering you, experimenting with the attention projections in the early layers is a more targeted lever than a global scale.
Install
Search Easygoing in the ComfyUI Manager, or:
cd ComfyUI/custom_nodes
git clone https://github.com/easygoing0114/ComfyUI-easygoing-nodes.git
Restart ComfyUI. No pip extras; needs a current ComfyUI with the V3 node API for the pack to register.
Honest warning
This is a scaler for people already invested in ERNIE-Image, and the sub-component granularity is genuinely useful there - but the node only makes sense if the widget prefixes match your model's actual keys. Run it once with the pack's Key Name Inspector wired in parallel if you're not sure; a mismatch shows up as sliders that do nothing, and that's a wasted afternoon otherwise. Scaling is also in-graph only - save the workflow, or route through the pack's save-with-original nodes if you want a file.
Inputs (511)
| Name | Type | Default | Description |
|---|---|---|---|
| model | MODEL | — | |
| x_embedder. | FLOAT | 1.000–2 | — |
| text_proj. | FLOAT | 1.000–2 | — |
| time_embedding. | FLOAT | 1.000–2 | — |
| layers.0. | FLOAT | 1.000–2 | — |
| layers.0.self_attention. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.0.mlp. | FLOAT | 1.000–2 | — |
| layers.0.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.0.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.0.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.0.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.0.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.1. | FLOAT | 1.000–2 | — |
| layers.1.self_attention. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.1.mlp. | FLOAT | 1.000–2 | — |
| layers.1.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.1.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.1.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.1.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.1.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.2. | FLOAT | 1.000–2 | — |
| layers.2.self_attention. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.2.mlp. | FLOAT | 1.000–2 | — |
| layers.2.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.2.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.2.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.2.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.2.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.3. | FLOAT | 1.000–2 | — |
| layers.3.self_attention. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.3.mlp. | FLOAT | 1.000–2 | — |
| layers.3.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.3.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.3.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.3.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.3.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.4. | FLOAT | 1.000–2 | — |
| layers.4.self_attention. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.4.mlp. | FLOAT | 1.000–2 | — |
| layers.4.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.4.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.4.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.4.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.4.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.5. | FLOAT | 1.000–2 | — |
| layers.5.self_attention. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.5.mlp. | FLOAT | 1.000–2 | — |
| layers.5.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.5.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.5.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.5.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.5.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.6. | FLOAT | 1.000–2 | — |
| layers.6.self_attention. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.6.mlp. | FLOAT | 1.000–2 | — |
| layers.6.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.6.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.6.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.6.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.6.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.7. | FLOAT | 1.000–2 | — |
| layers.7.self_attention. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.7.mlp. | FLOAT | 1.000–2 | — |
| layers.7.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.7.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.7.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.7.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.7.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.8. | FLOAT | 1.000–2 | — |
| layers.8.self_attention. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.8.mlp. | FLOAT | 1.000–2 | — |
| layers.8.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.8.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.8.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.8.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.8.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.9. | FLOAT | 1.000–2 | — |
| layers.9.self_attention. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.9.mlp. | FLOAT | 1.000–2 | — |
| layers.9.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.9.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.9.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.9.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.9.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.10. | FLOAT | 1.000–2 | — |
| layers.10.self_attention. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.10.mlp. | FLOAT | 1.000–2 | — |
| layers.10.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.10.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.10.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.10.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.10.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.11. | FLOAT | 1.000–2 | — |
| layers.11.self_attention. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.11.mlp. | FLOAT | 1.000–2 | — |
| layers.11.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.11.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.11.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.11.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.11.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.12. | FLOAT | 1.000–2 | — |
| layers.12.self_attention. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.12.mlp. | FLOAT | 1.000–2 | — |
| layers.12.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.12.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.12.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.12.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.12.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.13. | FLOAT | 1.000–2 | — |
| layers.13.self_attention. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.13.mlp. | FLOAT | 1.000–2 | — |
| layers.13.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.13.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.13.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.13.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.13.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.14. | FLOAT | 1.000–2 | — |
| layers.14.self_attention. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.14.mlp. | FLOAT | 1.000–2 | — |
| layers.14.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.14.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.14.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.14.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.14.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.15. | FLOAT | 1.000–2 | — |
| layers.15.self_attention. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.15.mlp. | FLOAT | 1.000–2 | — |
| layers.15.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.15.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.15.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.15.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.15.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.16. | FLOAT | 1.000–2 | — |
| layers.16.self_attention. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.16.mlp. | FLOAT | 1.000–2 | — |
| layers.16.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.16.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.16.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.16.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.16.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.17. | FLOAT | 1.000–2 | — |
| layers.17.self_attention. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.17.mlp. | FLOAT | 1.000–2 | — |
| layers.17.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.17.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.17.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.17.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.17.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.18. | FLOAT | 1.000–2 | — |
| layers.18.self_attention. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.18.mlp. | FLOAT | 1.000–2 | — |
| layers.18.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.18.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.18.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.18.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.18.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.19. | FLOAT | 1.000–2 | — |
| layers.19.self_attention. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.19.mlp. | FLOAT | 1.000–2 | — |
| layers.19.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.19.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.19.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.19.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.19.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.20. | FLOAT | 1.000–2 | — |
| layers.20.self_attention. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.20.mlp. | FLOAT | 1.000–2 | — |
| layers.20.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.20.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.20.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.20.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.20.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.21. | FLOAT | 1.000–2 | — |
| layers.21.self_attention. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.21.mlp. | FLOAT | 1.000–2 | — |
| layers.21.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.21.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.21.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.21.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.21.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.22. | FLOAT | 1.000–2 | — |
| layers.22.self_attention. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.22.mlp. | FLOAT | 1.000–2 | — |
| layers.22.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.22.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.22.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.22.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.22.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.23. | FLOAT | 1.000–2 | — |
| layers.23.self_attention. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.23.mlp. | FLOAT | 1.000–2 | — |
| layers.23.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.23.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.23.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.23.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.23.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.24. | FLOAT | 1.000–2 | — |
| layers.24.self_attention. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.24.mlp. | FLOAT | 1.000–2 | — |
| layers.24.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.24.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.24.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.24.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.24.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.25. | FLOAT | 1.000–2 | — |
| layers.25.self_attention. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.25.mlp. | FLOAT | 1.000–2 | — |
| layers.25.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.25.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.25.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.25.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.25.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.26. | FLOAT | 1.000–2 | — |
| layers.26.self_attention. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.26.mlp. | FLOAT | 1.000–2 | — |
| layers.26.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.26.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.26.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.26.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.26.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.27. | FLOAT | 1.000–2 | — |
| layers.27.self_attention. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.27.mlp. | FLOAT | 1.000–2 | — |
| layers.27.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.27.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.27.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.27.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.27.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.28. | FLOAT | 1.000–2 | — |
| layers.28.self_attention. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.28.mlp. | FLOAT | 1.000–2 | — |
| layers.28.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.28.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.28.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.28.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.28.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.29. | FLOAT | 1.000–2 | — |
| layers.29.self_attention. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.29.mlp. | FLOAT | 1.000–2 | — |
| layers.29.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.29.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.29.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.29.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.29.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.30. | FLOAT | 1.000–2 | — |
| layers.30.self_attention. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.30.mlp. | FLOAT | 1.000–2 | — |
| layers.30.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.30.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.30.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.30.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.30.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.31. | FLOAT | 1.000–2 | — |
| layers.31.self_attention. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.31.mlp. | FLOAT | 1.000–2 | — |
| layers.31.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.31.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.31.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.31.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.31.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.32. | FLOAT | 1.000–2 | — |
| layers.32.self_attention. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.32.mlp. | FLOAT | 1.000–2 | — |
| layers.32.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.32.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.32.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.32.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.32.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.33. | FLOAT | 1.000–2 | — |
| layers.33.self_attention. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.33.mlp. | FLOAT | 1.000–2 | — |
| layers.33.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.33.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.33.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.33.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.33.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.34. | FLOAT | 1.000–2 | — |
| layers.34.self_attention. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.34.mlp. | FLOAT | 1.000–2 | — |
| layers.34.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.34.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.34.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.34.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.34.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.35. | FLOAT | 1.000–2 | — |
| layers.35.self_attention. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.35.mlp. | FLOAT | 1.000–2 | — |
| layers.35.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.35.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.35.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.35.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.35.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| adaLN_modulation. | FLOAT | 1.000–2 | — |
| final_norm. | FLOAT | 1.000–2 | — |
| final_linear. | FLOAT | 1.000–2 | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| MODEL | MODEL | — |