ComfyUI Node
Model Scale ERNIE Image
A ComfyUI node in advanced/model_merging/model_specific with 511 inputs and 1 output.
Model Scale ERNIE Image
- model
- MODEL
◄x_embedder.1.00►
◄text_proj.1.00►
◄time_embedding.1.00►
◄layers.0.1.00►
◄layers.0.self_attention.1.00►
◄layers.0.self_attention.to_q.1.00►
◄layers.0.self_attention.to_k.1.00►
◄layers.0.self_attention.to_v.1.00►
◄layers.0.self_attention.to_out.1.00►
◄layers.0.self_attention.norm_q.1.00►
◄layers.0.self_attention.norm_k.1.00►
◄layers.0.mlp.1.00►
◄layers.0.mlp.gate_proj.1.00►
◄layers.0.mlp.up_proj.1.00►
◄layers.0.mlp.linear_fc2.1.00►
◄layers.0.adaLN_mlp_ln.1.00►
◄layers.0.adaLN_sa_ln.1.00►
◄layers.1.1.00►
◄layers.1.self_attention.1.00►
◄layers.1.self_attention.to_q.1.00►
◄layers.1.self_attention.to_k.1.00►
◄layers.1.self_attention.to_v.1.00►
◄layers.1.self_attention.to_out.1.00►
◄layers.1.self_attention.norm_q.1.00►
◄layers.1.self_attention.norm_k.1.00►
◄layers.1.mlp.1.00►
◄layers.1.mlp.gate_proj.1.00►
◄layers.1.mlp.up_proj.1.00►
◄layers.1.mlp.linear_fc2.1.00►
◄layers.1.adaLN_mlp_ln.1.00►
◄layers.1.adaLN_sa_ln.1.00►
◄layers.2.1.00►
◄layers.2.self_attention.1.00►
◄layers.2.self_attention.to_q.1.00►
◄layers.2.self_attention.to_k.1.00►
◄layers.2.self_attention.to_v.1.00►
◄layers.2.self_attention.to_out.1.00►
◄layers.2.self_attention.norm_q.1.00►
◄layers.2.self_attention.norm_k.1.00►
◄layers.2.mlp.1.00►
◄layers.2.mlp.gate_proj.1.00►
◄layers.2.mlp.up_proj.1.00►
◄layers.2.mlp.linear_fc2.1.00►
◄layers.2.adaLN_mlp_ln.1.00►
◄layers.2.adaLN_sa_ln.1.00►
◄layers.3.1.00►
◄layers.3.self_attention.1.00►
◄layers.3.self_attention.to_q.1.00►
◄layers.3.self_attention.to_k.1.00►
◄layers.3.self_attention.to_v.1.00►
◄layers.3.self_attention.to_out.1.00►
◄layers.3.self_attention.norm_q.1.00►
◄layers.3.self_attention.norm_k.1.00►
◄layers.3.mlp.1.00►
◄layers.3.mlp.gate_proj.1.00►
◄layers.3.mlp.up_proj.1.00►
◄layers.3.mlp.linear_fc2.1.00►
◄layers.3.adaLN_mlp_ln.1.00►
◄layers.3.adaLN_sa_ln.1.00►
◄layers.4.1.00►
◄layers.4.self_attention.1.00►
◄layers.4.self_attention.to_q.1.00►
◄layers.4.self_attention.to_k.1.00►
◄layers.4.self_attention.to_v.1.00►
◄layers.4.self_attention.to_out.1.00►
◄layers.4.self_attention.norm_q.1.00►
◄layers.4.self_attention.norm_k.1.00►
◄layers.4.mlp.1.00►
◄layers.4.mlp.gate_proj.1.00►
◄layers.4.mlp.up_proj.1.00►
◄layers.4.mlp.linear_fc2.1.00►
◄layers.4.adaLN_mlp_ln.1.00►
◄layers.4.adaLN_sa_ln.1.00►
◄layers.5.1.00►
◄layers.5.self_attention.1.00►
◄layers.5.self_attention.to_q.1.00►
◄layers.5.self_attention.to_k.1.00►
◄layers.5.self_attention.to_v.1.00►
◄layers.5.self_attention.to_out.1.00►
◄layers.5.self_attention.norm_q.1.00►
◄layers.5.self_attention.norm_k.1.00►
◄layers.5.mlp.1.00►
◄layers.5.mlp.gate_proj.1.00►
◄layers.5.mlp.up_proj.1.00►
◄layers.5.mlp.linear_fc2.1.00►
◄layers.5.adaLN_mlp_ln.1.00►
◄layers.5.adaLN_sa_ln.1.00►
◄layers.6.1.00►
◄layers.6.self_attention.1.00►
◄layers.6.self_attention.to_q.1.00►
◄layers.6.self_attention.to_k.1.00►
◄layers.6.self_attention.to_v.1.00►
◄layers.6.self_attention.to_out.1.00►
◄layers.6.self_attention.norm_q.1.00►
◄layers.6.self_attention.norm_k.1.00►
◄layers.6.mlp.1.00►
◄layers.6.mlp.gate_proj.1.00►
◄layers.6.mlp.up_proj.1.00►
◄layers.6.mlp.linear_fc2.1.00►
◄layers.6.adaLN_mlp_ln.1.00►
◄layers.6.adaLN_sa_ln.1.00►
◄layers.7.1.00►
◄layers.7.self_attention.1.00►
◄layers.7.self_attention.to_q.1.00►
◄layers.7.self_attention.to_k.1.00►
◄layers.7.self_attention.to_v.1.00►
◄layers.7.self_attention.to_out.1.00►
◄layers.7.self_attention.norm_q.1.00►
◄layers.7.self_attention.norm_k.1.00►
◄layers.7.mlp.1.00►
◄layers.7.mlp.gate_proj.1.00►
◄layers.7.mlp.up_proj.1.00►
◄layers.7.mlp.linear_fc2.1.00►
◄layers.7.adaLN_mlp_ln.1.00►
◄layers.7.adaLN_sa_ln.1.00►
◄layers.8.1.00►
◄layers.8.self_attention.1.00►
◄layers.8.self_attention.to_q.1.00►
◄layers.8.self_attention.to_k.1.00►
◄layers.8.self_attention.to_v.1.00►
◄layers.8.self_attention.to_out.1.00►
◄layers.8.self_attention.norm_q.1.00►
◄layers.8.self_attention.norm_k.1.00►
◄layers.8.mlp.1.00►
◄layers.8.mlp.gate_proj.1.00►
◄layers.8.mlp.up_proj.1.00►
◄layers.8.mlp.linear_fc2.1.00►
◄layers.8.adaLN_mlp_ln.1.00►
◄layers.8.adaLN_sa_ln.1.00►
◄layers.9.1.00►
◄layers.9.self_attention.1.00►
◄layers.9.self_attention.to_q.1.00►
◄layers.9.self_attention.to_k.1.00►
◄layers.9.self_attention.to_v.1.00►
◄layers.9.self_attention.to_out.1.00►
◄layers.9.self_attention.norm_q.1.00►
◄layers.9.self_attention.norm_k.1.00►
◄layers.9.mlp.1.00►
◄layers.9.mlp.gate_proj.1.00►
◄layers.9.mlp.up_proj.1.00►
◄layers.9.mlp.linear_fc2.1.00►
◄layers.9.adaLN_mlp_ln.1.00►
◄layers.9.adaLN_sa_ln.1.00►
◄layers.10.1.00►
◄layers.10.self_attention.1.00►
◄layers.10.self_attention.to_q.1.00►
◄layers.10.self_attention.to_k.1.00►
◄layers.10.self_attention.to_v.1.00►
◄layers.10.self_attention.to_out.1.00►
◄layers.10.self_attention.norm_q.1.00►
◄layers.10.self_attention.norm_k.1.00►
◄layers.10.mlp.1.00►
◄layers.10.mlp.gate_proj.1.00►
◄layers.10.mlp.up_proj.1.00►
◄layers.10.mlp.linear_fc2.1.00►
◄layers.10.adaLN_mlp_ln.1.00►
◄layers.10.adaLN_sa_ln.1.00►
◄layers.11.1.00►
◄layers.11.self_attention.1.00►
◄layers.11.self_attention.to_q.1.00►
◄layers.11.self_attention.to_k.1.00►
◄layers.11.self_attention.to_v.1.00►
◄layers.11.self_attention.to_out.1.00►
◄layers.11.self_attention.norm_q.1.00►
◄layers.11.self_attention.norm_k.1.00►
◄layers.11.mlp.1.00►
◄layers.11.mlp.gate_proj.1.00►
◄layers.11.mlp.up_proj.1.00►
◄layers.11.mlp.linear_fc2.1.00►
◄layers.11.adaLN_mlp_ln.1.00►
◄layers.11.adaLN_sa_ln.1.00►
◄layers.12.1.00►
◄layers.12.self_attention.1.00►
◄layers.12.self_attention.to_q.1.00►
◄layers.12.self_attention.to_k.1.00►
◄layers.12.self_attention.to_v.1.00►
◄layers.12.self_attention.to_out.1.00►
◄layers.12.self_attention.norm_q.1.00►
◄layers.12.self_attention.norm_k.1.00►
◄layers.12.mlp.1.00►
◄layers.12.mlp.gate_proj.1.00►
◄layers.12.mlp.up_proj.1.00►
◄layers.12.mlp.linear_fc2.1.00►
◄layers.12.adaLN_mlp_ln.1.00►
◄layers.12.adaLN_sa_ln.1.00►
◄layers.13.1.00►
◄layers.13.self_attention.1.00►
◄layers.13.self_attention.to_q.1.00►
◄layers.13.self_attention.to_k.1.00►
◄layers.13.self_attention.to_v.1.00►
◄layers.13.self_attention.to_out.1.00►
◄layers.13.self_attention.norm_q.1.00►
◄layers.13.self_attention.norm_k.1.00►
◄layers.13.mlp.1.00►
◄layers.13.mlp.gate_proj.1.00►
◄layers.13.mlp.up_proj.1.00►
◄layers.13.mlp.linear_fc2.1.00►
◄layers.13.adaLN_mlp_ln.1.00►
◄layers.13.adaLN_sa_ln.1.00►
◄layers.14.1.00►
◄layers.14.self_attention.1.00►
◄layers.14.self_attention.to_q.1.00►
◄layers.14.self_attention.to_k.1.00►
◄layers.14.self_attention.to_v.1.00►
◄layers.14.self_attention.to_out.1.00►
◄layers.14.self_attention.norm_q.1.00►
◄layers.14.self_attention.norm_k.1.00►
◄layers.14.mlp.1.00►
◄layers.14.mlp.gate_proj.1.00►
◄layers.14.mlp.up_proj.1.00►
◄layers.14.mlp.linear_fc2.1.00►
◄layers.14.adaLN_mlp_ln.1.00►
◄layers.14.adaLN_sa_ln.1.00►
◄layers.15.1.00►
◄layers.15.self_attention.1.00►
◄layers.15.self_attention.to_q.1.00►
◄layers.15.self_attention.to_k.1.00►
◄layers.15.self_attention.to_v.1.00►
◄layers.15.self_attention.to_out.1.00►
◄layers.15.self_attention.norm_q.1.00►
◄layers.15.self_attention.norm_k.1.00►
◄layers.15.mlp.1.00►
◄layers.15.mlp.gate_proj.1.00►
◄layers.15.mlp.up_proj.1.00►
◄layers.15.mlp.linear_fc2.1.00►
◄layers.15.adaLN_mlp_ln.1.00►
◄layers.15.adaLN_sa_ln.1.00►
◄layers.16.1.00►
◄layers.16.self_attention.1.00►
◄layers.16.self_attention.to_q.1.00►
◄layers.16.self_attention.to_k.1.00►
◄layers.16.self_attention.to_v.1.00►
◄layers.16.self_attention.to_out.1.00►
◄layers.16.self_attention.norm_q.1.00►
◄layers.16.self_attention.norm_k.1.00►
◄layers.16.mlp.1.00►
◄layers.16.mlp.gate_proj.1.00►
◄layers.16.mlp.up_proj.1.00►
◄layers.16.mlp.linear_fc2.1.00►
◄layers.16.adaLN_mlp_ln.1.00►
◄layers.16.adaLN_sa_ln.1.00►
◄layers.17.1.00►
◄layers.17.self_attention.1.00►
◄layers.17.self_attention.to_q.1.00►
◄layers.17.self_attention.to_k.1.00►
◄layers.17.self_attention.to_v.1.00►
◄layers.17.self_attention.to_out.1.00►
◄layers.17.self_attention.norm_q.1.00►
◄layers.17.self_attention.norm_k.1.00►
◄layers.17.mlp.1.00►
◄layers.17.mlp.gate_proj.1.00►
◄layers.17.mlp.up_proj.1.00►
◄layers.17.mlp.linear_fc2.1.00►
◄layers.17.adaLN_mlp_ln.1.00►
◄layers.17.adaLN_sa_ln.1.00►
◄layers.18.1.00►
◄layers.18.self_attention.1.00►
◄layers.18.self_attention.to_q.1.00►
◄layers.18.self_attention.to_k.1.00►
◄layers.18.self_attention.to_v.1.00►
◄layers.18.self_attention.to_out.1.00►
◄layers.18.self_attention.norm_q.1.00►
◄layers.18.self_attention.norm_k.1.00►
◄layers.18.mlp.1.00►
◄layers.18.mlp.gate_proj.1.00►
◄layers.18.mlp.up_proj.1.00►
◄layers.18.mlp.linear_fc2.1.00►
◄layers.18.adaLN_mlp_ln.1.00►
◄layers.18.adaLN_sa_ln.1.00►
◄layers.19.1.00►
◄layers.19.self_attention.1.00►
◄layers.19.self_attention.to_q.1.00►
◄layers.19.self_attention.to_k.1.00►
◄layers.19.self_attention.to_v.1.00►
◄layers.19.self_attention.to_out.1.00►
◄layers.19.self_attention.norm_q.1.00►
◄layers.19.self_attention.norm_k.1.00►
◄layers.19.mlp.1.00►
◄layers.19.mlp.gate_proj.1.00►
◄layers.19.mlp.up_proj.1.00►
◄layers.19.mlp.linear_fc2.1.00►
◄layers.19.adaLN_mlp_ln.1.00►
◄layers.19.adaLN_sa_ln.1.00►
◄layers.20.1.00►
◄layers.20.self_attention.1.00►
◄layers.20.self_attention.to_q.1.00►
◄layers.20.self_attention.to_k.1.00►
◄layers.20.self_attention.to_v.1.00►
◄layers.20.self_attention.to_out.1.00►
◄layers.20.self_attention.norm_q.1.00►
◄layers.20.self_attention.norm_k.1.00►
◄layers.20.mlp.1.00►
◄layers.20.mlp.gate_proj.1.00►
◄layers.20.mlp.up_proj.1.00►
◄layers.20.mlp.linear_fc2.1.00►
◄layers.20.adaLN_mlp_ln.1.00►
◄layers.20.adaLN_sa_ln.1.00►
◄layers.21.1.00►
◄layers.21.self_attention.1.00►
◄layers.21.self_attention.to_q.1.00►
◄layers.21.self_attention.to_k.1.00►
◄layers.21.self_attention.to_v.1.00►
◄layers.21.self_attention.to_out.1.00►
◄layers.21.self_attention.norm_q.1.00►
◄layers.21.self_attention.norm_k.1.00►
◄layers.21.mlp.1.00►
◄layers.21.mlp.gate_proj.1.00►
◄layers.21.mlp.up_proj.1.00►
◄layers.21.mlp.linear_fc2.1.00►
◄layers.21.adaLN_mlp_ln.1.00►
◄layers.21.adaLN_sa_ln.1.00►
◄layers.22.1.00►
◄layers.22.self_attention.1.00►
◄layers.22.self_attention.to_q.1.00►
◄layers.22.self_attention.to_k.1.00►
◄layers.22.self_attention.to_v.1.00►
◄layers.22.self_attention.to_out.1.00►
◄layers.22.self_attention.norm_q.1.00►
◄layers.22.self_attention.norm_k.1.00►
◄layers.22.mlp.1.00►
◄layers.22.mlp.gate_proj.1.00►
◄layers.22.mlp.up_proj.1.00►
◄layers.22.mlp.linear_fc2.1.00►
◄layers.22.adaLN_mlp_ln.1.00►
◄layers.22.adaLN_sa_ln.1.00►
◄layers.23.1.00►
◄layers.23.self_attention.1.00►
◄layers.23.self_attention.to_q.1.00►
◄layers.23.self_attention.to_k.1.00►
◄layers.23.self_attention.to_v.1.00►
◄layers.23.self_attention.to_out.1.00►
◄layers.23.self_attention.norm_q.1.00►
◄layers.23.self_attention.norm_k.1.00►
◄layers.23.mlp.1.00►
◄layers.23.mlp.gate_proj.1.00►
◄layers.23.mlp.up_proj.1.00►
◄layers.23.mlp.linear_fc2.1.00►
◄layers.23.adaLN_mlp_ln.1.00►
◄layers.23.adaLN_sa_ln.1.00►
◄layers.24.1.00►
◄layers.24.self_attention.1.00►
◄layers.24.self_attention.to_q.1.00►
◄layers.24.self_attention.to_k.1.00►
◄layers.24.self_attention.to_v.1.00►
◄layers.24.self_attention.to_out.1.00►
◄layers.24.self_attention.norm_q.1.00►
◄layers.24.self_attention.norm_k.1.00►
◄layers.24.mlp.1.00►
◄layers.24.mlp.gate_proj.1.00►
◄layers.24.mlp.up_proj.1.00►
◄layers.24.mlp.linear_fc2.1.00►
◄layers.24.adaLN_mlp_ln.1.00►
◄layers.24.adaLN_sa_ln.1.00►
◄layers.25.1.00►
◄layers.25.self_attention.1.00►
◄layers.25.self_attention.to_q.1.00►
◄layers.25.self_attention.to_k.1.00►
◄layers.25.self_attention.to_v.1.00►
◄layers.25.self_attention.to_out.1.00►
◄layers.25.self_attention.norm_q.1.00►
◄layers.25.self_attention.norm_k.1.00►
◄layers.25.mlp.1.00►
◄layers.25.mlp.gate_proj.1.00►
◄layers.25.mlp.up_proj.1.00►
◄layers.25.mlp.linear_fc2.1.00►
◄layers.25.adaLN_mlp_ln.1.00►
◄layers.25.adaLN_sa_ln.1.00►
◄layers.26.1.00►
◄layers.26.self_attention.1.00►
◄layers.26.self_attention.to_q.1.00►
◄layers.26.self_attention.to_k.1.00►
◄layers.26.self_attention.to_v.1.00►
◄layers.26.self_attention.to_out.1.00►
◄layers.26.self_attention.norm_q.1.00►
◄layers.26.self_attention.norm_k.1.00►
◄layers.26.mlp.1.00►
◄layers.26.mlp.gate_proj.1.00►
◄layers.26.mlp.up_proj.1.00►
◄layers.26.mlp.linear_fc2.1.00►
◄layers.26.adaLN_mlp_ln.1.00►
◄layers.26.adaLN_sa_ln.1.00►
◄layers.27.1.00►
◄layers.27.self_attention.1.00►
◄layers.27.self_attention.to_q.1.00►
◄layers.27.self_attention.to_k.1.00►
◄layers.27.self_attention.to_v.1.00►
◄layers.27.self_attention.to_out.1.00►
◄layers.27.self_attention.norm_q.1.00►
◄layers.27.self_attention.norm_k.1.00►
◄layers.27.mlp.1.00►
◄layers.27.mlp.gate_proj.1.00►
◄layers.27.mlp.up_proj.1.00►
◄layers.27.mlp.linear_fc2.1.00►
◄layers.27.adaLN_mlp_ln.1.00►
◄layers.27.adaLN_sa_ln.1.00►
◄layers.28.1.00►
◄layers.28.self_attention.1.00►
◄layers.28.self_attention.to_q.1.00►
◄layers.28.self_attention.to_k.1.00►
◄layers.28.self_attention.to_v.1.00►
◄layers.28.self_attention.to_out.1.00►
◄layers.28.self_attention.norm_q.1.00►
◄layers.28.self_attention.norm_k.1.00►
◄layers.28.mlp.1.00►
◄layers.28.mlp.gate_proj.1.00►
◄layers.28.mlp.up_proj.1.00►
◄layers.28.mlp.linear_fc2.1.00►
◄layers.28.adaLN_mlp_ln.1.00►
◄layers.28.adaLN_sa_ln.1.00►
◄layers.29.1.00►
◄layers.29.self_attention.1.00►
◄layers.29.self_attention.to_q.1.00►
◄layers.29.self_attention.to_k.1.00►
◄layers.29.self_attention.to_v.1.00►
◄layers.29.self_attention.to_out.1.00►
◄layers.29.self_attention.norm_q.1.00►
◄layers.29.self_attention.norm_k.1.00►
◄layers.29.mlp.1.00►
◄layers.29.mlp.gate_proj.1.00►
◄layers.29.mlp.up_proj.1.00►
◄layers.29.mlp.linear_fc2.1.00►
◄layers.29.adaLN_mlp_ln.1.00►
◄layers.29.adaLN_sa_ln.1.00►
◄layers.30.1.00►
◄layers.30.self_attention.1.00►
◄layers.30.self_attention.to_q.1.00►
◄layers.30.self_attention.to_k.1.00►
◄layers.30.self_attention.to_v.1.00►
◄layers.30.self_attention.to_out.1.00►
◄layers.30.self_attention.norm_q.1.00►
◄layers.30.self_attention.norm_k.1.00►
◄layers.30.mlp.1.00►
◄layers.30.mlp.gate_proj.1.00►
◄layers.30.mlp.up_proj.1.00►
◄layers.30.mlp.linear_fc2.1.00►
◄layers.30.adaLN_mlp_ln.1.00►
◄layers.30.adaLN_sa_ln.1.00►
◄layers.31.1.00►
◄layers.31.self_attention.1.00►
◄layers.31.self_attention.to_q.1.00►
◄layers.31.self_attention.to_k.1.00►
◄layers.31.self_attention.to_v.1.00►
◄layers.31.self_attention.to_out.1.00►
◄layers.31.self_attention.norm_q.1.00►
◄layers.31.self_attention.norm_k.1.00►
◄layers.31.mlp.1.00►
◄layers.31.mlp.gate_proj.1.00►
◄layers.31.mlp.up_proj.1.00►
◄layers.31.mlp.linear_fc2.1.00►
◄layers.31.adaLN_mlp_ln.1.00►
◄layers.31.adaLN_sa_ln.1.00►
◄layers.32.1.00►
◄layers.32.self_attention.1.00►
◄layers.32.self_attention.to_q.1.00►
◄layers.32.self_attention.to_k.1.00►
◄layers.32.self_attention.to_v.1.00►
◄layers.32.self_attention.to_out.1.00►
◄layers.32.self_attention.norm_q.1.00►
◄layers.32.self_attention.norm_k.1.00►
◄layers.32.mlp.1.00►
◄layers.32.mlp.gate_proj.1.00►
◄layers.32.mlp.up_proj.1.00►
◄layers.32.mlp.linear_fc2.1.00►
◄layers.32.adaLN_mlp_ln.1.00►
◄layers.32.adaLN_sa_ln.1.00►
◄layers.33.1.00►
◄layers.33.self_attention.1.00►
◄layers.33.self_attention.to_q.1.00►
◄layers.33.self_attention.to_k.1.00►
◄layers.33.self_attention.to_v.1.00►
◄layers.33.self_attention.to_out.1.00►
◄layers.33.self_attention.norm_q.1.00►
◄layers.33.self_attention.norm_k.1.00►
◄layers.33.mlp.1.00►
◄layers.33.mlp.gate_proj.1.00►
◄layers.33.mlp.up_proj.1.00►
◄layers.33.mlp.linear_fc2.1.00►
◄layers.33.adaLN_mlp_ln.1.00►
◄layers.33.adaLN_sa_ln.1.00►
◄layers.34.1.00►
◄layers.34.self_attention.1.00►
◄layers.34.self_attention.to_q.1.00►
◄layers.34.self_attention.to_k.1.00►
◄layers.34.self_attention.to_v.1.00►
◄layers.34.self_attention.to_out.1.00►
◄layers.34.self_attention.norm_q.1.00►
◄layers.34.self_attention.norm_k.1.00►
◄layers.34.mlp.1.00►
◄layers.34.mlp.gate_proj.1.00►
◄layers.34.mlp.up_proj.1.00►
◄layers.34.mlp.linear_fc2.1.00►
◄layers.34.adaLN_mlp_ln.1.00►
◄layers.34.adaLN_sa_ln.1.00►
◄layers.35.1.00►
◄layers.35.self_attention.1.00►
◄layers.35.self_attention.to_q.1.00►
◄layers.35.self_attention.to_k.1.00►
◄layers.35.self_attention.to_v.1.00►
◄layers.35.self_attention.to_out.1.00►
◄layers.35.self_attention.norm_q.1.00►
◄layers.35.self_attention.norm_k.1.00►
◄layers.35.mlp.1.00►
◄layers.35.mlp.gate_proj.1.00►
◄layers.35.mlp.up_proj.1.00►
◄layers.35.mlp.linear_fc2.1.00►
◄layers.35.adaLN_mlp_ln.1.00►
◄layers.35.adaLN_sa_ln.1.00►
◄adaLN_modulation.1.00►
◄final_norm.1.00►
◄final_linear.1.00►
Categoryadvanced/model_merging/model_specific
Inputs (511)
| Name | Type | Default | Description |
|---|---|---|---|
| model | MODEL | — | |
| x_embedder. | FLOAT | 1.000–2 | — |
| text_proj. | FLOAT | 1.000–2 | — |
| time_embedding. | FLOAT | 1.000–2 | — |
| layers.0. | FLOAT | 1.000–2 | — |
| layers.0.self_attention. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.0.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.0.mlp. | FLOAT | 1.000–2 | — |
| layers.0.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.0.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.0.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.0.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.0.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.1. | FLOAT | 1.000–2 | — |
| layers.1.self_attention. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.1.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.1.mlp. | FLOAT | 1.000–2 | — |
| layers.1.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.1.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.1.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.1.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.1.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.2. | FLOAT | 1.000–2 | — |
| layers.2.self_attention. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.2.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.2.mlp. | FLOAT | 1.000–2 | — |
| layers.2.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.2.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.2.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.2.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.2.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.3. | FLOAT | 1.000–2 | — |
| layers.3.self_attention. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.3.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.3.mlp. | FLOAT | 1.000–2 | — |
| layers.3.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.3.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.3.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.3.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.3.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.4. | FLOAT | 1.000–2 | — |
| layers.4.self_attention. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.4.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.4.mlp. | FLOAT | 1.000–2 | — |
| layers.4.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.4.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.4.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.4.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.4.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.5. | FLOAT | 1.000–2 | — |
| layers.5.self_attention. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.5.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.5.mlp. | FLOAT | 1.000–2 | — |
| layers.5.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.5.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.5.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.5.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.5.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.6. | FLOAT | 1.000–2 | — |
| layers.6.self_attention. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.6.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.6.mlp. | FLOAT | 1.000–2 | — |
| layers.6.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.6.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.6.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.6.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.6.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.7. | FLOAT | 1.000–2 | — |
| layers.7.self_attention. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.7.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.7.mlp. | FLOAT | 1.000–2 | — |
| layers.7.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.7.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.7.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.7.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.7.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.8. | FLOAT | 1.000–2 | — |
| layers.8.self_attention. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.8.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.8.mlp. | FLOAT | 1.000–2 | — |
| layers.8.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.8.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.8.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.8.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.8.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.9. | FLOAT | 1.000–2 | — |
| layers.9.self_attention. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.9.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.9.mlp. | FLOAT | 1.000–2 | — |
| layers.9.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.9.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.9.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.9.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.9.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.10. | FLOAT | 1.000–2 | — |
| layers.10.self_attention. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.10.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.10.mlp. | FLOAT | 1.000–2 | — |
| layers.10.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.10.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.10.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.10.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.10.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.11. | FLOAT | 1.000–2 | — |
| layers.11.self_attention. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.11.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.11.mlp. | FLOAT | 1.000–2 | — |
| layers.11.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.11.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.11.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.11.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.11.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.12. | FLOAT | 1.000–2 | — |
| layers.12.self_attention. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.12.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.12.mlp. | FLOAT | 1.000–2 | — |
| layers.12.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.12.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.12.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.12.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.12.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.13. | FLOAT | 1.000–2 | — |
| layers.13.self_attention. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.13.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.13.mlp. | FLOAT | 1.000–2 | — |
| layers.13.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.13.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.13.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.13.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.13.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.14. | FLOAT | 1.000–2 | — |
| layers.14.self_attention. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.14.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.14.mlp. | FLOAT | 1.000–2 | — |
| layers.14.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.14.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.14.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.14.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.14.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.15. | FLOAT | 1.000–2 | — |
| layers.15.self_attention. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.15.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.15.mlp. | FLOAT | 1.000–2 | — |
| layers.15.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.15.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.15.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.15.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.15.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.16. | FLOAT | 1.000–2 | — |
| layers.16.self_attention. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.16.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.16.mlp. | FLOAT | 1.000–2 | — |
| layers.16.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.16.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.16.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.16.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.16.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.17. | FLOAT | 1.000–2 | — |
| layers.17.self_attention. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.17.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.17.mlp. | FLOAT | 1.000–2 | — |
| layers.17.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.17.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.17.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.17.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.17.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.18. | FLOAT | 1.000–2 | — |
| layers.18.self_attention. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.18.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.18.mlp. | FLOAT | 1.000–2 | — |
| layers.18.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.18.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.18.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.18.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.18.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.19. | FLOAT | 1.000–2 | — |
| layers.19.self_attention. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.19.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.19.mlp. | FLOAT | 1.000–2 | — |
| layers.19.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.19.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.19.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.19.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.19.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.20. | FLOAT | 1.000–2 | — |
| layers.20.self_attention. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.20.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.20.mlp. | FLOAT | 1.000–2 | — |
| layers.20.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.20.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.20.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.20.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.20.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.21. | FLOAT | 1.000–2 | — |
| layers.21.self_attention. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.21.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.21.mlp. | FLOAT | 1.000–2 | — |
| layers.21.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.21.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.21.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.21.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.21.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.22. | FLOAT | 1.000–2 | — |
| layers.22.self_attention. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.22.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.22.mlp. | FLOAT | 1.000–2 | — |
| layers.22.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.22.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.22.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.22.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.22.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.23. | FLOAT | 1.000–2 | — |
| layers.23.self_attention. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.23.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.23.mlp. | FLOAT | 1.000–2 | — |
| layers.23.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.23.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.23.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.23.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.23.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.24. | FLOAT | 1.000–2 | — |
| layers.24.self_attention. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.24.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.24.mlp. | FLOAT | 1.000–2 | — |
| layers.24.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.24.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.24.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.24.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.24.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.25. | FLOAT | 1.000–2 | — |
| layers.25.self_attention. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.25.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.25.mlp. | FLOAT | 1.000–2 | — |
| layers.25.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.25.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.25.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.25.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.25.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.26. | FLOAT | 1.000–2 | — |
| layers.26.self_attention. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.26.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.26.mlp. | FLOAT | 1.000–2 | — |
| layers.26.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.26.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.26.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.26.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.26.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.27. | FLOAT | 1.000–2 | — |
| layers.27.self_attention. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.27.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.27.mlp. | FLOAT | 1.000–2 | — |
| layers.27.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.27.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.27.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.27.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.27.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.28. | FLOAT | 1.000–2 | — |
| layers.28.self_attention. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.28.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.28.mlp. | FLOAT | 1.000–2 | — |
| layers.28.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.28.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.28.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.28.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.28.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.29. | FLOAT | 1.000–2 | — |
| layers.29.self_attention. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.29.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.29.mlp. | FLOAT | 1.000–2 | — |
| layers.29.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.29.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.29.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.29.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.29.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.30. | FLOAT | 1.000–2 | — |
| layers.30.self_attention. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.30.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.30.mlp. | FLOAT | 1.000–2 | — |
| layers.30.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.30.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.30.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.30.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.30.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.31. | FLOAT | 1.000–2 | — |
| layers.31.self_attention. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.31.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.31.mlp. | FLOAT | 1.000–2 | — |
| layers.31.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.31.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.31.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.31.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.31.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.32. | FLOAT | 1.000–2 | — |
| layers.32.self_attention. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.32.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.32.mlp. | FLOAT | 1.000–2 | — |
| layers.32.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.32.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.32.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.32.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.32.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.33. | FLOAT | 1.000–2 | — |
| layers.33.self_attention. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.33.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.33.mlp. | FLOAT | 1.000–2 | — |
| layers.33.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.33.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.33.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.33.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.33.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.34. | FLOAT | 1.000–2 | — |
| layers.34.self_attention. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.34.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.34.mlp. | FLOAT | 1.000–2 | — |
| layers.34.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.34.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.34.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.34.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.34.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| layers.35. | FLOAT | 1.000–2 | — |
| layers.35.self_attention. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_q. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_k. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_v. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.to_out. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.norm_q. | FLOAT | 1.000–2 | — |
| layers.35.self_attention.norm_k. | FLOAT | 1.000–2 | — |
| layers.35.mlp. | FLOAT | 1.000–2 | — |
| layers.35.mlp.gate_proj. | FLOAT | 1.000–2 | — |
| layers.35.mlp.up_proj. | FLOAT | 1.000–2 | — |
| layers.35.mlp.linear_fc2. | FLOAT | 1.000–2 | — |
| layers.35.adaLN_mlp_ln. | FLOAT | 1.000–2 | — |
| layers.35.adaLN_sa_ln. | FLOAT | 1.000–2 | — |
| adaLN_modulation. | FLOAT | 1.000–2 | — |
| final_norm. | FLOAT | 1.000–2 | — |
| final_linear. | FLOAT | 1.000–2 | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| MODEL | MODEL | — |