Nodes/ComfyUi-Untwisting-RoPE/Unofficial Extensions
ComfyUI Node

Unofficial Extensions

Optional unofficial toggles for Untwisting RoPE. These are intentionally separated from the main paper settings.

By BigStationW·Created 3 months ago·Updated about a month ago· 125
Unofficial Extensions
    • unofficial_extensions
    post_attention_adain_strength0.50
    axis0_rope_modematch_axes
    axis0_rope_scale1.00
    cosine_gated_v_injection0.00
    variance_gated_v_adain0.00
    key_subspace_alignment0.00
    Categorymodel_patches/Untwisting RoPE

    Inputs (6)

    NameTypeDefaultDescription
    post_attention_adain_strengthFLOAT0.500–1Blend strength for matching the target attention output to the reference attention output.
    axis0_rope_modeCOMBOmatch_axesAxis-0 RoPE behavior. default -> Its values are equal to low_scale; match_axes -> makes axis 0 use the same curve as axes 1+; constant -> uses axis0_rope_scale.
    axis0_rope_scaleFLOAT1.000–8RoPE scale used only when axis0_rope_mode = constant.
    cosine_gated_v_injectionFLOAT0.000–1Only aligned target/reference V tokens receive reference injection.
    variance_gated_v_adainFLOAT0.000–1Applies V AdaIN only on high-reference-variance channels.
    key_subspace_alignmentFLOAT0.000–1Projects target keys onto reference keys to restrict routing towards the reference key subspace.

    Outputs (1)

    NameTypeDescription
    unofficial_extensionsUNTWISTING_ROPE_EXTENSIONS