SHIFT Style Steering (FLUX.2 Klein)
SHIFT reference-image style steering for FLUX.2 Klein (4B, 4B Base, 9B, 9B Base): extract an activation-steering vector from one style image, then generate plain text-to-image in that style, with no reference image at inference.
ComfyUI-SHIFT-StyleSteer
Reference-image style steering for FLUX.2 Klein in ComfyUI: 4B, 4B Base, 9B and 9B Base.
The style comes from one reference image, and that image is used only once. Each prompt is run twice from the same noise: once with the reference (Klein I2I, the teacher) and once without it (plain T2I, the student). The node records the double-stream block outputs at every step, crops the reference tokens, and takes the mean difference. That difference is the steering field. Generation afterwards is plain text-to-image with no reference image: the node patches the double blocks with
h <- |h| * (h + a * v) / |h + a * v| (per token, image stream)
This is the SHIFT method (arXiv:2604.09213) extended to reference images (gugmelik/SHIFT, branch
flux-klein). It runs as native ComfyUI model patches (patches_replace["dit"]["double_block", i]),
so no weights are copied, and it works together with LoRAs, other patches and any sampler.
Install
Option 1: ComfyUI-Manager, "Install via Git URL"
- Open Manager and click Install via Git URL.
- Paste the URL and confirm:
https://github.com/gugmelik/ComfyUI-SHIFT-StyleSteer - Restart ComfyUI.
If Manager answers "This action is not allowed with this security level configuration", it is because installing from a Git URL counts as a high-risk action. To allow it:
- Open Manager's
config.ini:- ComfyUI v0.3.76 and newer:
ComfyUI/user/__manager/config.ini - older versions:
ComfyUI/user/default/ComfyUI-Manager/config.ini
- ComfyUI v0.3.76 and newer:
- Set
security_level = weak. - Restart ComfyUI, install, then set it back to
normal.
Git-URL installs also need ComfyUI to listen only on 127.0.0.1, so don't start it with --listen.
Option 2: ComfyUI-Manager search (after the node is published to the Comfy Registry)
Search Manager for SHIFT Style Steering and click Install.
Option 3: by hand
cd ComfyUI/custom_nodes
git clone https://github.com/gugmelik/ComfyUI-SHIFT-StyleSteer
# restart ComfyUI
The node has no extra Python dependencies: it only uses torch and safetensors, which come with ComfyUI.
Models
Four Klein variants are supported. Each has its own example workflow, with the sampler settings from ComfyUI's official Klein templates:
| Variant | Diffusion model (models/diffusion_models) | Text encoder (models/text_encoders) | Sampling | License |
| --- | --- | --- | --- | --- |
| 4B (distilled) | flux-2-klein-4b.safetensors | qwen_3_4b.safetensors | 4 steps, cfg 1 | Apache-2.0 |
| 4B Base | flux-2-klein-base-4b-fp8.safetensors | qwen_3_4b.safetensors | 20 steps, cfg 5 | Apache-2.0 |
| 9B (distilled) | flux-2-klein-9b.safetensors | qwen_3_8b.safetensors | 4 steps, cfg 1 | FLUX Non-Commercial |
| 9B Base | flux-2-klein-base-9b.safetensors | qwen_3_8b.safetensors | 20 steps, cfg 5 | FLUX Non-Commercial |
All four use the same VAE: flux2-vae.safetensors, in models/vae.
The 9B repos are gated. Open each model page on Hugging Face, accept the FLUX Non-Commercial License, and download while signed in (or with a token). The BFL 4B Base repo may also ask you to accept its terms.
To download from a terminal into an existing ComfyUI (for example on RunPod):
cd ComfyUI/custom_nodes/ComfyUI-SHIFT-StyleSteer
COMFY_DIR=/workspace/ComfyUI MODELS="4b 9b" HF_TOKEN=hf_... bash scripts/download_models.sh
# MODELS: 4b 4b-base 9b 9b-base all (HF_TOKEN only needed for the black-forest-labs repos)
The example workflows carry these download links too, so ComfyUI's missing-models dialog can offer them when you open a workflow.
Use
- Open an example workflow. The JSON files are in
example_workflows/, and ComfyUI also lists them under Templates in this node pack's section. You can also drag a JSON file onto the canvas. There are two per variant (4b,4b-base,9b,9b-base):shift_klein_<variant>_extract_and_generateextracts a vector, saves it, then renders an unsteered and a steered image with the same seed.shift_klein_<variant>_generate_from_saved_vectorloads a saved vector and generates, without extracting again.
- Style reference (Load Image): upload any image.
references/contains CC0 examples; copymonet_water_lilies.jpgintoComfyUI/inputto use the workflow's default. - Press Run. The Teacher previews should show the style. If they don't, the vector won't carry it either.
- Tune SHIFT Apply Style Steering:
strength_img: start at 6 and sweep 2–12.mode = anglewithangle_deg5–20: a fixed rotation per token.blocks/steps(e.g.0-2,0,1): restrict steering to some blocks or step bins (bin 0 = the earliest, noisiest steps).vector_field = pooled: one vector per block, so it works at any resolution.
Vectors are saved to ComfyUI/models/shift_vectors/. Extract again for each style and each model:
vectors from 4B, 9B, base and distilled are not interchangeable.
Base models: they need 20 steps at cfg 5 with an empty negative prompt. The base workflows use
8 extraction prompts, and extraction is about 5× slower than with the distilled models.
step_bins = 4 groups the 20 steps (by sigma) into 4 fields, so the vector stays about the same
size as a distilled one. Set it to 0 to keep one field per step; that makes the vector about 5×
larger.
Hardware: for 4B, an NVIDIA GPU with 16 GB of VRAM or more is comfortable; with 8–12 GB, start
ComfyUI with --lowvram. The 9B variants use the full bf16 weights (about 18 GB diffusion model
plus a 16 GB text encoder). ComfyUI moves the text encoder off the GPU while sampling, but plan on
a 48 GB GPU (A6000 / L40S / A100) for comfortable extraction, or 32 GB with --lowvram.
Developer setup (optional)
The scripts/ folder builds a separate ComfyUI next to this repo, with its own venv, CUDA torch
and models. It links this repo into custom_nodes (as a junction or symlink), so you edit the code
here and just restart ComfyUI.
# Windows, from the repo folder
powershell -ExecutionPolicy Bypass -File scripts\setup_windows.ps1 # -> ..\ComfyUI-shift
powershell -ExecutionPolicy Bypass -File scripts\smoke_test_windows.ps1 # CPU test, tiny random model
powershell -ExecutionPolicy Bypass -File scripts\run_windows.ps1 # http://127.0.0.1:8188
# Linux / RunPod
bash scripts/setup_linux.sh && bash scripts/run_linux.sh # port 8188
Options: -Models 4b,9b (or 4b-base, 9b-base, all; the default is 4b), -Cuda cu126 for
older drivers, -SkipModels if the models are already downloaded, -ComfyDir D:\ComfyUI to use
another ComfyUI folder. For the gated repos, set $env:HF_TOKEN = "hf_..." first.
On Linux, the same options are MODELS="4b 9b", HF_TOKEN=... and COMFY_DIR=/path.
ComfyUI-SHIFT-StyleSteer/
├── __init__.py / nodes.py / shift_core.py the node pack (ComfyUI imports __init__.py)
├── pyproject.toml Comfy Registry metadata
├── example_workflows/ workflows shown in ComfyUI's template browser
├── references/ prompts/ CC0 style images, 50 train / 100 test prompts
├── scripts/ tests/ tools/ dev setup, CPU smoke test, workflow generator
└── .github/workflows/publish_action.yml publishes to the Comfy Registry when pyproject.toml changes
The nodes
| Node | Inputs | Output |
| --- | --- | --- |
| SHIFT Extract Style Vector (Klein) | MODEL, CLIP, VAE, reference IMAGE, prompts (one per line), width/height (1024), steps (4 / 20 base), cfg (1 / 5 base), seed, max_prompts, ref_max_megapixels, step_bins (4), negative_prompt (base only) | SHIFT_VECTOR, teacher images, student images |
| SHIFT Apply Style Steering (Klein) | MODEL, SHIFT_VECTOR, mode, strength_img, angle_deg, strength_txt, blocks, steps, vector_field, apply_to | patched MODEL |
| SHIFT Save Style Vector | SHIFT_VECTOR, filename_prefix | models/shift_vectors/<prefix>_00001.safetensors |
| SHIFT Load Style Vector | file name | SHIFT_VECTOR |
A few details:
- Reference tokens are cropped. Klein lays out the image stream as
[generated | reference]. Only the generated tokens are recorded and steered. The token count comes from ComfyUI'sreference_image_num_tokens. - Steps are matched by sigma. Each model call is matched to the nearest sigma of the extraction grid. The 4-step grid at 1024² is (1.000, 0.967, 0.908, 0.767), the same as in the paper. Running with a different step count therefore still maps to the closest extracted step.
- CFG > 1 is supported (Klein base). Only the cond rows are recorded during extraction. With
apply_to = cond_only, only the cond rows are steered. - Step bins.
step_binsmaps the extraction steps to bins by position in the schedule (20 steps / 4 bins = 5 steps per bin). All steps in a bin share one averaged field, and at apply time each model call uses the bin of its nearest extraction sigma. - The vector file is safetensors with keys
img.s{bin}.b{block}andtxt.s{bin}.b{block}, plus metadata (sigmas, step_bins, resolution, prompt count, negative prompt). At 1024² with 4 bins it is a few hundred MB (4B) to about 1 GB (9B) in fp16.
Troubleshooting
| Symptom | Fix |
| --- | --- |
| SHIFT nodes are red / missing | Check the ComfyUI console for IMPORT FAILED ... ComfyUI-SHIFT-StyleSteer. Make sure ComfyUI/custom_nodes/ComfyUI-SHIFT-StyleSteer/__init__.py exists, then restart ComfyUI. |
| this MODEL has no double_blocks | The Load Diffusion Model node isn't pointing at a Klein file. |
| Loader nodes are red | The model files are missing. Download them from the Models table into ComfyUI/models/{diffusion_models,text_encoders,vae}, or use scripts/download_models.sh. |
| 401 / 403 when downloading 9B | Accept the license on the model's Hugging Face page, then pass HF_TOKEN. |
| Out of memory | Start with --lowvram, lower max_prompts to 8, or use RunPod. |
| Warning using the token-pooled vector | The generation resolution differs from the extraction resolution. Extract again at that size for the per-token field. |
| Steered image ≈ unsteered | Raise strength_img, and check that the teacher previews actually show the style. |
Credits
- Method: N. Konovalova, A. Kuznetsov, A. Alanov, SHIFT: Steering hidden intermediates in flow
transformers, arXiv:2604.09213 (MIT). Reference-image extension for Klein: SHIFT branch
flux-klein. - Reference images: see
references/SOURCES.md(AIC Open Access, CC0). - FLUX.2 [klein] 4B / 4B Base: Black Forest Labs, Apache-2.0. FLUX.2 [klein] 9B / 9B Base: Black Forest Labs, FLUX Non-Commercial License.