Nodes/Comfy_HunyuanImage3/Hunyuan 3 Generate (Low VRAM Budget)
ComfyUI Node

Hunyuan 3 Generate (Low VRAM Budget)

The 24GB workhorse, with a GPU budget override

By EricRollei·Created 10 months ago·Updated 4 months ago· 65
Hunyuan 3 Generate (Low VRAM Budget)
  • model
  • image
  • rewritten_prompt
  • status
  • trigger
promptA beautiful landscape
seed0
steps40
resolution
guidance_scale7.5
offload_modesmart
post_actionsoft_unload_to_cpu
enable_prompt_rewritefalse
rewrite_stylenone
api_urlhttps://api.deepseek.com/v1/chat/completions
model_namedeepseek-chat
gpu_budget_gb-1.0

"Hunyuan 3 Generate (Low VRAM Budget)" is the generator end of the pack's recommended 24–32GB pairing: it's the Low VRAM generator plus a gpu_budget_gb override and memory telemetry, designed to run against the NF4 Low VRAM+ loader. The README's verified reference workflow - loader → (optional rewriter) → this node → save - produced a 1600×1600 render on a 24GB rig without tripping the bitsandbytes validation that used to plague NF4 on small cards. If you have a 24GB GPU and want HunyuanImage-3.0 at all, this is the node you'll live in.

Like the plain Low VRAM generator, it's built for quantized NF4/INT8 models loaded with a device map: it skips the conflicting CPU-offload calls and works with accelerate's offloading instead of against it. The Budget variant adds the two things production workflows want - a way to override the memory assumption for a single run, and telemetry in the status output.

The inputs that matter

The usual generator controls are all here (model, prompt, seed, steps default 40, resolution, guidance_scale, offload_mode, post_action), plus the optional prompt-rewrite block and two things that make this node what it is:

  • gpu_budget_gb - override the loader's recorded GPU budget for this run (default -1 = use the loader's value). The README gives the concrete use: set it to assume a different baseline (say 65GB) so smart-mode offload math changes, without reloading or remapping the model. Leave it at -1 unless you know why you're changing it.
  • post_action defaults to soft_unload_to_cpu - the right default on a card where you'll want VRAM back for downstream nodes.

offload_mode has the same honest tooltip as the Low VRAM node: for NF4/INT8 it's ignored, because the loader's device map already owns offloading. Set always and you'll double-offload and stall. Outputs are image, rewritten_prompt, status (now with memory telemetry), and trigger.

The workflow it belongs to

Hunyuan 3 Loader (NF4 Low VRAM+) → Hunyuan 3 Generate (Low VRAM Budget) → Save/Display

The loader's gpu_memory_target_gb (18–20GB on a 24GB card) is what this node's smart defaults assume - keep them in sync and it stays out of trouble. Swap in a plain Low VRAM generator if you don't need the budget override or telemetry; they're compatible, but this variant is the fuller-featured choice.

Installing

cd ComfyUI/custom_nodes
git clone https://github.com/EricRollei/Comfy_HunyuanImage3
cd Comfy_HunyuanImage3
pip install -r requirements.txt

Restart ComfyUI (or ComfyUI Manager, search "Comfy_HunyuanImage3"), and have the NF4 weights in ComfyUI/models/:

huggingface-cli download EricRollei/HunyuanImage-3-NF4-v2 --local-dir HunyuanImage-3-NF4

Reality check

All the Low VRAM caveats apply: this node removes crashes, not physics. On 24GB cards the offloaded weights stream over PCIe, so generations are slow - community testers who ran NF4 on a 4090 called it functional but "not worth the time" for serious iteration, and a 96GB card runs circles around it. The budget slider gives you fine-grained control, but it can't manufacture bandwidth. If you've got a 48GB+ card, use the base Generate node and keep this one for a future upgrade scenario.

CategoryHunyuanImage3

Inputs (13)

NameTypeDefaultDescription
modelHUNYUAN_MODEL
promptSTRINGA beautiful landscape
seedINT00–18446744073709550000
stepsINT401–100Number of sampling steps. 30-40 is recommended.
resolutionCOMBO20 options: Auto (model default), 720x1280 - Portrait 720p (0.9MP), 864x1152 - Portrait 3:4 (1.0MP), 1024x1024 - Square 1K (1.0MP), 1152x864 - Landscape 4:3 (1.0MP), 1280x720 - Landscape 720p (0.9MP), +14
guidance_scaleFLOAT7.51–20Classifier-free guidance scale. Higher = closer to prompt, Lower = more creative.
offload_modeCOMBOsmartFor NF4/INT8 models, offloading is handled automatically by the loader (device_map). This setting is ignored for quantized models.
post_actionCOMBOsoft_unload_to_cpuAfter generation: soft_unload_to_cpu recommended for Low VRAM to free GPU for downstream tasks
enable_prompt_rewriteoptBOOLEANfalse
rewrite_styleoptCOMBOnone3 options: none, en_recaption, en_think_recaption
api_urloptSTRINGhttps://api.deepseek.com/v1/chat/completions
model_nameoptSTRINGdeepseek-chat
gpu_budget_gboptFLOAT-1.0-1–128Override loader GPU budget for this run (GB). -1 uses loader default.

Outputs (4)

NameTypeDescription
imageIMAGE
rewritten_promptSTRING
statusSTRING
trigger*