Nodes/ComfyUI-UtilsCollection/Advanced MiniMax H3 Image to Video
ComfyUI Node

Advanced MiniMax H3 Image to Video

The MiniMax H3 image-to-video conditioning node that does the plumbing for you

By silveroxides·Created 2 months ago·Updated about 7 hours ago· 24
Advanced MiniMax H3 Image to Video
  • clip
  • vae
  • first_frame
  • last_frame
  • visual_fusion_config
  • reference_images
  • fusion_images
  • media_config
  • positive
  • LATENT
prompt
width1344
height768
length124
multiplier1.0
ref_image_sizematch
vlm_resolution384

MiniMax H3 is the 33B omni-modal video model that dropped in August 2026 with native audio, and its ComfyUI pipeline is demanding: it needs a Qwen3-VL text encoder projected into H3's 32B conditioning space, a separate video VAE for keyframes, reference images that become both VLM pictures and VAE anchors, and a joint video/audio latent. Getting all that wired by hand is a genuinely unpleasant afternoon. UC_AdvancedMiniMaxH3ImageToVideo is the pack's node that collapses most of it into one box: feed it the encoder, the VAE, a prompt, and images, and it returns both the positive conditioning and the matching LATENT ready for sampling.

Setting it up (the part people skip and then blame the node)

The README is explicit about the two non-obvious setup steps, and skipping either produces "why is this garbage" hours:

  1. Load the encoder with Core's Load CLIP using type minimax, then run it through UC_MiniMaxH3ClipProjectionPatcher, which projects a Qwen3-VL 4B or 8B encoder into H3's conditioning space.
  2. Download one matching projection file into ComfyUI/models/clip_projections/ - e.g. mmh3-4b-ClipProj-v3.1.safetensors or the 8B equivalent, plain or residual-MLP variants - from the linked NicoLab28 repo. Only one is used at a time.

This node then takes the patched CLIP as its clip input plus the H3 video vae, and handles the rest.

The inputs that matter

  • clip - the H3 Qwen3-VL 32B text encoder (post-projection patcher).
  • vae - MiniMax H3 video VAE, used for frame anchors and native references.
  • prompt - raw H3 prompt. Picture labels are supplied by Core from the connected image roles, so don't hand-write <Picture N>.
  • width / height - 1344×768 defaults, 32-step.
  • length - frame count at 24 fps (default 124). The tooltip's key detail: it's snapped upward to H3's 17k+5 temporal grid, so don't fight it with odd counts.
  • ref_image_size - match (limit native references to the generation pixel area), max (short edge capped at 2048), or none (images stay Qwen pictures only, no native VAE reference conditioning). The none mode is how the README's eight-image, 1024-VLM workflow runs - visual-token conditioning without VAE reference encoding.
  • vlm_resolution - equivalent-square Qwen3-VL target (256–3584, default 384), independent of VAE sizing.

Optionals are where it gets interesting: first_frame/last_frame become VAE anchors and numbered Qwen pictures; reference_images are ordered native H3 references (mutually exclusive with explicit frames); fusion_images and visual_fusion_config handle Qwen-only fusion routing; and media_config (from UC_MiniMaxH3MediaConfig) adds Qwen-only Video timeline images with timestamps plus optional native audio via an H3 audio VAE.

Outputs

positive (CONDITIONING) and LATENT. Wire both into the same sampler - this node is a conditioning and latent factory, not just an encoder. The README's worked example reproduced a 12.25-second sequence's framing in seven sampling steps on a 16GB GPU, which is the right mental model for what this node is trying to make easy.

Install

ComfyUI Manager → search ComfyUI-UtilsCollection → install, or clone:

cd ComfyUI/custom_nodes
git clone https://github.com/silveroxides/ComfyUI-UtilsCollection

Restart. Python deps are light (opencv-python, typing-extensions); the heavy lifting is the H3 weights themselves, which is a big download and - important - the H3 Community License excludes the US, EU, UK and South Korea from local-weight use, so check that before you spend the bandwidth. One more thing: the pack's generic ref_latent_mode must stay off here; H3 uses Core's dedicated reference conditioning instead.

Categoryadvanced/conditioning

Inputs (15)

NameTypeDefaultDescription
clipCLIPMiniMax H3 Qwen3-VL 32B text encoder (qwen3vl_32b).
vaeVAEMiniMax H3 video VAE used for connected frame anchors and native image references.
promptSTRINGRaw MiniMax H3 prompt. Picture labels are supplied by Core from the connected image roles.
widthINT134432–16384
heightINT76832–16384
lengthINT1245–3600Frame count at 24 fps, snapped upward to MiniMax H3's 17k+5 temporal grid.
multiplierFLOAT1.0-1000–1000Scales the final Qwen conditioning and pooled output; does not alter VAE keyframes or the H3 latent.
ref_image_sizeCOMBOmatchMatch limits each native reference to the generation pixel area; max limits its short edge to 2048 pixels. None keeps frame and reference inputs as Qwen pictures but skips native VAE keyframe and reference conditioning. All image sizing preserves aspect ratio; final 32-pixel alignment can marginally enlarge a dimension.
vlm_resolutionINT3840–4096Equivalent-square Qwen3-VL target from 256 to 3584. Values outside that range preserve the original image resolution. This is independent of VAE frame and reference sizing.
first_frameoptIMAGEOptional frame-zero VAE anchor and the first numbered Qwen picture.
last_frameoptIMAGEOptional final-frame VAE anchor and the next numbered Qwen picture.
visual_fusion_configoptVISUAL_FUSION_CONFIGOptional spatial method. With frame inputs, fusion_image_1 targets Picture 1 and fusion_image_2 targets Picture 2; disconnected or off keeps fusion images as separate numbered Qwen pictures outside native-reference mode. See fusion_images for the complete routing contract.
reference_imagesoptCOMFY_AUTOGROW_V3Ordered native H3 references and numbered Qwen pictures. This mode cannot be combined with explicit first/last frame inputs. See fusion_images for supported reference-picture fusion.
fusion_imagesoptCOMFY_AUTOGROW_V3Qwen-only fusion contract. Active method: with frames, socket N targets Picture N and every batch item is another source; an unmatched socket errors. With native references, one image on fusion_image_1 broadcasts to every reference Picture; otherwise flattened fusion images pair by index and extras beyond the reference count are ignored. Without frames or references, all fusion images combine into Picture 1. Method off keeps them as separate Pictures, except native-reference mode ignores them. Video blocks are never fusion targets.
media_configoptMINIMAX_H3_MEDIA_CONFIGAdds a Qwen-only Video after existing Pictures and optional native audio. It creates no native video latent and excludes Video blocks from fusion; active mixed-media fusion requires grid-deepstack.

Outputs (2)

NameTypeDescription
positiveCONDITIONING
LATENTLATENT