Advanced MiniMax H3 Image to Video
The MiniMax H3 image-to-video conditioning node that does the plumbing for you
- clip
- vae
- first_frame
- last_frame
- visual_fusion_config
- reference_images
- fusion_images
- media_config
- positive
- LATENT
MiniMax H3 is the 33B omni-modal video model that dropped in August 2026 with native audio, and its ComfyUI pipeline is demanding: it needs a Qwen3-VL text encoder projected into H3's 32B conditioning space, a separate video VAE for keyframes, reference images that become both VLM pictures and VAE anchors, and a joint video/audio latent. Getting all that wired by hand is a genuinely unpleasant afternoon. UC_AdvancedMiniMaxH3ImageToVideo is the pack's node that collapses most of it into one box: feed it the encoder, the VAE, a prompt, and images, and it returns both the positive conditioning and the matching LATENT ready for sampling.
Setting it up (the part people skip and then blame the node)
The README is explicit about the two non-obvious setup steps, and skipping either produces "why is this garbage" hours:
- Load the encoder with Core's Load CLIP using type
minimax, then run it throughUC_MiniMaxH3ClipProjectionPatcher, which projects a Qwen3-VL 4B or 8B encoder into H3's conditioning space. - Download one matching projection file into
ComfyUI/models/clip_projections/- e.g.mmh3-4b-ClipProj-v3.1.safetensorsor the 8B equivalent, plain or residual-MLP variants - from the linked NicoLab28 repo. Only one is used at a time.
This node then takes the patched CLIP as its clip input plus the H3 video vae, and handles the rest.
The inputs that matter
clip- the H3 Qwen3-VL 32B text encoder (post-projection patcher).vae- MiniMax H3 video VAE, used for frame anchors and native references.prompt- raw H3 prompt. Picture labels are supplied by Core from the connected image roles, so don't hand-write<Picture N>.width/height- 1344×768 defaults, 32-step.length- frame count at 24 fps (default 124). The tooltip's key detail: it's snapped upward to H3's 17k+5 temporal grid, so don't fight it with odd counts.ref_image_size-match(limit native references to the generation pixel area),max(short edge capped at 2048), ornone(images stay Qwen pictures only, no native VAE reference conditioning). Thenonemode is how the README's eight-image, 1024-VLM workflow runs - visual-token conditioning without VAE reference encoding.vlm_resolution- equivalent-square Qwen3-VL target (256–3584, default 384), independent of VAE sizing.
Optionals are where it gets interesting: first_frame/last_frame become VAE anchors and numbered Qwen pictures; reference_images are ordered native H3 references (mutually exclusive with explicit frames); fusion_images and visual_fusion_config handle Qwen-only fusion routing; and media_config (from UC_MiniMaxH3MediaConfig) adds Qwen-only Video timeline images with timestamps plus optional native audio via an H3 audio VAE.
Outputs
positive (CONDITIONING) and LATENT. Wire both into the same sampler - this node is a conditioning and latent factory, not just an encoder. The README's worked example reproduced a 12.25-second sequence's framing in seven sampling steps on a 16GB GPU, which is the right mental model for what this node is trying to make easy.
Install
ComfyUI Manager → search ComfyUI-UtilsCollection → install, or clone:
cd ComfyUI/custom_nodes
git clone https://github.com/silveroxides/ComfyUI-UtilsCollection
Restart. Python deps are light (opencv-python, typing-extensions); the heavy lifting is the H3 weights themselves, which is a big download and - important - the H3 Community License excludes the US, EU, UK and South Korea from local-weight use, so check that before you spend the bandwidth. One more thing: the pack's generic ref_latent_mode must stay off here; H3 uses Core's dedicated reference conditioning instead.
Inputs (15)
| Name | Type | Default | Description |
|---|---|---|---|
| clip | CLIP | MiniMax H3 Qwen3-VL 32B text encoder (qwen3vl_32b). | |
| vae | VAE | MiniMax H3 video VAE used for connected frame anchors and native image references. | |
| prompt | STRING | Raw MiniMax H3 prompt. Picture labels are supplied by Core from the connected image roles. | |
| width | INT | 134432–16384 | — |
| height | INT | 76832–16384 | — |
| length | INT | 1245–3600 | Frame count at 24 fps, snapped upward to MiniMax H3's 17k+5 temporal grid. |
| multiplier | FLOAT | 1.0-1000–1000 | Scales the final Qwen conditioning and pooled output; does not alter VAE keyframes or the H3 latent. |
| ref_image_size | COMBO | match | Match limits each native reference to the generation pixel area; max limits its short edge to 2048 pixels. None keeps frame and reference inputs as Qwen pictures but skips native VAE keyframe and reference conditioning. All image sizing preserves aspect ratio; final 32-pixel alignment can marginally enlarge a dimension. |
| vlm_resolution | INT | 3840–4096 | Equivalent-square Qwen3-VL target from 256 to 3584. Values outside that range preserve the original image resolution. This is independent of VAE frame and reference sizing. |
| first_frameopt | IMAGE | Optional frame-zero VAE anchor and the first numbered Qwen picture. | |
| last_frameopt | IMAGE | Optional final-frame VAE anchor and the next numbered Qwen picture. | |
| visual_fusion_configopt | VISUAL_FUSION_CONFIG | Optional spatial method. With frame inputs, fusion_image_1 targets Picture 1 and fusion_image_2 targets Picture 2; disconnected or off keeps fusion images as separate numbered Qwen pictures outside native-reference mode. See fusion_images for the complete routing contract. | |
| reference_imagesopt | COMFY_AUTOGROW_V3 | Ordered native H3 references and numbered Qwen pictures. This mode cannot be combined with explicit first/last frame inputs. See fusion_images for supported reference-picture fusion. | |
| fusion_imagesopt | COMFY_AUTOGROW_V3 | Qwen-only fusion contract. Active method: with frames, socket N targets Picture N and every batch item is another source; an unmatched socket errors. With native references, one image on fusion_image_1 broadcasts to every reference Picture; otherwise flattened fusion images pair by index and extras beyond the reference count are ignored. Without frames or references, all fusion images combine into Picture 1. Method off keeps them as separate Pictures, except native-reference mode ignores them. Video blocks are never fusion targets. | |
| media_configopt | MINIMAX_H3_MEDIA_CONFIG | Adds a Qwen-only Video after existing Pictures and optional native audio. It creates no native video latent and excludes Video blocks from fusion; active mixed-media fusion requires grid-deepstack. |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| positive | CONDITIONING | — |
| LATENT | LATENT | — |