Nodes/ComfyUI-UtilsCollection/Adv MiniMax H3 Image to Video (TokenFusion)
ComfyUI Node

Adv MiniMax H3 Image to Video (TokenFusion)

TokenFusion for MiniMax H3 image-to-video

By silveroxides·Created 2 months ago·Updated about 7 hours ago· 24
Adv MiniMax H3 Image to Video (TokenFusion)
  • clip
  • vae
  • first_frame
  • last_frame
  • visual_fusion_config
  • reference_images
  • fusion_images
  • media_config
  • positive
  • LATENT
prompt
width1344
height768
length124
multiplier1.0
ref_image_sizematch
vlm_resolution384

MiniMax H3 is the big one for 2026 video: MiniMax's 33B omni-modal model (the open-weights version of Hailuo 3.0) that takes text, images, video, and audio as one context and generates clips with native, jointly-produced sound. ComfyUI had day-0 support, and this pack is where a lot of the day-0 workflows came from - silveroxides is the same person behind the Chroma GGUF quants and ComfyUI_SamplingUtils, i.e. a power user who lives on the bleeding edge of VLM conditioning rather than someone shipping Yet Another Upscaler.

So what does this node do? It's a variant of the pack's Advanced MiniMax H3 Image to Video encoder, and the "TokenFusion" in the name is the whole point. Instead of encoding each reference image separately and blending the results afterwards, it fuses the visual tokens from your frame, reference, and fusion images first, then runs a single shared Qwen3-VL encode. One encode means fewer passes over the text encoder and - in theory and usually in practice - tighter coordination between the pictures and the prompt, because the model never has to reconcile separately-encoded conditionings.

The node takes a clip (MiniMax H3's Qwen3-VL 32B text encoder, qwen3vl_32b), a vae (the H3 video VAE), and your raw prompt - Picture labels are supplied by Core from whatever image roles you connect, so don't hand-write them. width/height default to 1344x768, length defaults to 124 frames, which is the interesting gotcha: frame count is snapped upward to MiniMax H3's 17k+5 temporal grid, so 124 becomes whatever the grid lands on. multiplier scales the final Qwen conditioning and pooled output without touching the VAE keyframes or latent, and vlm_resolution (default 384) controls the equivalent-square resolution the Qwen3-VL encoder sees the images at.

Optional inputs are where the real work happens: first_frame and last_frame become VAE-encoded anchors at frame zero and the end, reference_images (an ordered autogrow list) are native H3 references that also become numbered Qwen pictures, visual_fusion_config adds a spatial fusion method, and media_config can add a Qwen-only Video timeline plus optional native audio conditioning. One rule to remember: reference mode and explicit first/last frame inputs are mutually exclusive - the node will error if you mix them.

You get two outputs - positive (CONDITIONING) and LATENT - and they must both feed the same sampling branch, along with the same model. Forget that and you'll get mysterious inconsistency between what the latent expects and what the conditioning describes.

Installation is the pack-standard: ComfyUI Manager search for "ComfyUI-UtilsCollection", or:

cd ComfyUI/custom_nodes
git clone https://github.com/silveroxides/ComfyUI-UtilsCollection

Its real dependencies are light (opencv-python, typing-extensions) - the weight is in the models. You need the MiniMax H3 checkpoint, the Qwen3-VL 32B text encoder (Core's Load CLIP with type minimax), and the H3 VAE. If 32B is too heavy, the pack's UC_MiniMaxH3ClipProjectionPatcher lets you use a 4B or 8B Qwen3-VL with a small projection file in ComfyUI/models/clip_projections/ instead. And before you go far: H3's license geofences out the US, EU, UK, and Korea - if you're in one of those, the local weights aren't licensed to you at all, API or nothing.

Categoryadvanced/conditioning

Inputs (15)

NameTypeDefaultDescription
clipCLIPMiniMax H3 Qwen3-VL 32B text encoder (qwen3vl_32b).
vaeVAEMiniMax H3 video VAE used for connected frame anchors and native image references.
promptSTRINGRaw MiniMax H3 prompt. Picture labels are supplied by Core from the connected image roles.
widthINT134432–16384
heightINT76832–16384
lengthINT1245–3600Frame count at 24 fps, snapped upward to MiniMax H3's 17k+5 temporal grid.
multiplierFLOAT1.0-1000–1000Scales the final Qwen conditioning and pooled output; does not alter VAE keyframes or the H3 latent.
ref_image_sizeCOMBOmatchMatch limits each native reference to the generation pixel area; max limits its short edge to 2048 pixels. None keeps frame and reference inputs as Qwen pictures but skips native VAE keyframe and reference conditioning. All image sizing preserves aspect ratio; final 32-pixel alignment can marginally enlarge a dimension.
vlm_resolutionINT3840–4096Equivalent-square Qwen3-VL target from 256 to 3584. Values outside that range preserve the original image resolution. This is independent of VAE frame and reference sizing.
first_frameoptIMAGEOptional frame-zero VAE anchor and the first numbered Qwen picture.
last_frameoptIMAGEOptional final-frame VAE anchor and the next numbered Qwen picture.
visual_fusion_configoptVISUAL_FUSION_CONFIGOptional spatial method. With frame inputs, fusion_image_1 targets Picture 1 and fusion_image_2 targets Picture 2; disconnected or off keeps fusion images as separate numbered Qwen pictures outside native-reference mode. See fusion_images for the complete routing contract.
reference_imagesoptCOMFY_AUTOGROW_V3Ordered native H3 references and numbered Qwen pictures. This mode cannot be combined with explicit first/last frame inputs. See fusion_images for supported reference-picture fusion.
fusion_imagesoptCOMFY_AUTOGROW_V3Qwen-only fusion contract. Active method: with frames, socket N targets Picture N and every batch item is another source; an unmatched socket errors. With native references, one image on fusion_image_1 broadcasts to every reference Picture; otherwise flattened fusion images pair by index and extras beyond the reference count are ignored. Without frames or references, all fusion images combine into Picture 1. Method off keeps them as separate Pictures, except native-reference mode ignores them. Video blocks are never fusion targets.
media_configoptMINIMAX_H3_MEDIA_CONFIGAdds a Qwen-only Video after existing Pictures and optional native audio. It creates no native video latent and excludes Video blocks from fusion; active mixed-media fusion requires grid-deepstack.

Outputs (2)

NameTypeDescription
positiveCONDITIONING
LATENTLATENT