Nodes/ComfyUI-UtilsCollection/Adv MiniMax H3 Image to Video (Temporal TokenFusion)
ComfyUI Node

Adv MiniMax H3 Image to Video (Temporal TokenFusion)

MiniMax H3 temporal density, fused before the Qwen encode (the VRAM-savvy twin)

By silveroxides·Created 3 months ago·Updated 2 days ago· 35
Adv MiniMax H3 Image to Video (Temporal TokenFusion)
  • clip
  • vae
  • first_frame
  • last_frame
  • visual_fusion_config
  • reference_images
  • media_config
  • video
  • audio
  • audio_vae
  • text_blend_config
  • positive
  • LATENT
prompt
width1344
height768
length124
multiplier1.0
ref_image_sizematch
vlm_resolution384
vlm_video_resolution384

This is the sibling to the Temporal Fusion node in the same pack, and the difference between them is one word in the name: Token. Where Temporal Fusion encodes every extra video sample lane separately with Qwen3-VL and then stitches the results together in the finished conditioning, this variant merges the video features before the encode runs - token-level fusion that needs only one Qwen pass per schedule. Same temporal density, same "ordinary video token budget" contract, roughly one big encode instead of one per lane.

Why you'd pick this one. If you've read the Fusion article you know the pitch: MiniMax H3's video encoder only sees a sample of frames, so fast motion between the samples gets invented, and the pack's temporal-density experiment fixes that by sampling offset frame "lanes" and fusing them back into the fixed token budget. The Fusion node pays for that with a full Qwen encode per lane. On the 32B Qwen3-VL text encoder that MiniMax H3 conditions through, encode passes aren't free - they're seconds and VRAM you feel. TokenFusion fuses the corresponding video features - including their DeepStack vision layers - first, and hands the merged token sequence to a single Qwen encode. If you're GPU-tight, this is the temporal node you want to try before its sibling.

Mechanically it's still grounded in the same experimental frame-sampling machinery: you set temporal_density and the consensus/spatial method on the MiniMax H3 Media Configurator (UC_MiniMaxH3MediaConfig), and density 1 is the "act like ordinary sampling" escape hatch. The configurator controls Picture timestamp formatting, video_fps, and motion guidance too, but the density field is the one this node exists for.

Inputs worth knowing.

  • clip - the Qwen3-VL 32B MiniMax H3 text encoder (qwen3vl_32b), loaded with Core's Load CLIP using type minimax. Wrong encoder, immediate error.
  • media_config - temporal density and fusion method live here; this is the switch that turns the experiment on.
  • video - the complete 24 fps frame batch the temporal lanes are drawn from.
  • length - frame count, snapped up to H3's 17k+5 temporal grid at 24 fps.
  • text_blend_config - consensus weighting for the merge (disconnected uses a default).
  • multiplier - scales the final conditioning; leave at 1.0 unless you know why you're touching it.

Frame references go through first_frame/last_frame (VAE anchors plus the first two numbered Qwen pictures) or ordered reference_images - never both, and never combined with a reference video. vlm_video_resolution trades visual tokens against encode cost; higher captures more per-frame detail.

Outputs. positive CONDITIONING for the sampler's positive socket, and LATENT for the KSampler - the standard advanced-H3 hand-off, then decode and save as usual.

Install. It ships in the same pack as its sibling, so the steps are identical: ComfyUI Manager → search ComfyUI-UtilsCollection, or

cd ComfyUI/custom_nodes
git clone https://github.com/silveroxides/ComfyUI-UtilsCollection

then restart. The pack's own deps are light (opencv-python, typing-extensions, unifiedefficientloader); the cost is the model stack - MiniMax H3 checkpoint (~42.5 GB), Qwen3-VL 32B encoder, H3 VAE - which nothing downloads for you. Same licence warning applies: the MiniMax H3 Community License excludes the EU, UK, South Korea and the US from its applicable territory.

Reality check. Both temporal nodes are experiments with zero community mileage behind them - treat results as research-grade. If density 1 doesn't reproduce your stock workflow's output, you've found a bug worth reporting rather than a quirk to route around. If you just need H3 image-to-video and your motion is fine, none of this is for you; it's for the shots where the smearing between frames is the problem and you don't want to pay a larger conditioning to fix it.

Categoryadvanced/conditioning

Inputs (19)

NameTypeDefaultDescription
clipCLIPMiniMax H3 Qwen3-VL 32B text encoder (qwen3vl_32b).
promptSTRINGRaw MiniMax H3 prompt. Picture labels are supplied by Core from the connected image roles.
widthINT134432–16384
heightINT76832–16384
lengthINT1245–3600Frame count at 24 fps, snapped upward to MiniMax H3's 17k+5 temporal grid.
multiplierFLOAT1.0-1000–1000Scales the final Qwen conditioning and pooled output; does not alter VAE keyframes or the H3 latent.
ref_image_sizeCOMBOmatchMatch limits each native reference to the generation pixel area; max limits its short edge to 2048 pixels. None keeps frame, reference, and Video inputs available to the text encoder but does not VAE-encode them. All image sizing preserves aspect ratio; final 32-pixel alignment can marginally enlarge a dimension.
vlm_resolutionINT3840–4096Equivalent-square Qwen3-VL target from 256 to 3584. Values outside that range preserve the original image resolution. This is independent of VAE frame and reference sizing.
vlm_video_resolutionINT3840–4096Qwen3-VL resolution for Video frames. Higher values use more visual tokens. Values outside 256 to 3584 preserve the input resolution.
vaeoptVAEEncodes first/last frames, reference images, and a complete Video. Not required when reference image size is none.
first_frameoptIMAGEOptional frame-zero VAE anchor and the first numbered Qwen picture.
last_frameoptIMAGEOptional final-frame VAE anchor and the next numbered Qwen picture.
visual_fusion_configoptVISUAL_FUSION_CONFIGOptional spatial method. With frame inputs, fusion_image_1 targets Picture 1 and fusion_image_2 targets Picture 2; disconnected or off keeps fusion images as separate numbered Qwen pictures outside native-reference mode. See fusion_images for the complete routing contract.
reference_imagesoptCOMFY_AUTOGROW_V3Ordered native H3 references and numbered Qwen pictures. This mode cannot be combined with explicit first/last frame inputs. See fusion_images for supported reference-picture fusion.
media_configoptMINIMAX_H3_MEDIA_CONFIGOptionally formats Picture timestamps, sets Qwen Video sampling, and controls Video motion guidance. Its default Picture constructor matches Core handling.
videooptIMAGEComplete Video frame batch at 24 fps. The configurator controls Qwen sampling and full, spaced, or disabled VAE motion guidance.
audiooptAUDIOOptional H3 reference audio. Missing audio from a video is ignored.
audio_vaeoptVAERequired only when audio is present. Skipped when audio is absent; otherwise resamples and encodes the reference audio.
text_blend_configoptTEXT_BLEND_CONFIGTemporal consensus settings. Disconnected uses custom index consensus with norm rescaling.

Outputs (2)

NameTypeDescription
positiveCONDITIONING
LATENTLATENT