MiniMax H3 Audio Reroll (Experimental) / 音频重生成(实验性)
Re-score a MiniMax H3 clip without re-authoring the picture (read the fine print)
- conditioning
- av_latent
- positive
- latent
- video_passthrough
- info
Here's the problem this node exists to solve. MiniMax H3 samples video and audio in one loop, so if you don't like the score, changing the soundscape text means regenerating the entire clip - and with it the whole visual lottery: framing, performance, lip-sync. There's no official "reuse this picture, new sound" workflow. Audio Reroll is an experimental attempt to build one on top of machinery H3 already has.
How it works
H3 can't freeze half of a jointly-denoised pack mid-sampling, but it does have reference conditioning - the same mechanism used for keyframes and image references. The node takes your finished video latent and hands it back to the DiT as a whole-clip video reference with video_cond_strength at 1.0. At that setting the reference enters completely un-noised and the model treats it as "already clean, take it as given." The audio stream starts from zeros (if reset_audio_latent is on), so the sampler writes a genuinely new track against a strongly-conditioned picture.
Inputs: conditioning (from the same H3 conditioning node as the original run, with the soundscape/music text changed), av_latent (the finished run whose picture you want), video_cond_strength (default 1.0 - lower lets the picture drift), and reset_audio_latent (default on; off biases toward the original track).
Outputs: positive conditioning, the new latent, video_passthrough (the original video stream, bit-identical), and an info string.
The fine print - read this before you queue
The pack's own measured findings are refreshingly honest, and they matter:
- The picture is strongly preserved, not frozen. The test measured 43.6 dB PSNR between reroll and original - very close, on the order of a lossy re-encode. Good, but not identical.
- It's slower than generating from scratch. Feeding the whole clip back as a reference doubles the sequence length, and attention is quadratic. Measured: 26 s/it for the original run, 63 s/it for the reroll - about 2.4×. The packed reference tokens ride along on every sampling step.
- It requires the
ref2vacheckpoint path. Thefl2vaconditioning node has nominimax_refspath, so this node won't work without ref2va weights. - Validation is one clip, one seed. The preservation numbers describe that one experiment; your mileage is genuinely unmeasured.
So the honest use case is when identity matters more than time: you nailed the performance and framing, the dialogue and lip-sync are right, and you only want a different ambience or score underneath. If you just want a cheap audio variation, this is the wrong tool - regenerate at a fixed seed, or skip the DiT entirely.
The bit-identical alternative
If you need the original frames byte-for-byte, don't re-sample at all. Take the video_passthrough output, decode it, and mux the new audio over it downstream - that's one VAE decode and one audio decode, seconds instead of minutes. The trade-off: the new audio was generated without seeing the video, so it won't lip-sync to existing dialogue. Use it for ambience and score, not for speech.
Install
Part of the MiniMax-H3 Tools pack (ComfyUI 0.30.0+). Search "MiniMax H3 Tools" in ComfyUI Manager, or:
cd ComfyUI/custom_nodes
git clone https://github.com/Rinne414/ComfyUI-MiniMaxH3-Tools.git
Restart ComfyUI, find MiniMax H3 Audio Reroll (Experimental) under MiniMax H3. No extra dependencies for the node itself - but it does nothing until you have a full H3 stack loaded (model, text encoder, both VAEs), and the ref2va weights specifically.
Inputs (4)
| Name | Type | Default | Description |
|---|---|---|---|
| conditioning | CONDITIONING | Conditioning from an H3 conditioning node, with the soundscape/music text changed. / 来自 H3 条件节点的条件,其中环境音或音乐文字已经修改。 | |
| av_latent | LATENT | The AV latent from the run whose picture you want to keep. / 需要保留画面的原始运行所产生的音视频潜空间。 | |
| video_cond_strength | FLOAT | 1.0000.5–1 | Noise augmentation on the video reference. 1.0 feeds it perfectly clean for maximum preservation; lower values let the picture drift. The DiT keyframe default is 0.999. / 视频参考的噪声增强值。1.0 表示完全干净并最大程度保留画面;较低值会允许画面变化。DiT 的关键帧默认值为 0.999。 |
| reset_audio_latent | BOOLEAN | true | Start the audio stream from zeros so the sampler writes a genuinely new track. Off reuses the old audio latent and biases the result toward the original. / 从零开始音频流,让采样器生成全新音轨;关闭时复用旧音频潜空间,结果会偏向原音轨。 |
Outputs (4)
| Name | Type | Description |
|---|---|---|
| positive | CONDITIONING | — |
| latent | LATENT | — |
| video_passthrough | LATENT | — |
| info | STRING | — |