Nodes/comfyui-minimax-h3-audio-T8/MiniMax H3 Scheduled Drive Audio Injection (T8 Advanced)
ComfyUI Node

MiniMax H3 Scheduled Drive Audio Injection (T8 Advanced)

Inject your drive audio into H3's denoise window, on schedule

By T8mars·Created 2 months ago·Updated about 8 hours ago· 1,158
MiniMax H3 Scheduled Drive Audio Injection (T8 Advanced)
  • model
  • av_latent
  • drive_audio
  • audio_vae
  • final_audio
  • model
  • sampler
  • sigmas
  • av_latent
  • mux_audio
  • report_json
◄steps4►
◄shift_video12.00►
◄shift_audio3.00►
◄modereport_only►
◄start_percent0.00►
◄end_percent1.00►
◄strength1.00►
◄envelopeconstant►
◄injection_seed0►
◄lock_final_audiofalse►
◄allow_unverified_patch_stackfalse►
◄schedulernative_flow►

H3 can take an audio track as a drive - a conditioning signal that steers the joint generation - but how hard that drive bites depends on when during denoising it's applied. This is an experimental dual-clock sampler that repeatedly re-anchors your complete drive-audio latent onto its own sigma path, across a window you control. Instead of the drive being a one-time setup baked in at the start, it keeps getting re-presented to the model as the noise schedule progresses, which is a stronger and different lever than stock behavior.

Read the name carefully: drive audio, not source audio, and not a mix. It doesn't isolate speech from music or effects - the whole supplied audio latent gets anchored, warts and all. If you want your original dialogue preserved bit-for-bit, the README points elsewhere (lock_source/mux_audio routes). This node is for when you want the audio to influence generation more aggressively.

How it works and the inputs that matter

It's a sampler factory: feed it model, the nested av_latent, the drive_audio (AUDIO), and an audio_vae to encode it, and it returns model, sampler, sigmas for a KSampler plus the processed av_latent and a mux_audio output.

The controls that actually matter:

  • mode - report_only (default) is an unchanged dual-clock bypass. Injection only happens when you switch out of it. This is the pack's standard "opt in or the node is a no-op" pattern.
  • start_percent / end_percent - the injection window across the denoise. 0 is the first/high-noise step, 1 is the last/low-noise step. Default full range 0→1; shrink it to inject only early (structure) or only late (detail).
  • strength (1) and envelope (constant) - how hard, and whether that strength ramps.
  • injection_seed - independent seed for the re-noise at each anchor.
  • lock_final_audio - if true, replaces the final generated audio latent with the encoded drive audio. The tooltip is blunt: for unchanged source PCM, use mux_audio, not this.
  • allow_unverified_patch_stack - false by default; it blocks combinations of patches that haven't passed the validation matrix. Leave it off.
  • optional scheduler (native_flow default) and final_audio.

Installing and the honest take

Part of T8mars MiniMax H3 Audio T8:

cd ComfyUI/custom_nodes
git clone https://github.com/T8mars/comfyui-minimax-h3-audio-T8

or ComfyUI Manager → "MiniMax H3 Audio T8", restart. No pip deps; it runs on your existing model/VAE.

Honestly, treat this as a power-user experiment. The default is a clean bypass, so you can drop it in, confirm your existing workflow is untouched, then start tightening the window. Where it's interesting is on a clip whose audio feel keeps drifting from the reference - re-anchoring mid-denoise is a real difference from one-shot conditioning. Where it will bite: lock_final_audio sounds like the easy win but can fight the video side, and stacking it with other experimental patches is what allow_unverified_patch_stack is there to stop. Start with report_only, then a window like 0→0.6, and judge by ear.

CategoryT8/MiniMax H3/Audio/Experimental

Inputs (17)

NameTypeDefaultDescription
modelMODEL—
av_latentLATENT—
drive_audioAUDIO—
audio_vaeVAE—
stepsINT41–1000—
shift_videoFLOAT12.000.01–100—
shift_audioFLOAT3.000.01–100—
modeCOMBOreport_only2 options: report_only, scheduled_injection
start_percentFLOAT0.000–10 is the first/high-noise denoise step.
end_percentFLOAT1.000–11 is the last/low-noise denoise step.
strengthFLOAT1.000–1—
envelopeCOMBOconstant3 options: constant, fade_out, fade_in
injection_seedINT00–9223372036854776000—
lock_final_audioBOOLEANfalseReplace final generated audio latent with encoded drive audio. Use mux_audio for unchanged source PCM.
allow_unverified_patch_stackBOOLEANfalseAllow patches_replace/LongVideo/MultiKeyframe combinations that have not passed the Scheduled Audio validation matrix.
scheduleroptCOMBOnative_flow11 options: native_flow, beta57, simple, sgm_uniform, karras, exponential, +5
final_audiooptAUDIO—

Outputs (6)

NameTypeDescription
modelMODEL—
samplerSAMPLER—
sigmasSIGMAS—
av_latentLATENT—
mux_audioAUDIO—
report_jsonSTRING—