Nodes/comfyui-h3-audio-drive-auto/H3 Lip Sync Wav2Lip (phoneme-level mouth)
ComfyUI Node

H3 Lip Sync Wav2Lip (phoneme-level mouth)

A ComfyUI node in minimax/h3/audio with 11 inputs and 3 outputs.

By lebao-arch·Created about 22 hours ago·Updated about 17 hours ago· 0
H3 Lip Sync Wav2Lip (phoneme-level mouth)
  • images
  • audio
  • frames
  • audio
  • report
◄fps24.000►
◄checkpointwav2lip_gan.pth►
◄pads0 10 0 0►
◄resize_factor1►
◄nosmoothfalse►
◄audio_offset_frames0►
◄python_exeG:\lipsync-tools\venv-latentsync\Scripts\python.exe►
◄wav2lip_dirG:\lipsync-tools\Wav2Lip►
◄ffmpeg_dirF:\ffmpeg\ffmpeg-8.0.1-essentials_build\bin►
Categoryminimax/h3/audio

Inputs (11)

NameTypeDefaultDescription
imagesIMAGEFrames to re-synthesise. Only the mouth is replaced; face, hair and body pixels are kept.
audioAUDIOThe soundtrack to lip-sync to. Returned (optionally shifted) for the mux.
fpsFLOAT24.0001–120—
checkpointCOMBOwav2lip_gan.pthwav2lip_gan = sharper picture; wav2lip = slightly tighter lipsync and a softer mouth (both measured on this machine).
padsSTRING0 10 0 0Extra crop around the detected face: top bottom left right, in pixels.
resize_factorINT11–4Downscale before processing (1 = full resolution). 2 is faster on big frames.
nosmoothBOOLEANfalseDisable the temporal smoothing of the detected face box.
audio_offset_framesoptINT0-48–48Shifts the returned audio against the frames (same meaning as the driving nodes). Leave 0 to lip-sync in place.
python_exeoptSTRINGG:\lipsync-tools\venv-latentsync\Scripts\python.exeInterpreter that can import Wav2Lip's deps (librosa, torch, face_detection).
wav2lip_diroptSTRINGG:\lipsync-tools\Wav2LipWav2Lip checkout containing inference.py and checkpoints/.
ffmpeg_diroptSTRINGF:\ffmpeg\ffmpeg-8.0.1-essentials_build\binDirectory prepended to PATH; Wav2Lip shells out to ffmpeg for audio.

Outputs (3)

NameTypeDescription
framesIMAGE—
audioAUDIO—
reportSTRING—