ComfyUI LatentSync (Unofficial Support)

Unofficial LatentSync support for ComfyUI.

Important Updates

• 2024/12/31: Added ComfyUI nodes and workflow examples

Example Workflow

This workflow shows the basic usage.

Installation

• Install from ComfyUI Manager (search for latentsync, make sure ffmpeg is installed)

• Download or git clone this repository into the ComfyUI/custom_nodes/ directory and run:

sudo apt install ffmpeg
sudo apt -y install libgl1
pip install -r requirements.txt

Download Checkpoints

All models will be downloaded automatically, if not, try download from HuggingFace repo, the checkpoints should appear as follows:

./checkpoints/
|-- latentsync_unet.pt
|-- whisper
|   `-- tiny.pt