ComfyUI Extension: ComfyUI Sync Lipsync Node
This custom node allows you to perform audio-video lip synchronization inside ComfyUI using a simple interface.
Custom Nodes (0)
README
ComfyUI Sync Lipsync Node
This custom node allows you to perform audio-video lip synchronization inside ComfyUI using a simple interface.
Installation & Usage
After cloning ComfyUI and setting up a virtual environment for it, follow these steps:
-
Navigate to the custom nodes directory:
cd /path/to/ComfyUI/custom_nodes/
-
Clone this repository:
https://github.com/synchronicity-labs/sync-comfyui.git
-
Install the required dependencies:
pip install -r requirements.txt
IMPORTANT: If you want to ignore steps 2-3, just run comfy node install comfyui-sync-lipsync-node
in your /path/to/ComfyUI/custom_nodes/
-
Go back to the main ComfyUI directory and run:
cd /path/to/ComfyUI/
python main.py
-
A link will be printed in the terminal — open it in your browser to access the ComfyUI GUI.
-
In the ComfyUI interface:
- On the left sidebar, go to the Nodes tab.
- Search for Sync. You will find three sync nodes; one for input, one for generation and one for output. Connect them to each other.
- Input your video, audio, and API key. For audio and video, you can give a url or a local path as an input. The local files should be in the ComfyUI repository that you are using.
- Click Run to generate the synced output.
- It will save the video along with the job_id in a json file.
For issues or contributions, feel free to open a pull request or create an issue in this repository.