Extensions/Lip Service
ComfyUI Extension

Lip Service

Lip Service in ComfyUI: voices that say text and sing scores, on the CPU, as AUDIO.

By gileshall·Created a day ago·Updated a day ago· 0
gileshall/comfyui-lipservice
Nodes—
On cloudLocal install
Stars0
Updateda day ago
Readme

Lip Service for ComfyUI

Voices that say text and sing scores, made on the CPU by Lip Service, as ComfyUI AUDIO: mono, 24 kHz. They go straight into Preview Audio, Save Audio or any node that takes audio.

Install

Search for Lip Service in ComfyUI's Manager, or from the command line:

comfy node install comfyui-lipservice

By hand: clone this repository into ComfyUI's custom_nodes, install its one requirement into ComfyUI's Python, and restart ComfyUI:

pip install -r requirements.txt

The first run fetches the models, about 56 MB for hifi, from models.lipservice.dev into the lipservice package's own cache (LIPSERVICE_CACHE moves it). The voice list is read from the package when ComfyUI starts. macOS and Linux.

Nodes

Lip Service Say says text. Lip Service Sing sings a score. Each is the package's say or sing, every parameter with its default; hover an input for what it does. The seed stays fixed after a run, so a change is heard on the same take; set its control to randomize for a new take each run.

What the engine refuses, a miscounted word or a note it cannot read, stops the run with the engine's own words. The samples are handed on exactly as the package returns them.

A score

A word a line, and a note for each of its syllables:

bpm 90
amazing D4:1 G4:2 B4:0.5+G4:0.5
grace B4:2
rest 1
how A4:1
sweet G4:2

NOTE:BEATS with the note as C4, F#3, Bb2 or a MIDI number; + joins notes on one syllable; rest BEATS is silence; bpm N is the tempo, once. The whole format is SCORE.md.

Examples

example_workflows/ has a say and a sing, each to Preview Audio and Save Audio. ComfyUI lists them among its templates.

Tests

From a Python that imports ComfyUI's folder (comfy_api) and has lipservice installed:

python -m pytest tests
python tests/e2e.py --comfyui COMFYUI_DIR --base SCRATCH_DIR

The first checks the nodes' samples bit for bit against the package's; the second runs the examples on a headless ComfyUI (see its docstring).

License

AGPL-3.0-only, as Lip Service.