ComfyUI Extension: ComfyUI-Vui

Authored by Yuan-ManX

Created

Updated

3 stars

ComfyUI-Vui is now available in ComfyUI, Vui is a llama based transformer that predicts audio tokens.

Custom Nodes (0)

    README

    ComfyUI-Vui

    ComfyUI-Vui is now available in ComfyUI, Vui is a llama based transformer that predicts audio tokens.

    Installation

    1. Make sure you have ComfyUI installed

    2. Clone this repository into your ComfyUI's custom_nodes directory:

    cd ComfyUI/custom_nodes
git clone https://github.com/Yuan-ManX/ComfyUI-Vui.git
    1. Install dependencies:
    cd ComfyUI-Vui
pip install -r requirements.txt

    Model

    Download Pretrained Models

    Vui Pretrained Models

    1. Vui.BASE is base checkpoint trained on 40k hours of audio conversations

    2. Vui.ABRAHAM is a single speaker model that can reply with context awareness.

    3. Vui.COHOST is checkpoint with two speakers that can talk to each other.