Extensions/ComfyUI-llama-cpp_vlm
ComfyUI Extension

ComfyUI-llama-cpp_vlm

Run LLM/VLM models natively in ComfyUI based on llama.cpp

By lihaoyun6·Created 10 months ago·Updated 8 days ago· 532
lihaoyun6/ComfyUI-llama-cpp_vlm
Nodes—
On cloudLocal install
Stars532
Updated8 days ago
Readme

ComfyUI-llama-cpp

Run LLM/VLM models natively in ComfyUI based on llama.cpp
[📃中文版]

Preview

Installation

Install the node:

cd ComfyUI/custom_nodes
git clone https://github.com/lihaoyun6/ComfyUI-llama-cpp.git
python -m pip install -r ComfyUI-llama-cpp/requirements.txt
#For CUDA 13, please run:
#python -m pip install -r ComfyUI-llama-cpp/requirements_cu131.txt

Download models:

  • Place your model files in the ComfyUI/models/LLM folder.

    If you need a VLM model to process image input, don't forget to download the mmproj weights.

Credits