ComfyUI Extension
comfyui_davcha_llm
vLLM nodes for comfyui using llama-cpp-python
dchatel/comfyui_davcha_llm
Nodes—
On cloudLocal install
Stars1
Updateda day ago
Readme
comfyui_davcha_llm
vLLM nodes for comfyui using llama-cpp-python
Please install llama-cpp-python with cuda enabled. Can be found here for windows: https://github.com/dougeeai/llama-cpp-python-wheels