comfyui_davcha_llm

vLLM nodes for comfyui using llama-cpp-python

By dchatel·Created 6 months ago·Updated 2 months ago· 3

dchatel/comfyui_davcha_llm

Nodes—

On cloudLocal install

Stars3

Updated2 months ago

Readme

vLLM nodes for comfyui using llama-cpp-python

Please install llama-cpp-python with cuda enabled. Can be found here for windows: https://github.com/dougeeai/llama-cpp-python-wheels