ComfyUI Node: LlamaCPP Options

Authored by pointave

Created

Updated

2 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

LlamaCPP API

Inputs

enable_seed BOOLEAN
seed INT
enable_num_ctx BOOLEAN
num_ctx INT
enable_repeat_last_n BOOLEAN
repeat_last_n INT
enable_repeat_penalty BOOLEAN
repeat_penalty FLOAT
enable_temperature BOOLEAN
temperature FLOAT
enable_stop BOOLEAN
stop STRING
enable_top_k BOOLEAN
top_k INT
enable_top_p BOOLEAN
top_p FLOAT
enable_min_p BOOLEAN
min_p FLOAT
enable_main_gpu BOOLEAN
main_gpu INT
enable_thinking_budget BOOLEAN
thinking_budget INT
video_frame_step INT
video_max_frames INT
audio_max_seconds FLOAT
debug BOOLEAN

Outputs

LLAMACPP_OPTIONS

Extension: comfyui-llamacpp-plus

Access llama.cpp server, plus ease-of-life functionality

Authored by pointave

Looking for a different node?

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more