Nodes/ComfyUI-llamacpp-server/Llama.cpp Server Node
ComfyUI Node

Llama.cpp Server Node

A ComfyUI node in Llama-cpp with 14 inputs and 2 outputs.

By Localsmile·Created 2 months ago·Updated 2 months ago· 0
Llama.cpp Server Node
  • images
  • result
  • thinking
urlhttp://127.0.0.1:8080
model
system_promptYou are a helpful AI assistant.
user_requestHello!
seed0
keep_alive0
keep_alive_unit
reset_sessiontrue
temperature1.00
top_p0.95
top_k64
max_tokens2048
repeat_penalty1.00
CategoryLlama-cpp

Inputs (14)

NameTypeDefaultDescription
urlSTRINGhttp://127.0.0.1:8080
modelCOMBO1 options: Auto (Detect Active Model)
system_promptSTRINGYou are a helpful AI assistant.
user_requestSTRINGHello!
seedINT00–18446744073709550000
keep_aliveINT00–43200
keep_alive_unitCOMBO2 options: minutes, hours
reset_sessionBOOLEANtrue
imagesoptIMAGE
temperatureoptFLOAT1.000–2
top_poptFLOAT0.950–1
top_koptINT640–1000
max_tokensoptINT20480–32768
repeat_penaltyoptFLOAT1.000–10

Outputs (2)

NameTypeDescription
resultSTRING
thinkingSTRING