ComfyUI Node

Get LLM Response

Get response from the provided llama.cpp model

By 5agado·Created 11 months ago·Updated 2 months ago· 0
Get LLM Response
  • model
  • response_message
  • full_response
prompt
system_promptYou are a helpful assistant.
temperature0.6
max_tokens2048
top_p0.95
seed42
image_path
image_base64
CategorySagado-Nodes

Inputs (9)

NameTypeDefaultDescription
modelMODEL
promptSTRING
system_promptSTRINGYou are a helpful assistant.
temperatureFLOAT0.60–1
max_tokensINT2048-1–32000
top_pFLOAT0.950–1
seedINT42
image_pathoptSTRING
image_base64optSTRING

Outputs (2)

NameTypeDescription
response_messageSTRING
full_responseSTRING