ComfyUI Node
Get LLama CPP Response
Get response from the provided llama.cpp server
Get LLama CPP Response
- response
◄prompt►
◄server_urlhttp://127.0.0.1:8080►
◄temperature0.7►
◄thinkfalse►
◄max_tokens2048►
◄top_p0.95►
◄top_k20►
◄min_p0.05►
◄repeat_penalty1.00►
◄presence_penalty0.0►
◄seed42►
◄image_path►
◄image_base64►
CategorySagado-Nodes/llm
Inputs (13)
| Name | Type | Default | Description |
|---|---|---|---|
| prompt | STRING | — | |
| server_url | STRING | http://127.0.0.1:8080 | — |
| temperature | FLOAT | 0.70–2 | — |
| think | BOOLEAN | false | — |
| max_tokens | INT | 2048-1–32000 | — |
| top_p | FLOAT | 0.950–1 | — |
| top_k | INT | 200–200 | — |
| min_p | FLOAT | 0.050–1 | — |
| repeat_penalty | FLOAT | 1.000–2 | — |
| presence_penalty | FLOAT | 0.0-2–2 | — |
| seed | INT | 42 | — |
| image_pathopt | STRING | — | |
| image_base64opt | STRING | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| response | STRING | — |