ComfyUI Node
llama.cpp Connection
Creates a reusable llama-server connection profile while keeping API-key values out of saved workflows.
llama.cpp Connection
- connection
◄server_url►
◄model►
◄api_key_envLLAMACPP_API_KEY►
◄verify_tlstrue►
◄request_timeout300►
CategoryLlamaCpp
Inputs (5)
| Name | Type | Default | Description |
|---|---|---|---|
| server_url | STRING | Local or remote llama-server URL, or empty for the managed server. Attached endpoints are never implicitly stopped. | |
| modelopt | STRING | Optional default router model ID. | |
| api_key_envopt | STRING | LLAMACPP_API_KEY | Environment variable containing the API key. |
| verify_tlsopt | BOOLEAN | true | Verify HTTPS certificates. |
| request_timeoutopt | INT | 3001–86400 | Overall request deadline in seconds. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| connection | LLAMACPP_CONNECTION | Reusable secret-free llama-server connection profile. |