ComfyUI Node
Local LLM
Ask a local or OpenAI-compatible LLM endpoint and return the response text.
Local LLM
- image
- text
- model
◄endpoint_urlhttp://localhost:1234►
◄api_typeopenai_compatible►
◄modelauto►
◄prompt►
◄system_prompt►
◄api_key►
◄temperature0.70►
◄max_tokens1024►
◄timeout120►
◄unload_existing_modelsfalse►
◄force_rerunfalse►
Category🎨 DockerCPU API/Utilities
Inputs (12)
| Name | Type | Default | Description |
|---|---|---|---|
| endpoint_url | STRING | http://localhost:1234 | — |
| api_type | COMBO | openai_compatible | 2 options: openai_compatible, lmstudio_native |
| model | COMBO | auto | 1 options: auto |
| prompt | STRING | — | |
| system_prompt | STRING | — | |
| api_key | STRING | — | |
| temperature | FLOAT | 0.700–2 | — |
| max_tokens | INT | 10241–32768 | — |
| timeout | INT | 1201–3600 | — |
| unload_existing_models | BOOLEAN | false | — |
| force_rerun | BOOLEAN | false | — |
| imageopt | IMAGE | — |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| text | STRING | — |
| model | STRING | — |