ComfyUI Node
API Chat
A ComfyUI node in LLM with 10 inputs and 1 output.
API Chat
- client_info
- images
- extra_parameters
- response
◄system_promptYou are a helpful assistant.►
◄user_promptHello world!►
◄temperature1.0►
◄top_p0.9►
◄top_k40►
◄max_tokens1024►
◄unload_model_after_chattrue►
CategoryLLM
Inputs (10)
| Name | Type | Default | Description |
|---|---|---|---|
| client_info | CLIENT_INFO | The LLM client info. | |
| system_prompt | STRING | You are a helpful assistant. | The system prompt for the LLM model. |
| user_prompt | STRING | Hello world! | The system prompt for the LLM model. |
| temperature | FLOAT | 1.00–2 | The temperature parameter for the LLM model. |
| top_p | FLOAT | 0.90–2 | The top_p parameter for the LLM model. |
| top_k | INT | 401–99 | The top_k parameter for the LLM model. Only Ollama is supported. |
| max_tokens | INT | 10241–1000000 | The max_tokens for the LLM model. |
| unload_model_after_chat | BOOLEAN | true | Whether to unload the LLM model after the chat. Only Ollama is supported. |
| imagesopt | IMAGE | The images for the LLM model. | |
| extra_parametersopt | EXTRA_PARAMETERS | The extra parameters for the LLM model. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| response | STRING | — |