ComfyUI Node Runs on cloud
LLM Advanced (Memory Optional)
A ComfyUI node in VLM Nodes/LLM with 15 inputs and 1 output.
LLM Advanced (Memory Optional)
- STRING
◄ckpt_name▾►
◄max_ctx4096►
◄gpu_layers27►
◄n_threads8►
◄system_msgYou are a helpful AI assistant.►
◄prompt►
◄max_tokens512►
◄temperature0.10►
◄top_p0.95►
◄top_k40►
◄frequency_penalty0.00►
◄presence_penalty0.00►
◄repeat_penalty1.10►
◄seed42►
◄unloadfalse►
CategoryVLM Nodes/LLM
Inputs (15)
| Name | Type | Default | Description |
|---|---|---|---|
| ckpt_name | COMBO | 0 options: | |
| max_ctx | INT | 4096128–128000 | — |
| gpu_layers | INT | 270–100 | — |
| n_threads | INT | 81–100 | — |
| system_msg | STRING | You are a helpful AI assistant. | — |
| prompt | STRING | — | |
| max_tokens | INT | 5121–2048 | — |
| temperature | FLOAT | 0.100.01–1 | — |
| top_p | FLOAT | 0.950.1–1 | — |
| top_k | INT | 40 | — |
| frequency_penalty | FLOAT | 0.00 | — |
| presence_penalty | FLOAT | 0.00 | — |
| repeat_penalty | FLOAT | 1.10 | — |
| seed | INT | 42 | — |
| unload | BOOLEAN | false | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| STRING | STRING | — |