ComfyUI Node
LlamaServe-Doc Generate
通过独立 llama-server 高效推理；停止开关已集成在本节点中。
LlamaServe-Doc Generate
- server_config
- text
- performance_json
◄system_prompt►
◄user_prompt►
◄max_tokens1024►
◄temperature0.80►
◄top_k30►
◄top_p0.90►
◄min_p0.05►
◄repeat_penalty1.05►
◄seed0►
◄reasoningoff►
◄stop_server_after_generatefalse►
CategoryLlamaServe-Doc
Inputs (12)
| Name | Type | Default | Description |
|---|---|---|---|
| server_config | LLAMA_SERVER_CONFIG | — | |
| system_prompt | STRING | — | |
| user_prompt | STRING | — | |
| max_tokens | INT | 10241–32768 | — |
| temperature | FLOAT | 0.800–2 | — |
| top_k | INT | 300–200 | — |
| top_p | FLOAT | 0.900–1 | — |
| min_p | FLOAT | 0.050–1 | — |
| repeat_penalty | FLOAT | 1.050–2 | — |
| seed | INT | 0-1–9223372036854776000 | — |
| reasoning | COMBO | off | 3 options: off, auto, on |
| stop_server_after_generate | BOOLEAN | false | — |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| text | STRING | — |
| performance_json | STRING | — |