ComfyUI Node
MinusZone - LLamaCPPOptions
A ComfyUI node in MinusZone - Prompt/others with 21 inputs and 1 output.
MinusZone - LLamaCPPOptions
- llama_cpp_options
◄n_ctx2048►
◄n_batch2048►
◄n_threads0►
◄n_threads_batch0►
◄split_modeLLAMA_SPLIT_MODE_NONE►
◄main_gpu0►
◄n_gpu_layers-1►
◄max_tokens4096►
◄temperature1.60►
◄top_p0.95►
◄min_p0.05►
◄typical_p1.00►
◄stop►
◄frequency_penalty0.00►
◄presence_penalty0.00►
◄repeat_penalty1.10►
◄top_k50►
◄tfs_z1.00►
◄mirostat_modenone►
◄mirostat_tau5.00►
◄mirostat_eta0.10►
CategoryMinusZone - Prompt/others
Inputs (21)
| Name | Type | Default | Description |
|---|---|---|---|
| n_ctx | INT | 2048-18446744073709550000–18446744073709550000 | — |
| n_batch | INT | 2048-18446744073709550000–18446744073709550000 | — |
| n_threads | INT | 0-18446744073709550000–18446744073709550000 | — |
| n_threads_batch | INT | 0-18446744073709550000–18446744073709550000 | — |
| split_mode | COMBO | LLAMA_SPLIT_MODE_NONE | 3 options: LLAMA_SPLIT_MODE_NONE, LLAMA_SPLIT_MODE_LAYER, LLAMA_SPLIT_MODE_ROW |
| main_gpu | INT | 0-18446744073709550000–18446744073709550000 | — |
| n_gpu_layers | INT | -1-18446744073709550000–18446744073709550000 | — |
| max_tokens | INT | 4096-18446744073709550000–18446744073709550000 | — |
| temperature | FLOAT | 1.60-18446744073709550000–18446744073709550000 | — |
| top_p | FLOAT | 0.95-18446744073709550000–18446744073709550000 | — |
| min_p | FLOAT | 0.05-18446744073709550000–18446744073709550000 | — |
| typical_p | FLOAT | 1.00-18446744073709550000–18446744073709550000 | — |
| stop | STRING | — | |
| frequency_penalty | FLOAT | 0.00-18446744073709550000–18446744073709550000 | — |
| presence_penalty | FLOAT | 0.00-18446744073709550000–18446744073709550000 | — |
| repeat_penalty | FLOAT | 1.10-18446744073709550000–18446744073709550000 | — |
| top_k | INT | 50-18446744073709550000–18446744073709550000 | — |
| tfs_z | FLOAT | 1.00-18446744073709550000–18446744073709550000 | — |
| mirostat_mode | COMBO | none | 3 options: none, mirostat, mirostat_v2 |
| mirostat_tau | FLOAT | 5.00-18446744073709550000–18446744073709550000 | — |
| mirostat_eta | FLOAT | 0.10-18446744073709550000–18446744073709550000 | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| llama_cpp_options | LLamaCPPOptions | — |