ComfyUI Node
[llama.cpp] Hardware Runtime Profile
Bundles K/V cache type, offload, CPU, attention, and mmap settings.
[llama.cpp] Hardware Runtime Profile
- hardware profile
◄gpu_layersauto►
◄type_kFP16►
◄type_vFP16►
◄main_gpu0►
◄n_threads0►
◄flash_attentionauto►
◄use_mmaptrue►
Categoryllama_cpp/profile
Inputs (7)
| Name | Type | Default | Description |
|---|---|---|---|
| gpu_layers | COMBO | auto | 3 options: all, auto, cpu |
| type_k | COMBO | FP16 | Data type for the key (K) cache. |
| type_v | COMBO | FP16 | Data type for the value (V) cache. |
| main_gpu | INT | 00–31 | — |
| n_threads | INT | 00–1024 | — |
| flash_attention | COMBO | auto | 3 options: auto, enabled, disabled |
| use_mmap | BOOLEAN | true | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| hardware profile | OLLAMA_IMAGE_LIST_LLAMA_CPP_HARDWARE_RUNTIME_PROFILE | — |