ComfyUI Node
Get LlamaCPP Model
Load a local model using llama-cpp-python and return the model object for subsequent calls
Get LlamaCPP Model
- chat_handler
- model
◄model_name►
◄models_dir_path►
◄chat_format►
◄n_ctx4094►
CategorySagado-Nodes
Inputs (5)
| Name | Type | Default | Description |
|---|---|---|---|
| model_name | STRING | — | |
| models_dir_path | STRING | — | |
| chat_format | STRING | — | |
| n_ctx | INT | 4094-1–128000 | — |
| chat_handleropt | MODEL | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| model | MODEL | — |