ComfyUI Node
LUNA VLM Loader (GGUF)
A ComfyUI node in LUNA/VLM with 5 inputs and 1 output.
LUNA VLM Loader (GGUF)
- llm_model
◄model_path▾►
◄gpu_index0►
◄n_ctx2048►
◄n_gpu_layers-1►
◄mmproj_path▾►
CategoryLUNA/VLM
Inputs (5)
| Name | Type | Default | Description |
|---|---|---|---|
| model_path | COMBO | GGUF model file — auto-downloaded from HuggingFace if missing | |
| gpu_index | INT | 00–7 | CUDA device index for the LLM |
| n_ctx | INT | 2048512–32768 | Context window size in tokens |
| n_gpu_layers | INT | -1-1–200 | -1 = offload all layers to GPU |
| mmproj_pathopt | COMBO | mmproj file for vision (VLM Chat). Auto-downloaded if missing. |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| llm_model | LLM_MODEL | — |