Nodes/Prompt Translator & Enhancer/Load LLM Model (GGUF)
ComfyUI Node

Load LLM Model (GGUF)

Loads a GGUF language model for prompt enhancement. Place .gguf files in ComfyUI/models/LLM/

By ezetojo·Created 6 months ago·Updated 6 months ago· 0
Load LLM Model (GGUF)
    • llm_model
    llm_modelno_models_found
    n_gpu_layers-1
    n_ctx4096
    CategoryLLM/Prompt Enhancement

    Inputs (3)

    NameTypeDefaultDescription
    llm_modelCOMBOno_models_found1 options: no_models_found
    n_gpu_layersINT-1-1–100Number of layers to offload to GPU. -1 = all layers.
    n_ctxINT4096512–32768Context window size in tokens. Qwen3 supports up to 40960.

    Outputs (1)

    NameTypeDescription
    llm_modelLLM_MODEL