Nodes/ComfyUI-llama-multimodal/[llama.cpp] Connect Session
ComfyUI Node

[llama.cpp] Connect Session

Creates a session handle for a llama.cpp server. Connect fetches model IDs; the saved model string remains the value used for generation.

By craftingmod·Created 2 months ago·Updated 4 days ago· 3
[llama.cpp] Connect Session
    • session
    ◄urlhttp://127.0.0.1:9931►
    ◄available_models►
    ◄model►
    ◄api_key►
    Categoryllama_cpp/session

    Inputs (4)

    NameTypeDefaultDescription
    urlSTRINGhttp://127.0.0.1:9931llama.cpp server base URL. Only HTTP and HTTPS are accepted.
    available_modelsCOMBOModels reported by the configured llama.cpp server.
    modelSTRINGSaved model ID used for generation. Selecting available_models copies its ID here.
    api_keySTRINGOptional API key for the configured llama.cpp server.

    Outputs (1)

    NameTypeDescription
    sessionOLLAMA_IMAGE_LIST_LLAMA_CPP_SESSION—