Nodes/ComfyUI_LiteLLM/LiteLLMCustomEndpointProvider
ComfyUI Node

LiteLLMCustomEndpointProvider

A ComfyUI node in ETK/LLM/LiteLLM with 8 inputs and 1 output.

By Hopping-Mad-Games·Created 2 years ago·Updated 10 months ago· 7
LiteLLMCustomEndpointProvider
    • model
    model_namemistralai/Mistral-Nemo-Instruct-2407
    api_basehttps://api.kluster.ai/v1
    api_keyyour-api-key-here
    provideropenai
    api_version
    organization
    timeout60
    max_retries3
    CategoryETK/LLM/LiteLLM

    Inputs (8)

    NameTypeDefaultDescription
    model_nameSTRINGmistralai/Mistral-Nemo-Instruct-2407
    api_baseSTRINGhttps://api.kluster.ai/v1
    api_keySTRINGyour-api-key-here
    providerCOMBOopenai4 options: openai, anthropic, cohere, custom
    api_versionoptSTRING
    organizationoptSTRING
    timeoutoptINT601–300
    max_retriesoptINT30–10

    Outputs (1)

    NameTypeDescription
    modelLITELLM_MODEL