Nodes/ComfyUI Griptape Nodes/Griptape Agent Config: OpenAI Compatible Drivers
ComfyUI Node

Griptape Agent Config: OpenAI Compatible Drivers

One config that points Griptape at any OpenAI-compatible API

By griptape-ai·Created 2 years ago·Updated about a year ago· 238
Griptape Agent Config: OpenAI Compatible Drivers
    • CONFIG
    prompt_model_commentPrompt Driver
    modelgpt-4o
    max_attempts_on_fail2
    temperature0.10
    seed10342349342
    use_native_toolstrue
    max_tokens-1
    min_p0.10
    response_formatdefault
    api_key_env_varOPENAI_API_KEY
    base_urlhttps://api.openai.com/v1
    image_generation_model_commentImage Generation Driver
    image_generation_modeldall-e-3
    size1024x1024
    embedding_model_commentEmbedding Driver
    embedding_modeltext-embedding-3-small
    text_to_speech_model_commentText To Speech Driver
    text_to_speech_modeltts-1
    voicealloy
    audio_transcription_model_commentAudio Transcription Driver
    audio_transcription_modelwhisper-1

    This is the config node that quietly does the most work in the whole pack, because it's the one you point at anything that speaks OpenAI's API dialect. The OpenAI Drivers config is hard-wired to api.openai.com. This one isn't. Change base_url and suddenly your Griptape agent is talking to a local LM Studio server, a vLLM instance, a llama.cpp server, Groq, Together, or some random proxy that's OpenAI-compatible. In 2026 that's nearly every LLM server that matters, which makes this the config to reach for when you don't want to be locked to one provider.

    How it works

    It builds the same style of DriversConfig as the flagship OpenAI node - prompt, image generation, embedding, text-to-speech, and audio transcription drivers - but every driver talks to the base_url you supply instead of a fixed endpoint. api_key_env_var still defaults to OPENAI_API_KEY, so the key handling matches everything else in the pack: put the key in ComfyUI Settings → Griptape, or in the environment, and the node resolves the name you typed.

    That one base_url field is the whole trick. Set it to https://api.openai.com/v1 and you've basically rebuilt the OpenAI Drivers config. Set it to http://127.0.0.1:1234/v1 with LM Studio running and you're fully local.

    The inputs that matter

    • base_url (default https://api.openai.com/v1) - the server you're pointing at. This is the input you'll actually change.
    • model (default gpt-4o) - the prompt model name the target server recognizes.
    • api_key_env_var (default OPENAI_API_KEY) - env var / settings key name. Most local servers accept any junk key or none.
    • image_generation_model + size, text_to_speech_model + voice, audio_transcription_model, and embedding_model - the per-capability drivers, all optional.

    Plus the shared set: temperature, seed, max_tokens, min_p, response_format, use_native_tools, max_attempts_on_fail. Output is a single CONFIG.

    Installing it

    Pack install is the usual: Manager → search "Griptape", or:

    cd ComfyUI/custom_nodes
    git clone https://github.com/griptape-ai/ComfyUI-Griptape
    

    Restart, done. griptape[all] and python-dotenv come along automatically. One caveat the README flags: griptape drags in a torch build that can conflict with ComfyUI's - if things break right after install, that's the first suspect.

    Common issues

    • Connection refused with a local server - the server isn't running, or the port in base_url is wrong. LM Studio's default is http://127.0.0.1:1234/v1; Ollama's OpenAI endpoint is http://127.0.0.1:11434/v1.
    • Model not found - the target server doesn't know the name you typed. On LM Studio the name has to match what's loaded; on vLLM it has to match a served model.
    • Native tools fail on local models - small local models are often flaky at LLM-native tool calling. Flip use_native_tools off and Griptape's own tool engine takes over.

    The trap to avoid: don't reach for a provider-specific config when "compatible" will do. This one node covers LM Studio, vLLM, and a dozen hosted services, so it's often the better default than committing to a single vendor's box.

    CategoryGriptape/Agent Configs

    Inputs (21)

    NameTypeDefaultDescription
    prompt_model_commentoptSTRINGPrompt Driver
    modeloptSTRINGgpt-4oThe model to use, e.g., gpt-4o
    max_attempts_on_failoptINT21–100Maximum attempts on failure
    temperatureoptFLOAT0.100–1Temperature for sampling
    seedoptINT10342349342Seed for random number generation
    use_native_toolsoptBOOLEANtrueUse native tools for the LLM.
    max_tokensoptINT-1Maximum tokens to generate. If <=0, it will use the default based on the tokenizer.
    min_poptFLOAT0.100–1Minimum probability for sampling. Lower values will be more random.
    response_formatoptCOMBOdefaultFormat of the response
    api_key_env_varoptSTRINGOPENAI_API_KEYEnter the name of the environment variable that contains the API key, not the API key itself.
    base_urloptSTRINGhttps://api.openai.com/v1Enter the base URL for the API.
    image_generation_model_commentoptSTRINGImage Generation Driver
    image_generation_modeloptCOMBOdall-e-3Select the image generation model.
    sizeoptCOMBO1024x1024Select the desired image size.
    embedding_model_commentoptSTRINGEmbedding Driver
    embedding_modeloptSTRINGtext-embedding-3-smallSelect the embedding model to use.
    text_to_speech_model_commentoptSTRINGText To Speech Driver
    text_to_speech_modeloptCOMBOtts-1Enter the text-to-speech model name.
    voiceoptCOMBOalloySelect the voice for text-to-speech.
    audio_transcription_model_commentoptSTRINGAudio Transcription Driver
    audio_transcription_modeloptCOMBOwhisper-1Select the audio transcription model to use.

    Outputs (1)

    NameTypeDescription
    CONFIGCONFIG