Nodes/ComfyUI-InoNodes/Ino Vllm Run Sync
ComfyUI Node

Ino Vllm Run Sync

Runs a synchronous vLLM inference request on Runpod serverless with optional image input.

By nobandegani·Created about a year ago·Updated 29 days ago· 5
Ino Vllm Run Sync
    • success
    • id
    • status
    • delay_time
    • execution_time
    • response
    • reasoning
    • finish_reason
    enabledtrue
    url
    api_key
    model
    user_prompt
    system_prompt
    image_url
    temperature0.7
    max_tokens1024
    timeout600
    max_polls70
    poll_delay10
    max_failed_retries10
    CategoryInoRunpodHelper

    Inputs (13)

    NameTypeDefaultDescription
    enabledBOOLEANtrue
    urlSTRING
    api_keySTRING
    modelSTRING
    user_promptSTRING
    system_promptoptSTRING
    image_urloptSTRING
    temperatureoptFLOAT0.70–2
    max_tokensoptINT10241–128000
    timeoutoptFLOAT60010–600
    max_pollsoptINT701–100
    poll_delayoptFLOAT101–60
    max_failed_retriesoptINT100–20

    Outputs (8)

    NameTypeDescription
    successBOOLEAN
    idSTRING
    statusSTRING
    delay_timeINT
    execution_timeINT
    responseSTRING
    reasoningSTRING
    finish_reasonSTRING