Nodes/Parametric Studio/PSN LLM Offloader
ComfyUI Node

PSN LLM Offloader

Builds offload commands and parses responses for LLM VRAM offloading.

By parametricparadigm·Created 4 days ago·Updated about 3 hours ago· 1
PSN LLM Offloader
    • offload_status
    • freed_vram
    • api_payload
    ◄triggerfalse►
    ◄offload_target▾►
    ◄model_iddefault►
    ◄api_response►
    ◄last_trigger_time0.000►
    CategoryParametric/Agents

    Inputs (5)

    NameTypeDefaultDescription
    triggerBOOLEANfalseTrigger. Default False.
    offload_targetCOMBOOffload target. One of 2 choices.
    model_idoptSTRINGdefaultModel id. Default default.
    api_responseoptSTRINGApi response.
    last_trigger_timeoptFLOAT0.0000–1000000000000Last trigger time. From 0 to 1e+12. Default 0.0.

    Outputs (3)

    NameTypeDescription
    offload_statusSTRING—
    freed_vramFLOAT—
    api_payloadSTRING—