Extensions/ComfyUI_LiteLLM
ComfyUI Extension

ComfyUI_LiteLLM

Nodes for calling LLMs, enabled by LiteLLM

By Hopping-Mad-Games·Created 2 years ago·Updated 11 months ago· 7
Hopping-Mad-Games/ComfyUI_LiteLLM
Nodes31
On cloudLocal install
CategoryETK/LLM/LiteLLM, sd
Stars7
Updated11 months ago

Nodes (31)

AddDataModelToLLLm

Force the LLM into a JSON schema, no matter how much it wants to ramble

ETK/LLM/LiteLLM
AgentNode

The completion node that keeps going until the answer is actually good

sd
AppendMessages

The tiny node that merges two conversations into one

ETK/LLM/LiteLLM
BasicRecursionFilterNode

Make the LLM read its own answer and try again, until the answer is better

sd
CreateReflectionFilter

Wrap any callable into a reflection filter for the completion loop

ETK/LLM/LiteLLM
DocumentChunkRecursionFilterNode

Feed a whole document to an LLM that can only swallow one chunk at a time

sd
FirstCodeBlockReflectionFilter

A filter for code-generating loops

ETK/LLM/LiteLLM
HTMLRenderer

Preview the HTML an LLM just wrote, right inside the node

ETK/LLM/LiteLLM
HTMLRendererScreenshot

Rendered HTML that comes back as an actual image in your pipeline

ETK/LLM/LiteLLM
HTMLServerLink

Serve the HTML an LLM made, and hand you a link to open it

ETK/LLM/LiteLLM
ListToMessages

Turn a plain list into the message format the LLM nodes understand

ETK/LLM/LiteLLM
LiteLLMCompletion

One node to call basically any LLM from your ComfyUI graph

ETK/LLM/LiteLLM
LiteLLMCompletionListOfPrompts

Turn a list of prompts into a list of completions in one run

ETK/LLM/LiteLLM
LiteLLMCompletionPrePend

The completion node with a system-prompt slot bolted on front

ETK/LLM/LiteLLM
LiteLLMCompletionProvider

The node that hands the rest of the pack a callable 'ask the LLM' function

ETK/LLM/LiteLLM
LitellmCompletionV2

The completion node that can also caption your images

ETK/LLM/LiteLLM
LiteLLMCompletionWithReflectionFilter

Ask the LLM, look at its answer, and ask again until it's right

ETK/LLM/LiteLLM
LiteLLMCustomEndpointProvider

Point the whole pack at any OpenAI-compatible API, including ones you run yourself

ETK/LLM/LiteLLM
LiteLLMImageCaptioningProvider

A captioning function you can hand any image from your graph

ETK/LLM/LiteLLM
LiteLLMMessage

LiteLLMMessage builds the conversation

ETK/LLM/LiteLLM
LiteLLMModelProvider

LiteLLMModelProvider is the model dropdown, warts and all

ETK/LLM/LiteLLM
LiteLLMModelProviderAdv

The model picker that tells you what you'll pay before you spend a cent

ETK/LLM/LiteLLM
LLLMInterpretUrl

LLLMInterpretUrl grabs text and links for you

ETK/LLM/LiteLLM
MarkdownNode

MarkdownNode renders Markdown while passing text through

ETK/LLM/LiteLLM
MessagesToList

MessagesToList strips the type, keeps the data

ETK/LLM/LiteLLM
MessagesToText

MessagesToText turns chat history into plain text

ETK/LLM/LiteLLM
ModifyModelKwargs

ModifyModelKwargs tweaks your model call

ETK/LLM/LiteLLM
PDFToImageNode

PDFToImageNode turns pages into images

ETK/LLM/LiteLLM
ShowLastMessage

ShowLastMessage shows the tail of your chat

ETK/LLM/LiteLLM
ShowMessages

ShowMessages prints every message on the node

ETK/LLM/LiteLLM
TextToMessages

TextToMessages parses text into chat messages

ETK/LLM/LiteLLM
Readme

Nodes for calling LLMs, enabled by LiteLLM