ComfyUI Node: Call LLM Advanced

Authored by daniel-lewis-ab

Created

Updated

44 stars

Category

LLM

Inputs

LLM LLM
prompt STRING
suffix STRING
max_response_tokens INT
temperature FLOAT
top_p FLOAT
min_p FLOAT
typical_p FLOAT
echo BOOLEAN
frequency_penalty FLOAT
presence_penalty FLOAT
repeat_penalty FLOAT
top_k INT
seed INT
tfs_z FLOAT
mirostat_mode INT
mirostat_tau FLOAT
mirostat_eta FLOAT

Outputs

STRING

Extension: ComfyUI-Llama

This is a set of nodes to interact with llama-cpp-python

Authored by daniel-lewis-ab

Run ComfyUI workflows in the Cloud!

No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

Learn more