Nodes/ComfyUI-Tlant-Toolkit/Llama Server Chat/Vision (Tlant)
ComfyUI Node

Llama Server Chat/Vision (Tlant)

A ComfyUI node in Tlant Toolkit/LLM with 24 inputs and 3 outputs.

By Tlant·Created 2 months ago·Updated 6 days ago· 0
Llama Server Chat/Vision (Tlant)
  • images
  • text
  • raw_json
  • status
server_urlhttp://127.0.0.1:18080
endpoint/v1/chat/completions
modeldefault
system_prompt
prompt请用中文描述这张图片。
max_tokens512
temperature0.20
top_p0.95
top_k40
min_p0.05
repeat_penalty1.05
presence_penalty0.00
frequency_penalty0.00
seed-1
stop
response_formattext
image_formatpng
jpeg_quality92
max_images1
timeout_seconds300
api_key
extra_json
unload_afterfalse
CategoryTlant Toolkit/LLM

Inputs (24)

NameTypeDefaultDescription
server_urlSTRINGhttp://127.0.0.1:18080
endpointSTRING/v1/chat/completions
modelSTRINGdefault
system_promptSTRING
promptSTRING请用中文描述这张图片。
max_tokensINT5121–32768
temperatureFLOAT0.200–2
top_pFLOAT0.950–1
top_kINT400–1000
min_pFLOAT0.050–1
repeat_penaltyFLOAT1.050–3
presence_penaltyFLOAT0.00-2–2
frequency_penaltyFLOAT0.00-2–2
seedINT-1-1–18446744073709550000
stopSTRING
response_formatCOMBOtext2 options: text, json_object
image_formatCOMBOpng2 options: png, jpeg
jpeg_qualityINT921–100
max_imagesINT11–64
timeout_secondsFLOAT3001–3600
api_keySTRING
extra_jsonSTRING
unload_afterBOOLEANfalse
imagesoptIMAGE

Outputs (3)

NameTypeDescription
textSTRING
raw_jsonSTRING
statusSTRING