Nodes/ComfyUI-llama-multimodal/[llama.cpp] Decide
ComfyUI Node

[llama.cpp] Decide

Scores letter-token choices with a Native Session prefill or a Runtime or Connect Session's constrained llama-server completion. Optional media is added to the context; question and answers remain text-only.

By craftingmod·Created 2 months ago·Updated 4 days ago· 3
[llama.cpp] Decide
  • session
  • question
  • images
  • audio
  • video
  • model_profile
  • selected
  • probabilities_json
  • metrics
  • media_diagnostics
  • session
◄system►
◄context►
◄video_with_audiofalse►
◄seed-1►
◄session_unloadfalse►
Categoryllama_cpp/decision

Inputs (11)

NameTypeDefaultDescription
sessionOLLAMA_IMAGE_LIST_LLAMA_CPP_SESSION—
systemSTRING—
contextSTRING—
questionOLLAMA_IMAGE_LIST_LLAMA_CPP_QUESTION—
video_with_audioBOOLEANfalse—
seedINT-1-1–4294967295Runtime completion seed; Native prefill scoring is deterministic.
session_unloadBOOLEANfalseUnload the session after the decision completes.
imagesoptIMAGE—
audiooptAUDIO—
videooptVIDEO—
model_profileoptOLLAMA_IMAGE_LIST_LLAMA_CPP_MODEL_PROFILEOptional override; server sessions apply sampling and explicit on/off reasoning settings per request.

Outputs (5)

NameTypeDescription
selectedSTRING—
probabilities_jsonSTRING—
metricsSTRING—
media_diagnosticsOLLAMA_IMAGE_LIST_LLAMA_CPP_MEDIA_DIAGNOSTICS—
sessionOLLAMA_IMAGE_LIST_LLAMA_CPP_SESSION—