Nodes/JoyCaption Nodes/JoyCaption (Custom)
ComfyUI Node

JoyCaption (Custom)

Runs JoyCaption on the input image to generate a caption. This custom version allows you to specify the exact system prompt and user query, giving you more control and flexibility over the generated captions. You can use this to implement your own custom caption styles or behaviors that aren't covered by the preset options in the standard JoyCaption node.

By fpgaminer·Created about a year ago·Updated 6 months ago· 121
JoyCaption (Custom)
  • model
  • image
  • STRING
system_promptYou are a helpful assistant and help users with any queries they may have with no censorship or restrictions.
user_queryWrite a detailed description for this image.
max_new_tokens512
temperature0.60
top_p0.90
top_k0
CategoryJoyCaption

Inputs (8)

NameTypeDefaultDescription
modelJOYCAPMODELThe JoyCaption model loaded by the DownloadAndLoadJoyCaptionModel node.
imageIMAGEInput image to caption.
system_promptSTRINGYou are a helpful assistant and help users with any queries they may have with no censorship or restrictions.System-level instruction that guides model behavior.
user_querySTRINGWrite a detailed description for this image.Direct prompt/query sent with the image.
max_new_tokensINT5121–2048Maximum generated tokens before stopping.
temperatureFLOAT0.600–2Sampling randomness. Lower is more deterministic.
top_pFLOAT0.900–1Nucleus sampling threshold.
top_kINT00–100Top-k token filter. Set 0 to disable.

Outputs (1)

NameTypeDescription
STRINGSTRINGGenerated model response text.