Nodes/comfyui-llamacpp-plus/LlamaCPP Options
ComfyUI Node

LlamaCPP Options

A ComfyUI node in LlamaCPP API with 26 inputs and 1 output.

By pointave·Created 5 months ago·Updated 2 months ago· 2
LlamaCPP Options
    • options
    enable_seedfalse
    seed1390589294
    enable_num_ctxfalse
    num_ctx2048
    enable_repeat_last_nfalse
    repeat_last_n64
    enable_repeat_penaltyfalse
    repeat_penalty1.10
    enable_temperaturefalse
    temperature0.80
    enable_stopfalse
    stop
    enable_top_kfalse
    top_k40
    enable_top_pfalse
    top_p0.90
    enable_min_pfalse
    min_p0.00
    enable_main_gpufalse
    main_gpu0
    enable_thinking_budgetfalse
    thinking_budget1024
    video_frame_step1
    video_max_frames60
    audio_max_seconds30
    debugfalse
    CategoryLlamaCPP API

    Inputs (26)

    NameTypeDefaultDescription
    enable_seedBOOLEANfalse
    seedINT13905892940–2147483648
    enable_num_ctxBOOLEANfalse
    num_ctxINT20480–2147483648
    enable_repeat_last_nBOOLEANfalse
    repeat_last_nINT64-1–64
    enable_repeat_penaltyBOOLEANfalse
    repeat_penaltyFLOAT1.100–2
    enable_temperatureBOOLEANfalse
    temperatureFLOAT0.80-10–10
    enable_stopBOOLEANfalse
    stopSTRING
    enable_top_kBOOLEANfalse
    top_kINT400–100
    enable_top_pBOOLEANfalse
    top_pFLOAT0.900–1
    enable_min_pBOOLEANfalse
    min_pFLOAT0.000–1
    enable_main_gpuBOOLEANfalse
    main_gpuINT00–100
    enable_thinking_budgetBOOLEANfalseCap reasoning tokens (Gemma4, QwQ). 0 disables thinking entirely.
    thinking_budgetINT10240–32768
    video_frame_stepINT11–60Sample every Nth source frame from the video input. 1 = every frame.
    video_max_framesINT601–60Hard cap on frames sent to model. Video
    audio_max_secondsFLOAT301–30Trim audio to this many seconds before sending. Gemma4 E2B/E4B hard limit is 30 s.
    debugBOOLEANfalse

    Outputs (1)

    NameTypeDescription
    optionsLLAMACPP_OPTIONS