Nodes/ComfyUI_EmAySee_CustomNodes/EmAySee Advanced Oobabooga Connector With Help
ComfyUI Node

EmAySee Advanced Oobabooga Connector With Help

A ComfyUI node in EmAySee/LLM with 65 inputs and 3 outputs.

By EmAySee·Created about a year ago·Updated 3 months ago· 2
EmAySee Advanced Oobabooga Connector With Help
    • answer
    • thinking
    • full_raw
    ◄api_urlhttp://10.0.0.71:5000/v1/chat/completions►
    ◄api_keysupersecretkey►
    ◄promptEnter prompt here►
    ◄system_promptYou are a helpful assistant.►
    ◄seed-1►
    ◄max_tokens512►
    ◄temperature0.78►
    ◄top_p0.95►
    ◄min_p0.05►
    ◄top_k20►
    ◄repetition_penalty1.00►
    ◄reasoning_effortmedium►
    ◄auto_continuefalse►
    ◄max_continues3►
    ◄stop_on_errortrue►
    ◄best_of1►
    ◄echofalse►
    ◄frequency_penalty0.00►
    ◄presence_penalty0.00►
    ◄n1►
    ◄suffix►
    ◄user►
    ◄preset►
    ◄dynatemp_low1.00►
    ◄dynatemp_high1.00►
    ◄dynatemp_exponent1.00►
    ◄smoothing_factor0.00►
    ◄smoothing_curve1.0►
    ◄typical_p1.00►
    ◄xtc_threshold0.10►
    ◄xtc_probability0.00►
    ◄epsilon_cutoff0.00►
    ◄eta_cutoff0.00►
    ◄tfs1.00►
    ◄top_a0.00►
    ◄top_n_sigma0.00►
    ◄dry_multiplier0.00►
    ◄dry_allowed_length2►
    ◄dry_base1.75►
    ◄encoder_repetition_penalty1.00►
    ◄no_repeat_ngram_size0►
    ◄repetition_penalty_range1024►
    ◄penalty_alpha0.00►
    ◄guidance_scale1.0►
    ◄mirostat_mode0►
    ◄mirostat_tau5.0►
    ◄mirostat_eta0.10►
    ◄prompt_lookup_num_tokens0►
    ◄max_tokens_second0►
    ◄do_sampletrue►
    ◄dynamic_temperaturefalse►
    ◄temperature_lastfalse►
    ◄auto_max_new_tokensfalse►
    ◄ban_eos_tokenfalse►
    ◄add_bos_tokentrue►
    ◄enable_thinkingtrue►
    ◄skip_special_tokenstrue►
    ◄static_cachefalse►
    ◄truncation_length0►
    ◄custom_token_bans►
    ◄negative_prompt►
    ◄dry_sequence_breakers"\n", ":", "\"", "*"►
    ◄grammar_string►
    ◄sampler_priority►
    ◄stop_sequences►
    CategoryEmAySee/LLM

    Inputs (65)

    NameTypeDefaultDescription
    api_urlSTRINGhttp://10.0.0.71:5000/v1/chat/completionsAPI Endpoint URL: The network address where your LLM server is listening. This routes your prompt to the backend generation engine.
    api_keySTRINGsupersecretkeyAPI Key: The authorization token required to access the backend server. Prevents unauthorized execution if your API is exposed.
    promptSTRINGEnter prompt herePrompt: The main user input or instruction. This is the direct context or question the LLM will respond to.
    system_promptSTRINGYou are a helpful assistant.System Prompt: The foundational instructions given to the LLM before your main prompt. It defines the AI's persona, rules, memory, and behavioral constraints.
    seedINT-1-1–18446744073709550000Seed: The initialization number for the random number generator. Using the same seed with identical settings guarantees the exact same text output. -1 generates a random seed each time.
    max_tokensINT5121–32768Max Tokens: The absolute maximum number of words or sub-words the model is allowed to generate in a single response. Acts as a hard stop to prevent runaway generation.
    temperatureFLOAT0.780–2Temperature: Modifies token probabilities. >1.0 flattens the distribution, increasing randomness and creativity. <1.0 sharpens the distribution, making the model strictly pick highly probable, deterministic words. 0.0 is entirely greedy.
    top_pFLOAT0.950–1Top-P (Nucleus Sampling): Sorts tokens by probability and keeps adding them to a pool until their combined probability hits this limit. 0.95 discards the bottom 5% of unlikely tokens, cutting off the 'long tail' of gibberish.
    min_pFLOAT0.050–1Min-P: Sets a dynamic probability threshold relative to the most likely token. A value of 0.05 means any token with less than 5% of the top token's probability is instantly discarded. Excellent for maintaining coherence.
    top_kINT200–200Top-K: A hard, absolute limit on the number of token choices considered. 20 means the model will only ever choose from the 20 most likely next words, stripping away all other possibilities.
    repetition_penaltyFLOAT1.001–2Repetition Penalty: Divides the probability of tokens that have already appeared in the output by this value. >1.0 reduces looping. Setting it too high will cause the model to artificially avoid common grammar like 'the' or 'and'.
    reasoning_effortCOMBOmediumReasoning Effort: For advanced models supporting internal chain-of-thought. Dictates how much hidden compute time and context length the model dedicates to thinking before it begins outputting the final answer.
    auto_continueBOOLEANfalseAuto-Continue: If the model stops generating solely because it hit your 'Max Tokens' limit, enabling this will automatically append the generated text and ask the server to continue writing.
    max_continuesINT31–10Max Continues: The safety trigger for Auto-Continue. Prevents an infinite API loop by strictly capping how many consecutive times the node is allowed to ask the model to keep generating.
    stop_on_errorBOOLEANtrueStop on Error: If True, backend API errors (like timeouts or out-of-memory) will crash the ComfyUI workflow. If False, the node will output the error text and allow the workflow to proceed.
    best_ofoptINT11–10Best Of: Generates this number of full completions entirely on the server side, evaluates them, and only returns the single completion with the highest overall token probability score. Extremely compute-heavy.
    echooptBOOLEANfalseEcho: Forces the server to prepend your exact input prompt to the beginning of the generated output text.
    frequency_penaltyoptFLOAT0.00-2–2Frequency Penalty: Subtracts from a token's logit score based on exactly how many times it has ALREADY appeared in the text. Directly punishes repetitive vocabulary.
    presence_penaltyoptFLOAT0.00-2–2Presence Penalty: Applies a flat, one-time penalty to a token if it has appeared AT ALL in the generated text. Highly encourages the model to transition to new topics.
    noptINT11–10N: Instructs the API to generate multiple independent completions for a single prompt simultaneously. ComfyUI will only process the first choice with this specific node setup.
    suffixoptSTRINGSuffix: Text that the model expects to come immediately after its generation. Used heavily in fill-in-the-middle (FIM) coding tasks.
    useroptSTRINGUser: A unique string identifying the end-user for backend logging or rate-limiting purposes.
    presetoptSTRINGPreset: The exact string name of a generation YAML preset saved in your Oobabooga text-generation-webui server. Overrides node parameters if defined.
    dynatemp_lowoptFLOAT1.000–2Dynamic Temperature Low: The minimum temperature floor. When the model is highly confident in its next token, temperature shifts toward this value to ensure logical consistency.
    dynatemp_highoptFLOAT1.000–2Dynamic Temperature High: The maximum temperature ceiling. When the model is uncertain, temperature shifts toward this value to encourage creative exploration out of the uncertainty.
    dynatemp_exponentoptFLOAT1.000–10Dynamic Temperature Exponent: Controls the mathematical curve between dynatemp_low and dynatemp_high. Modifies how aggressively the temperature swings based on model confidence.
    smoothing_factoroptFLOAT0.000–10Smoothing Factor (Quadratic Sampling): Flattens extremely sharp spikes in the probability distribution. Makes the model slightly more likely to pick the 2nd or 3rd best token rather than constantly locking onto the absolute highest.
    smoothing_curveoptFLOAT1.00.1–10Smoothing Curve: Adjusts the shape of the mathematical curve applied by the Smoothing Factor.
    typical_poptFLOAT1.000–1Typical-P: Sorts tokens based on how close their probability is to the expected entropy (typicality) of the text, rather than pure likelihood. 1.0 disables it.
    xtc_thresholdoptFLOAT0.100–1XTC Threshold: Exclude Top Choices threshold. Any token with a probability higher than this value becomes eligible to be completely removed from consideration.
    xtc_probabilityoptFLOAT0.000–1XTC Probability: The random chance (0.0 to 1.0) that the tokens exceeding the XTC Threshold will actually be deleted. Forces the model into extreme lateral thinking by stripping the most obvious answers.
    epsilon_cutoffoptFLOAT0.000–1Epsilon Cutoff: A hard probability floor. Any token with a raw probability below this exact decimal value is instantly discarded. A flat alternative to min_p.
    eta_cutoffoptFLOAT0.000–1Eta Cutoff: A dynamic entropy-based cutoff. Similar to epsilon, but the threshold scales based on the overall uncertainty of the current token distribution.
    tfsoptFLOAT1.000–1Tail Free Sampling (TFS): Looks at the mathematical second derivative of the probability curve to find the exact point where probabilities drop off a cliff, and cuts the 'tail' off there.
    top_aoptFLOAT0.000–1Top-A: Squares the probability of the most likely token and multiplies it by this Top-A value to create a dynamic floor. Tokens below this dynamic floor are discarded.
    top_n_sigmaoptFLOAT0.000–10Top N Sigma: Retains only the tokens whose probabilities fall within this many standard deviations from the mean probability of the distribution.
    dry_multiplieroptFLOAT0.000–2DRY Multiplier (Don't Repeat Yourself): The master switch for the DRY algorithm. Applies an exponentially growing penalty to repeating sequences of text. 0.0 disables.
    dry_allowed_lengthoptINT20–20DRY Allowed Length: How many tokens can perfectly match a previous sequence before the DRY exponential penalty triggers and forces the model to change course.
    dry_baseoptFLOAT1.751–5DRY Base: The base mathematical value for the DRY exponential curve. Higher values make the penalty scale violently faster as a sequence repeats.
    encoder_repetition_penaltyoptFLOAT1.001–2Encoder Repetition Penalty: Applies specifically to the encoder phase of seq2seq models. Irrelevant for most standard decoder-only LLMs.
    no_repeat_ngram_sizeoptINT00–20No Repeat N-Gram Size: An absolute rule. If set to 3, the model is physically incapable of ever generating the same sequence of 3 tokens twice in the entire output.
    repetition_penalty_rangeoptINT10240–8192Repetition Penalty Range: How far back in the context (in tokens) the model looks when calculating standard repetition penalties. Should generally match your expected output length.
    penalty_alphaoptFLOAT0.000–10Penalty Alpha (Contrastive Search): Balances token probability with a penalty based on similarity to recent context. 0.0 disables. Forces diverse phrasing.
    guidance_scaleoptFLOAT1.00–20Guidance Scale: Classifier-Free Guidance (CFG) for LLMs. Pushes the output toward the prompt and heavily away from the Negative Prompt. >1.0 activates CFG.
    mirostat_modeoptINT00–2Mirostat Mode: 0 = Off, 1 = V1, 2 = V2. Completely overrides Temperature and Top-P to automatically lock the text generation at a constant level of target 'surprise' (entropy).
    mirostat_tauoptFLOAT5.00–20Mirostat Tau: The target entropy level for Mirostat. Higher values result in more surprising/creative text; lower values result in highly predictable text.
    mirostat_etaoptFLOAT0.100–1Mirostat Eta: The learning rate. Controls how quickly the Mirostat algorithm reacts and corrects the temperature when the text strays from the target Tau entropy.
    prompt_lookup_num_tokensoptINT00–20Prompt Lookup Tokens: Speculative decoding trick. The model scans the prompt for sequences matching its current generation and attempts to copy them wholesale to speed up generation.
    max_tokens_secondoptINT00–32768Max Tokens Second: A fallback/secondary token limit used by specific backend routing configurations.
    do_sampleoptBOOLEANtrueDo Sample: If True, uses all your configured samplers (temp, top_p, etc). If False, executes 'Greedy Decoding', bypassing all math to strictly pick the #1 top token every single time.
    dynamic_temperatureoptBOOLEANfalseDynamic Temperature Enable: Master switch to turn on the dynatemp_low, dynatemp_high, and exponent scaling logic.
    temperature_lastoptBOOLEANfalseTemperature Last: Shifts the Temperature calculation to the absolute end of the sampling pipeline, applying it after Top-K, Top-P, and min_p have made their cuts.
    auto_max_new_tokensoptBOOLEANfalseAuto Max New Tokens: Ignores your 'max_tokens' integer and automatically sets the generation limit to perfectly fill the absolute maximum remaining space in the model's context window.
    ban_eos_tokenoptBOOLEANfalseBan EOS Token: Physically forbids the model from outputting the 'End Of Stream' token. Forces the model to keep generating text until it hits the max_tokens wall.
    add_bos_tokenoptBOOLEANtrueAdd BOS Token: Automatically prepends the invisible 'Beginning Of Stream' token to your prompt. Most models require this to structure their context correctly.
    enable_thinkingoptBOOLEANtrueEnable Thinking: Allows models programmed with explicit reasoning phases (like DeepSeek R1) to output their internal thought process tags (<think>).
    skip_special_tokensoptBOOLEANtrueSkip Special Tokens: Strips backend formatting tokens (like <|endoftext|> or <|user|>) from the final returned string to keep the text clean.
    static_cacheoptBOOLEANfalseStatic Cache: Locks the Key-Value (KV) cache allocation in VRAM. Can improve continuous generation speed on some backends at the cost of rigid memory reservation.
    truncation_lengthoptINT00–131072Truncation Length: If your combined prompt and history exceeds this number, the backend will forcibly slice off the oldest text to fit. 0 uses the model's innate maximum.
    custom_token_bansoptSTRINGCustom Token Bans: Comma-separated list of raw Token IDs (numbers, not words) that the model is strictly forbidden from ever generating.
    negative_promptoptSTRINGNegative Prompt: Text describing exactly what you do NOT want. Only functions if Guidance Scale (CFG) is set higher than 1.0.
    dry_sequence_breakersoptSTRING"\n", ":", "\"", "*"DRY Sequence Breakers: Specific characters or strings that immediately reset the DRY exponential repetition penalty back to zero when generated.
    grammar_stringoptSTRINGGrammar String: A complex GBNF formatted string that forces the model to strictly adhere to a specific output format, such as a rigid JSON schema.
    sampler_priorityoptSTRINGSampler Priority: Comma-separated list defining the exact execution order of the math samplers (e.g., 'temperature, top_p, top_k'). Modifying this drastically changes generation logic.
    stop_sequencesoptSTRINGStop Sequences: Comma-separated words or symbols. If the model generates any of these exact sequences, it will instantly stop generating and return the text up to that point.

    Outputs (3)

    NameTypeDescription
    answerSTRING—
    thinkingSTRING—
    full_rawSTRING—