Nodes/SambaNova/SambaNova LLM
ComfyUI Node

SambaNova LLM

A ComfyUI node in LLM with 12 inputs and 3 outputs.

By Apache0ne·Created 2 years ago·Updated 2 years ago· 2
SambaNova LLM
    • generated_text
    • token_count
    • conversation_id
    prompt
    modelMeta-Llama-3.1-8B-Instruct
    max_tokens100
    temperature0.70
    top_p1.00
    top_k1
    request_typecompletion
    system_message
    stop_sequences
    conversation_id
    repetition_penalty1.00
    streamfalse
    CategoryLLM

    Inputs (12)

    NameTypeDefaultDescription
    promptSTRINGEnter your prompt here
    modelCOMBOMeta-Llama-3.1-8B-Instruct5 options: Meta-Llama-3.1-8B-Instruct, Meta-Llama-3.1-70B-Instruct, Meta-Llama-3.1-405B-Instruct, Meta-Llama-3.2-1B-Instruct, Meta-Llama-3.2-3B-Instruct
    max_tokensINT1001–4096
    temperatureFLOAT0.700–1
    top_pFLOAT1.000–1
    top_kINT11–100
    request_typeCOMBOcompletion2 options: completion, chat
    system_messageoptSTRING
    stop_sequencesoptSTRING
    conversation_idoptSTRING
    repetition_penaltyoptFLOAT1.001–2
    streamoptBOOLEANfalse

    Outputs (3)

    NameTypeDescription
    generated_textSTRING
    token_countINT
    conversation_idSTRING