Nodes/ComfyUI-Llama/Load LLM Model Advanced
ComfyUI Node

Load LLM Model Advanced

A ComfyUI node in LLM with 32 inputs and 1 output.

By HairlessPrimate·Created 3 years ago·Updated 2 years ago· 71
Load LLM Model Advanced
    • LLM
    Model
    n_gpu_layers0
    split_modeLLAMA_SPLIT_LAYER
    main_gpu0
    tensor_split0.00
    vocab_onlyfalse
    use_mmaptrue
    use_mlockfalse
    seed-1
    n_ctx512
    n_batch512
    n_threads
    n_threads_batch
    rope_scaling_typeLLAMA_ROPE_SCALING_UNSPECIFIED
    rope_freq_base0.00
    rope_freq_scale0.00
    yarn_ext_factor-1.00
    yarn_attn_factor1.00
    yarn_beta_fast32.00
    yarn_beta_slow1.00
    yarn_orig_ctx0
    mul_mat_q0
    logits_allfalse
    embeddingfalse
    offload_kqvfalse
    last_n_tokens_size64
    lora_base
    lora_scale0.00
    lora_path
    numafalse
    chat_formatllama-2
    verbosetrue
    CategoryLLM

    Inputs (32)

    NameTypeDefaultDescription
    ModelCOMBO0 options:
    n_gpu_layersoptINT0
    split_modeoptCOMBOLLAMA_SPLIT_LAYER3 options: LLAMA_SPLIT_NONE, LLAMA_SPLIT_LAYER, LLAMA_SPLIT_ROW
    main_gpuoptINT0
    tensor_splitoptFLOAT0.000–1
    vocab_onlyoptBOOLEANfalse
    use_mmapoptBOOLEANtrue
    use_mlockoptBOOLEANfalse
    seedoptINT-1
    n_ctxoptINT512
    n_batchoptINT512
    n_threadsoptINT
    n_threads_batchoptINT
    rope_scaling_typeoptCOMBOLLAMA_ROPE_SCALING_UNSPECIFIED4 options: LLAMA_ROPE_SCALING_UNSPECIFIED, LLAMA_ROPE_SCALING_NONE, LLAMA_ROPE_SCALING_LINEAR, LLAMA_ROPE_SCALING_YARN
    rope_freq_baseoptFLOAT0.000–1
    rope_freq_scaleoptFLOAT0.000–1
    yarn_ext_factoroptFLOAT-1.00
    yarn_attn_factoroptFLOAT1.000–1
    yarn_beta_fastoptFLOAT32.00
    yarn_beta_slowoptFLOAT1.000–1
    yarn_orig_ctxoptINT0
    mul_mat_qoptINT0
    logits_alloptBOOLEANfalse
    embeddingoptBOOLEANfalse
    offload_kqvoptBOOLEANfalse
    last_n_tokens_sizeoptINT64
    lora_baseoptSTRING
    lora_scaleoptFLOAT0.000–1
    lora_pathoptSTRING
    numaoptBOOLEANfalse
    chat_formatoptSTRINGllama-2
    verboseoptBOOLEANtrue

    Outputs (1)

    NameTypeDescription
    LLMLLM