ComfyUI Node: 🖥️Easy Local LLM Loader

Authored by heshengtao

Created

Updated

1655 stars

Category

大模型派对（llm_party）/模型加载器（model loader）

Inputs

model_name_or_path
    device
    • auto
    • cuda
    • cpu
    • mps
    dtype
    • auto
    • float32
    • float16
    • bfloat16
    • int8
    • int4
    is_locked BOOLEAN

    Outputs

    CUSTOM

    CUSTOM

    Extension: comfyui_LLM_party

    A set of block-based LLM agent node libraries designed for ComfyUI.This project aims to develop a complete set of nodes for LLM workflow construction based on comfyui. It allows users to quickly and conveniently build their own LLM workflows and easily integrate them into their existing SD workflows.

    Authored by heshengtao

    View Nodes

    Run ComfyUI workflows in the Cloud!

    No downloads or installs are required. Pay only for active GPU usage, not idle time. No complex setups and dependency issues

    Learn more