ComfyUI Node: 🖥️Easy Local LLM Loader

Authored by heshengtao

Created

Updated

2307 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

大模型派对(llm_party)/模型加载器(model loader)

Inputs

model_name_or_path
    device
    • auto
    • cuda
    • cpu
    • mps
    dtype
    • auto
    • float32
    • float16
    • bfloat16
    • int8
    • int4
    is_locked BOOLEAN

    Outputs

    CUSTOM

    CUSTOM

    Extension: comfyui_LLM_party

    A set of block-based LLM agent node libraries designed for ComfyUI.This project aims to develop a complete set of nodes for LLM workflow construction based on comfyui. It allows users to quickly and conveniently build their own LLM workflows and easily integrate them into their existing SD workflows.

    Authored by heshengtao

    Looking for a different node?

    Run ComfyUI workflows without the setup

    No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

    Learn more