ComfyUI Node: 🖥️ Local Text Model Loader (GGUF)

Authored by walke2019

Created

Updated

29 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

🤖 GGUF-VLM/💬 Text Models

Inputs

model
  • No models found
n_ctx INT
device
  • Auto
  • GPU
  • CPU
system_prompt STRING

Outputs

TEXT_MODEL

Extension: Qwen2.5-VL GGUF Nodes

ComfyUI nodes for running GGUF quantized Qwen2.5-VL models using llama.cpp

Authored by walke2019

Looking for a different node?

Also provided by 1 other extension

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more