Extensions/ComfyUI-ThinkingLLM
ComfyUI Extension

ComfyUI-ThinkingLLM

A multimodal ComfyUI AI node with Qwen3.5, Qwen3-VL, Qwen2.5-VL, Qwen3, and Gemma 4 integrations. Features live thinking in the terminal to see what the LLM is doing in real time.

By goodguy1963·Created 4 months ago·Updated 9 days ago· 21
goodguy1963/ComfyUI-ThinkingLLM
Nodes12
On cloudLocal install
Category🔷 QwenVL-Mod/Utils, ThinkingLLM
Stars21
Updated9 days ago

Nodes (12)

Story Split Node

Split one long story into four video prompts, then stitch it back together

🔷 QwenVL-Mod/Utils
ThinkingLLM Gemma 4 Audio (GGUF)

A local LLM that actually listens

ThinkingLLM
ThinkingLLM API (OpenAI Compatible)

Cloud LLMs from ComfyUI — without ever putting a key in a workflow

ThinkingLLM/API
ThinkingLLM

Your node isn't frozen — it's thinking

ThinkingLLM
ThinkingLLM Advanced

The same Qwen node, minus the training wheels

ThinkingLLM
ThinkingLLM (GGUF)

Vision LLMs on the VRAM you actually have

ThinkingLLM
ThinkingLLM Advanced (GGUF)

Every llama.cpp dial, exposed and explained

ThinkingLLM
ThinkingLLM Prompt Enhancer (GGUF)

Cheap, fast prompt enhancement on a text-only GGUF

ThinkingLLM
ThinkingLLM Prompt Enhancer

A local LLM that writes your prompts better than you do

ThinkingLLM
ThinkingLLM System Prompt Preset

Steal ThinkingLLM's system prompts for any node that takes a string

ThinkingLLM/Utils
ThinkingLLM Whisper ASR

Turn any audio into text your LLM can read

ThinkingLLM/Audio
VRAM Cleanup

VRAM-Cleanup

🔷 QwenVL-Mod/Utils
Readme

ComfyUI-ThinkingLLM

ThinkingLLM is a multimodal local-LLM node pack for ComfyUI. It provides clean workflows for Qwen, Gemma 4, GGUF, Whisper ASR, prompt enhancement, image/video understanding, audio analysis, and secure OpenAI-compatible providers.

Watch the demo on YouTube

GPL-3.0 fork of Deaquay/ComfyUI-Qwen3.5-Uncensored, itself derived from huchukato/ComfyUI-QwenVL-Mod and 1038lab/ComfyUI-QwenVL. See LICENSE.

ThinkingLLM Demo Node screenshot

Highlights

  • Local Transformers/Hugging Face and GGUF inference
  • Image and video understanding with optional mask-focused analysis
  • Gemma 4 audio understanding and Whisper speech-to-text
  • Prompt enhancers for image and video generation workflows
  • Thinking-mode control, live terminal streaming, and a separate RAW_TRACE output
  • Curated model recommendations and preset-specific generation guidance
  • Secure OpenAI-compatible API node for approved remote providers
  • Existing compatible models are discovered instead of downloaded twice

Quick install

ComfyUI Manager (recommended)

  1. Open ComfyUI Manager → Install via Registry.
  2. Search for ThinkingLLM.
  3. Click Install and restart ComfyUI.

Manual install

cd ComfyUI/custom_nodes
git clone https://github.com/goodguy1963/ComfyUI-ThinkingLLM.git
cd ComfyUI-ThinkingLLM
pip install -r requirements.txt

For GGUF vision or Gemma 4 audio, also follow the llama.cpp backend installation guide.

Nodes at a glance

| Node | Backend | Purpose | | --- | --- | --- | | ThinkingLLM | Transformers / HF | Image and video understanding | | ThinkingLLM (Advanced) | Transformers / HF | Full controls and MASK_PREVIEW | | ThinkingLLM Prompt Enhancer | Transformers / HF | Text prompt enhancement | | ThinkingLLM (GGUF) | llama.cpp | GGUF image and video understanding | | ThinkingLLM (GGUF Advanced) | llama.cpp | GGUF advanced controls and MASK_PREVIEW | | ThinkingLLM Gemma 4 Audio (GGUF) | llama.cpp | Gemma 4 audio understanding | | ThinkingLLM Whisper ASR | faster-whisper | Speech-to-text transcription | | ThinkingLLM Prompt Enhancer (GGUF) | llama.cpp | GGUF prompt enhancement | | ThinkingLLM System Prompt Preset | Utility | Reusable system prompts as STRING | | ThinkingLLM API (OpenAI Compatible) | Remote API | Approved OpenAI-compatible providers |

The Transformers/HF nodes are the recommended default when you want the simplest installation. Choose GGUF when you specifically need quantized llama.cpp models or Gemma 4 audio.

Start a workflow

  1. Add the ThinkingLLM node that matches your backend and task.
  2. Select a model or an already installed local model.
  3. Connect image, video, audio, mask, or text inputs as needed.
  4. Connect RESPONSE or ENHANCED_OUTPUT to a text display or downstream prompt input.
  5. Connect RAW_TRACE when you want generation diagnostics.

Useful defaults:

  • Start with enable_thinking=false for transcription and short direct answers.
  • Enable stream_tokens_to_terminal when diagnosing a slow or unhelpful generation.
  • Resize very large images before inference to reduce context and memory pressure.
  • Use the dedicated Gemma 4 Audio or Whisper node instead of assuming every multimodal model supports audio.

For explanations of thinking mode, model guidance, raw traces, audio, masks, and object-removal prompting, see Features and workflows.

Model families

ThinkingLLM includes curated entries for:

  • Qwen3.8, Qwen3.5, Qwen3-VL, Qwen2.5-VL, and Qwen3
  • Gemma 4 vision, text, and audio-capable GGUF variants
  • Whisper tiny through large-v3 and distil-large-v3
  • Local compatible Transformers checkpoints and GGUF/mmproj pairs

See Models and backends for exact families, model locations, local discovery, platform notes, and backend requirements.

Remote API node

ThinkingLLM API (OpenAI Compatible) supports approved OpenAI-compatible providers while keeping credentials on the ComfyUI server. Provider keys are not stored in workflows.

Documentation

| Topic | Guide | | --- | --- | | Thinking, streaming, traces, audio, masks, and workflow behavior | Features and workflows | | Supported models, discovery, locations, and backend selection | Models and backends | | GGUF / llama.cpp installation on Windows and Linux | llama.cpp backend installation | | Duration-aware LTX and MiniMax H3 prompting | Duration-aware video prompts | | Video preset recommendations and rationale | Video preset settings | | OpenAI-compatible API node | API setup and security | | OpenAI-compatible image inputs | API image inputs | | Maintainer and fork notes | Maintainer notes |

Production deployment

This repository provides ComfyUI nodes, not a complete production runtime. For exposed or serverless workflows, review dependency locking, validation, secrets, cost controls, monitoring, and rollback before deployment. The ComfyUI on RunPod production-readiness checklist is a useful starting point.

Credits

  • Deaquay/ComfyUI-Qwen3.5-Uncensored
  • huchukato/ComfyUI-QwenVL-Mod
  • 1038lab/ComfyUI-QwenVL
  • Qwen Team (Alibaba Cloud)
  • JamePeng/llama-cpp-python
  • comfyanonymous/ComfyUI

Maintainer: goodguy1963

License

GPL-3.0. See LICENSE.