ComfyUI Node
ThinkingLLM (GGUF)
A ComfyUI node in ThinkingLLM with 14 inputs and 2 outputs.
ThinkingLLM (GGUF)
- image
- video
- audio
- RESPONSE
- RAW_TRACE
◄model_nameQwen3-VL-4B-Instruct-c_abliterated-v2.Q4_K_M.gguf [~2.4GB]►
◄preset_prompt🖼️ Detailed Description►
◄custom_prompt►
◄max_tokens8192►
◄keep_model_loadedfalse►
◄seed1►
◄stream_tokens_to_terminalfalse►
◄enable_thinkingtrue►
◄auto_finalization_retryfalse►
◄hf_token►
◄audio_file_path►
CategoryThinkingLLM
Inputs (14)
| Name | Type | Default | Description |
|---|---|---|---|
| model_name | COMBO | Qwen3-VL-4B-Instruct-c_abliterated-v2.Q4_K_M.gguf [~2.4GB] | GGUF vision model from gguf_models.json or auto-detected local files. [installed] means the catalog model file was found on disk; [local] means an uncatalogued local model. Missing GGUF or mmproj files are downloaded on first use. |
| preset_prompt | COMBO | 🖼️ Detailed Description | Select 'No preset' to use only the custom prompt or image input. |
| custom_prompt | STRING | Additional user input that gets combined with the preset template. Leave empty to use only the template. | |
| max_tokens | INT | 819264–32768 | Maximum new tokens to generate. Larger values give more room for reasoning but increase runtime and memory use. |
| keep_model_loaded | BOOLEAN | false | Keep the GGUF model in RAM/VRAM after the run so repeated prompts skip model loading. Disable if you need memory back for other nodes. |
| seed | INT | 11–4294967295 | Sampling seed. The node also uses fixed-seed prompt persistence, so identical inputs can reuse the saved result. |
| stream_tokens_to_terminal | BOOLEAN | false | Print generated tokens live in the ComfyUI terminal. Useful for long runs and backend troubleshooting. |
| enable_thinking | BOOLEAN | true | Enable model reasoning/thinking when the backend supports it: True=allow thinking, False=force direct answer. Even when enabled, easy prompts may still get a direct answer, and this node automatically disables thinking when there is not enough output budget left for useful reasoning. For non-Qwen GGUF models this is advisory and may not be honored by the backend. |
| auto_finalization_retry | BOOLEAN | false | If enabled, runs an extra LLM completion when the first output is empty or reasoning-only. Disabled by default so one node execution performs one generation pass. |
| hf_token | STRING | Optional Hugging Face access token for private or gated GGUF/mmproj downloads. It is passed only to the download call, never logged or cached, and the in-memory copy is dropped after the download attempt. Clear this field before saving or sharing workflows. | |
| imageopt | IMAGE | — | |
| videoopt | IMAGE | — | |
| audioopt | AUDIO | — | |
| audio_file_pathopt | STRING | Optional local audio file path. M4A, MP3, WAV, FLAC, and other FFmpeg-readable files are decoded to 16 kHz mono WAV before inference. |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| RESPONSE | STRING | — |
| RAW_TRACE | STRING | — |