ComfyUI Node
ThinkingLLM
A ComfyUI node in ThinkingLLM with 13 inputs and 2 outputs.
ThinkingLLM
- image
- video
- RESPONSE
- RAW_TRACE
◄model_nameQwen3-VL-4B-Instruct-Abliterated [DL: 7.5GB, VRAM: 6.0GB]►
◄attention_modeauto►
◄preset_prompt🖼️ Detailed Description►
◄custom_prompt►
◄max_tokens8192►
◄keep_model_loadedfalse►
◄seed1►
◄keep_last_promptfalse►
◄stream_tokens_to_terminalfalse►
◄enable_thinkingtrue►
◄hf_token►
CategoryThinkingLLM
Inputs (13)
| Name | Type | Default | Description |
|---|---|---|---|
| model_name | COMBO | Qwen3-VL-4B-Instruct-Abliterated [DL: 7.5GB, VRAM: 6.0GB] | Pick the Qwen-VL checkpoint. First run downloads weights into models/LLM/Qwen-VL, so leave disk space. |
| attention_mode | COMBO | auto | auto tries SageAttention → FlashAttention 2 → SDPA in order. SDPA is stable and recommended. Only override when debugging attention backends. |
| preset_prompt | COMBO | 🖼️ Detailed Description | Built-in instruction describing how Qwen-VL should analyze the media input. Select 'No preset' to use only the custom prompt or image input. |
| custom_prompt | STRING | Additional user input that gets combined with the preset template. Leave empty to use only the template. | |
| max_tokens | INT | 819264–8192 | Maximum number of new tokens to decode. Larger values yield longer answers but consume more time and memory. |
| keep_model_loaded | BOOLEAN | false | Keeps the model resident in VRAM/RAM after the run so the next prompt skips loading. |
| seed | INT | 11–4294967295 | Seed controlling sampling and frame picking; reuse it to reproduce results. 💡 Cache Info: Prompts are cached automatically. Use the same inputs (model, preset, custom prompt, image/video) to reuse cached prompts and avoid regeneration. 🔒 Fixed Seed Mode: Set seed = 1 to ignore image/video changes and only use text-based caching. Perfect for keeping the same prompt regardless of media input variations. |
| keep_last_prompt | BOOLEAN | false | Keep the last generated prompt instead of creating a new one |
| stream_tokens_to_terminal | BOOLEAN | false | Print every generated token live to the ComfyUI terminal/console |
| enable_thinking | BOOLEAN | true | Enable model reasoning/thinking when the backend supports it: True=allow thinking, False=force direct answer. Even when enabled, easy prompts may still get a direct answer, and this node automatically disables thinking when there is not enough output budget left for useful reasoning. For non-Qwen models (Gemma, LLaMA) this is advisory. |
| hf_token | STRING | Optional Hugging Face access token for private or gated model downloads. It is passed only to the download call, never logged or cached, and the in-memory copy is dropped after the download attempt. Clear this field before saving or sharing workflows. | |
| imageopt | IMAGE | — | |
| videoopt | IMAGE | — |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| RESPONSE | STRING | — |
| RAW_TRACE | STRING | — |