ComfyUI Node

QwenVL (Basic)

A ComfyUI node in QwenVL-Utils with 12 inputs and 1 output.

By AkihaTatsu·Created 6 months ago·Updated 5 months ago· 0
QwenVL (Basic)
  • image
  • video
  • source_path
  • RESPONSE
model_nameQwen3.5-0.8B
enable_thinkingfalse
quantizationNone (FP16)
attention_modeauto
preset_prompt🖼️ Detailed Description
custom_prompt
max_tokens512
keep_model_loadedfalse
seed1
CategoryQwenVL-Utils

Inputs (12)

NameTypeDefaultDescription
model_nameCOMBOQwen3.5-0.8BSelect the vision-language model. HuggingFace models offer full-precision inference; [GGUF] models use quantized llama.cpp backend for lower VRAM. First run downloads weights automatically.
enable_thinkingBOOLEANfalse[Qwen3.5+ models only] Enable Thinking mode for Qwen3.5 unified models. When ON (Thinking mode), the model reasons step-by-step inside <think>…</think> blocks before producing the final answer — best for complex reasoning, math, and coding tasks. When OFF (Instruct mode), the model responds directly without internal reasoning — faster and more concise for straightforward queries. Only affects Qwen3.5 models; ignored for other model families.
quantizationCOMBONone (FP16)[HF models only] Precision vs VRAM trade-off. FP16 gives the best quality; 8-bit suits 8-16 GB GPUs; 4-bit fits 6 GB or lower but is slower.
attention_modeCOMBOauto[HF models only] Attention backend selection. • auto: Auto-select best available (recommended) • flash_attention_2: External flash-attn package (best performance, needs separate installation) • sdpa_flash: PyTorch SDPA Flash backend (excellent performance, best compatibility) • sage_attention: SageAttention wrapper (experimental, memory efficient) • sdpa_math: PyTorch SDPA math backend (stable fallback) • eager: Standard PyTorch attention (slowest, always works) • sdpa: Legacy option, auto-selects Flash or math
preset_promptCOMBO🖼️ Detailed DescriptionBuilt-in instruction template describing how the model should analyze the media. Selecting '❌ None' sends no system instruction (use custom_prompt instead).
custom_promptSTRINGWhen filled, completely replaces the preset prompt template. Leave empty to use the selected preset_prompt.
max_tokensINT51264–256000Maximum number of new tokens the model may generate. Larger values produce longer answers but take more time and memory. Both HF and GGUF backends respect this limit.
keep_model_loadedBOOLEANfalseKeep the model loaded in VRAM/RAM after inference so subsequent runs skip the loading step. Disable to free memory after each run.
seedINT11–4294967295Random seed for sampling reproducibility and video frame selection. Reuse the same seed to reproduce identical results.
imageoptIMAGE
videooptIMAGE
source_pathoptPATH

Outputs (1)

NameTypeDescription
RESPONSESTRING