ComfyUI Node
ialhabbal VLLM
A ComfyUI node in 🧪ialhabbal_VLLM with 10 inputs and 1 output.
ialhabbal VLLM
- image
- video
- RESPONSE
◄model_nameQwen3-VL-2B-Instruct►
◄quantizationNone (FP16)►
◄attention_modeauto►
◄preset_prompt🖼️ Detailed Description►
◄custom_prompt►
◄max_tokens512►
◄keep_model_loadedtrue►
◄seed1►
Category🧪ialhabbal_VLLM
Inputs (10)
| Name | Type | Default | Description |
|---|---|---|---|
| model_name | COMBO | Qwen3-VL-2B-Instruct | Pick the Qwen-VL checkpoint. First run downloads weights into models/LLM/Qwen-VL, so leave disk space. |
| quantization | COMBO | None (FP16) | Precision vs VRAM. FP16 gives the best quality if memory allows; 8-bit suits 8–16 GB GPUs; 4-bit fits 6 GB or lower but is slower. |
| attention_mode | COMBO | auto | auto tries flash-attn v2 when installed and falls back to SDPA. Only override when debugging attention backends. |
| preset_prompt | COMBO | 🖼️ Detailed Description | Built-in instruction describing how Qwen-VL should analyze the media input. |
| custom_prompt | STRING | Optional override—when filled it completely replaces the preset template. | |
| max_tokens | INT | 51264–2048 | Maximum number of new tokens to decode. Larger values yield longer answers but consume more time and memory. |
| keep_model_loaded | BOOLEAN | true | Keeps the model resident in VRAM/RAM after the run so the next prompt skips loading. |
| seed | INT | 11–4294967295 | Seed controlling sampling and frame picking; reuse it to reproduce results. |
| imageopt | IMAGE | — | |
| videoopt | IMAGE | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| RESPONSE | STRING | — |