ComfyUI Node
AQ_QwenLoader
A ComfyUI node in AQ/LLM with 4 inputs and 1 output.
AQ_QwenLoader
- qwen_model
◄modelunsloth/Qwen2.5-VL-3B-Instruct-bnb-4bit►
◄quantization4bit►
◄attentionsdpa►
◄deviceauto►
CategoryAQ/LLM
Inputs (4)
| Name | Type | Default | Description |
|---|---|---|---|
| model | COMBO | unsloth/Qwen2.5-VL-3B-Instruct-bnb-4bit | 3 options: unsloth/Qwen2.5-VL-3B-Instruct-bnb-4bit, unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit, unsloth/Qwen2.5-VL-32B-Instruct-bnb-4bit |
| quantization | COMBO | 4bit | 2 options: none, 4bit |
| attention | COMBO | sdpa | 3 options: flash_attention_2, sdpa, eager |
| device | COMBO | auto | 3 options: auto, cuda:0, cuda:1 |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| qwen_model | QWEN_MODEL | — |