Nodes/Multimodal — LLM (Local-first: GGUF + Transformers)/Multimodal — LLM (local first: GGUF + optional transformers)
ComfyUI Node
Multimodal — LLM (local first: GGUF + optional transformers)
**GGUF:** set **GGUF main + mmproj** (.gguf files under models/llm). **Use vision** ON + IMAGE → vision run; **OFF** → text-only (linked image is ignored — Comfy cannot hide the socket, but the model never sees pixels). **Image-only:** vision ON + IMAGE + empty text fields — GGUF sends image only; HF VLM may use a single `.` token only so the HF API accepts the call (not a written instruction). **combined_model** = transformers only (HF id / snapshot folder). Leave **empty** for GGUF-only (including text-only on GGUF). **load_source** applies only to **combined_model**.
Multimodal — LLM (local first: GGUF + optional transformers)
- image
- image2
- image3
- text
◄use_visiontrue►
◄load_sourceauto►
◄gguf_main_models_llm— use path fields below —►
◄gguf_mmproj_models_llm— use path fields below —►
◄gguf_model_path►
◄gguf_mmproj_path►
◄gguf_vlm_handlerqwen3-vl►
◄gguf_allow_qwen25_if_qwen3_handler_missingtrue►
◄gguf_n_ctx12288►
◄gguf_streamingfalse►
◄gguf_chat_template_enable_thinkingfalse►
◄include_thinking_in_outputfalse►
◄thinking_open_tag<think>►
◄thinking_close_tag</think>►
◄combined_model►
◄system_prompt►
◄extra_context►
◄prompt►
◄max_new_tokens5000►
◄do_samplefalse►
◄generation_seed_modefixed►
◄generation_seed0►
◄temperature0.70►
◄top_p0.95►
◄top_k20►
◄repetition_penalty1.00►
◄use_repetition_penaltytrue►
◄deviceauto►
◄dtypeauto►
◄trust_remote_codefalse►
◄keep_models_loadedfalse►
◄offload_image_modefalse►
◄log_load_detailstrue►
Categoryllm/multimodal
Inputs (36)
| Name | Type | Default | Description |
|---|---|---|---|
| use_vision | BOOLEAN | true | — |
| load_source | COMBO | auto | 3 options: auto, local, huggingface |
| gguf_main_models_llm | COMBO | — use path fields below — | 1 options: — use path fields below — |
| gguf_mmproj_models_llm | COMBO | — use path fields below — | 1 options: — use path fields below — |
| gguf_model_path | STRING | — | |
| gguf_mmproj_path | STRING | — | |
| gguf_vlm_handler | COMBO | qwen3-vl | 5 options: qwen3-vl, qwen2.5-vl, gemma3, llava-1.5, llava-1.6 |
| gguf_allow_qwen25_if_qwen3_handler_missing | BOOLEAN | true | — |
| gguf_n_ctx | INT | 12288512–131072 | — |
| gguf_streaming | BOOLEAN | false | — |
| gguf_chat_template_enable_thinking | BOOLEAN | false | — |
| include_thinking_in_output | BOOLEAN | false | — |
| thinking_open_tag | STRING | <think> | — |
| thinking_close_tag | STRING | </think> | — |
| combined_model | STRING | — | |
| system_prompt | STRING | — | |
| extra_context | STRING | — | |
| prompt | STRING | — | |
| max_new_tokens | INT | 50000–65536 | — |
| do_sample | BOOLEAN | false | — |
| generation_seed_mode | COMBO | fixed | 2 options: fixed, increment_each_run |
| generation_seed | INT | 00–4294967295 | — |
| temperature | FLOAT | 0.700–2 | — |
| top_p | FLOAT | 0.950–128 | — |
| top_k | INT | 20-1–100 | — |
| repetition_penalty | FLOAT | 1.000.5–2 | — |
| use_repetition_penalty | BOOLEAN | true | — |
| device | COMBO | auto | 3 options: auto, cuda, cpu |
| dtype | COMBO | auto | 6 options: auto, bfloat16, float16, float32, False, True |
| trust_remote_code | BOOLEAN | false | — |
| keep_models_loaded | BOOLEAN | false | — |
| offload_image_mode | BOOLEAN | false | — |
| log_load_details | BOOLEAN | true | — |
| imageopt | IMAGE | — | |
| image2opt | IMAGE | — | |
| image3opt | IMAGE | — |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| text | STRING | — |