๐ง VRGDG SuperGemma GGUF Chat ๐ง
Run Gemma as a GGUF inside ComfyUI, no llama.cpp shell needed
- image1
- image2
- image3
- image4
- image5
- image6
- image7
- image8
- image9
- image10
- image11
- image12
- image13
- image14
- image15
- image16
- image17
- image18
- image19
- image20
- image21
- image22
- image23
- image24
- text
- used_model
- status
VRGDG_SuperGemmaGGUFChat loads a Gemma model as a quantized GGUF file and runs it for text generation directly inside ComfyUI. "SuperGemma" is the author's branding - you won't find it on a model card, and that's fine; underneath it's a plain llama.cpp-backed Gemma chat node with task presets bolted on.
Why Gemma specifically? Gemma 3 is the text encoder inside LTX-2 and LTX-2.3, and its full fp16 weights are a 22GB monster that causes most of the OOM errors in the LTX community. Running a GGUF quantization of it - Q8 is basically fp16 at half the size, as the GGUF crowd likes to say - is the low-VRAM path. This node gives you that same model for prompt enhancement and captioning without a separate llama.cpp setup.
The gotcha you'll hit first
The model_file dropdown defaults to [No Gemma GGUF found in models/LLM]. That's not a bug - it's the node telling you, honestly, that you haven't put a model where it looks yet. Drop a Gemma .gguf into ComfyUI/models/LLM/ (only files with "gemma" in the name are listed), restart or refresh, and the dropdown fills in. If you want to send images to the model, you also need an mmproj_file - the multimodal projector GGUF, also under models/LLM - but that's only required when you actually use image inputs.
The inputs that actually matter
This node has a lot of fields, but you can ignore most of them.
- task_preset - the one to understand. Pick
text_to_image,text_to_video,image_to_video,image_edit, orcaptioner_training, and the node injects built-in instruction blocks tuned for that job.customuses your own custom_instructions. For the music-video workflow,text_to_videoandimage_to_videoare the scene-prompt writers;captioner_trainingis for captioning LoRA training data. - user_input - your actual task details and creative direction.
- image_count - how many of the optional image slots (up to 24) to show on the node. Turn it up if you're handing the model a batch of reference frames.
- advanced - flips on the GGUF runtime controls. n_ctx defaults to Gemma's full 262144-token training context, which is enormous; if RAM or VRAM pressure is high, lower it hard (16384 is plenty for prompt work). n_gpu_layers 99 means offload everything to GPU; -1 also offloads all supported layers. unload_after_run frees memory after each generation - worth enabling if the workflow then wants those GBs back for video.
Outputs: text (the response), used_model, and status.
Installing
Shared pack install:
cd ComfyUI/custom_nodes
git clone https://github.com/vrgamegirl19/comfyui-vrgamedevgirl
or Manager โ search "vrgamedev", restart. No extra Python deps beyond the pack's shared ones - the GGUF runtime is bundled with the node.
The honest verdict
This is the right tool when you want Gemma-class prompt enhancement or captioning inside ComfyUI without juggling an external process, and the task presets genuinely save time. Where people get burned: forgetting the model file (the empty dropdown), leaving n_ctx at 262144 on a 16GB machine, and expecting the mmproj to be optional when they've wired up images. Mind those three and it's a smooth, fully-local Gemma. It's also the rare node where "SuperGemma" being an in-house name is worth knowing - so when you google it and find nothing, you're not missing a secret model, you're just looking at a well-nicknamed wrapper.
Inputs (40)
| Name | Type | Default | Description |
|---|---|---|---|
| model_file | COMBO | [No Gemma GGUF found in models/LLM] | Gemma GGUF models found under ComfyUI/models/LLM. Only .gguf files with 'gemma' in the name are shown. |
| mmproj_file | COMBO | [No mmproj GGUF found in models/LLM] | mmproj GGUF files found under ComfyUI/models/LLM. Required only when using image inputs. |
| task_preset | COMBO | text_to_image | Select a task preset with built-in instructions. |
| custom_instructions | STRING | Used only when task_preset is custom. Enter your own full instruction block. | |
| user_input | STRING | Your task details and creative direction for the selected preset. | |
| trigger_word | STRING | Optional LoRA/training trigger token. Used only by Captioner preset. | |
| image_count | INT | 00โ24 | How many optional image inputs to show on the node. |
| advanced | BOOLEAN | false | Show advanced GGUF runtime controls such as context, GPU layers, threads, sampler, and token limits. |
| unload_after_run | BOOLEAN | false | If enabled, unload the GGUF model from cache after this run to free RAM/VRAM. |
| n_ctx | INT | 262144512โ262144 | GGUF context window. SuperGemma defaults to the full 262144-token training context; lower this if RAM/VRAM is too high. |
| n_gpu_layers | INT | 99-1โ200 | How many layers to offload to GPU. Use -1 to offload all supported layers. |
| n_threads | INT | 81โ128 | CPU threads used by llama.cpp. |
| chat_format | STRING | Optional llama.cpp chat format override. Leave blank to use the model default. | |
| temperature | FLOAT | 0.600โ2 | Higher = more creative variation, lower = more deterministic output. |
| top_p | FLOAT | 0.950โ1 | Nucleus sampling cutoff. |
| max_new_tokens | INT | 80032โ32000 | Maximum number of output tokens. |
| image1opt | IMAGE | Optional reference image input. | |
| image2opt | IMAGE | Optional reference image input. | |
| image3opt | IMAGE | Optional reference image input. | |
| image4opt | IMAGE | Optional reference image input. | |
| image5opt | IMAGE | Optional reference image input. | |
| image6opt | IMAGE | Optional reference image input. | |
| image7opt | IMAGE | Optional reference image input. | |
| image8opt | IMAGE | Optional reference image input. | |
| image9opt | IMAGE | Optional reference image input. | |
| image10opt | IMAGE | Optional reference image input. | |
| image11opt | IMAGE | Optional reference image input. | |
| image12opt | IMAGE | Optional reference image input. | |
| image13opt | IMAGE | Optional reference image input. | |
| image14opt | IMAGE | Optional reference image input. | |
| image15opt | IMAGE | Optional reference image input. | |
| image16opt | IMAGE | Optional reference image input. | |
| image17opt | IMAGE | Optional reference image input. | |
| image18opt | IMAGE | Optional reference image input. | |
| image19opt | IMAGE | Optional reference image input. | |
| image20opt | IMAGE | Optional reference image input. | |
| image21opt | IMAGE | Optional reference image input. | |
| image22opt | IMAGE | Optional reference image input. | |
| image23opt | IMAGE | Optional reference image input. | |
| image24opt | IMAGE | Optional reference image input. |
Outputs (3)
| Name | Type | Description |
|---|---|---|
| text | STRING | โ |
| used_model | STRING | โ |
| status | STRING | โ |