Nodes/VRGameDevGirl Video Enhancement Nodes/๐Ÿง  VRGDG SuperGemma GGUF Chat ๐Ÿง 
ComfyUI Node

๐Ÿง  VRGDG SuperGemma GGUF Chat ๐Ÿง 

Run Gemma as a GGUF inside ComfyUI, no llama.cpp shell needed

By vrgamegirl19ยทCreated about a year agoยทUpdated about 7 hours agoยท 718
๐Ÿง  VRGDG SuperGemma GGUF Chat ๐Ÿง 
  • image1
  • image2
  • image3
  • image4
  • image5
  • image6
  • image7
  • image8
  • image9
  • image10
  • image11
  • image12
  • image13
  • image14
  • image15
  • image16
  • image17
  • image18
  • image19
  • image20
  • image21
  • image22
  • image23
  • image24
  • text
  • used_model
  • status
โ—„model_file[No Gemma GGUF found in models/LLM]โ–บ
โ—„mmproj_file[No mmproj GGUF found in models/LLM]โ–บ
โ—„task_presettext_to_imageโ–บ
โ—„custom_instructionsโ–บ
โ—„user_inputโ–บ
โ—„trigger_wordโ–บ
โ—„image_count0โ–บ
โ—„advancedfalseโ–บ
โ—„unload_after_runfalseโ–บ
โ—„n_ctx262144โ–บ
โ—„n_gpu_layers99โ–บ
โ—„n_threads8โ–บ
โ—„chat_formatโ–บ
โ—„temperature0.60โ–บ
โ—„top_p0.95โ–บ
โ—„max_new_tokens800โ–บ

VRGDG_SuperGemmaGGUFChat loads a Gemma model as a quantized GGUF file and runs it for text generation directly inside ComfyUI. "SuperGemma" is the author's branding - you won't find it on a model card, and that's fine; underneath it's a plain llama.cpp-backed Gemma chat node with task presets bolted on.

Why Gemma specifically? Gemma 3 is the text encoder inside LTX-2 and LTX-2.3, and its full fp16 weights are a 22GB monster that causes most of the OOM errors in the LTX community. Running a GGUF quantization of it - Q8 is basically fp16 at half the size, as the GGUF crowd likes to say - is the low-VRAM path. This node gives you that same model for prompt enhancement and captioning without a separate llama.cpp setup.

The gotcha you'll hit first

The model_file dropdown defaults to [No Gemma GGUF found in models/LLM]. That's not a bug - it's the node telling you, honestly, that you haven't put a model where it looks yet. Drop a Gemma .gguf into ComfyUI/models/LLM/ (only files with "gemma" in the name are listed), restart or refresh, and the dropdown fills in. If you want to send images to the model, you also need an mmproj_file - the multimodal projector GGUF, also under models/LLM - but that's only required when you actually use image inputs.

The inputs that actually matter

This node has a lot of fields, but you can ignore most of them.

  • task_preset - the one to understand. Pick text_to_image, text_to_video, image_to_video, image_edit, or captioner_training, and the node injects built-in instruction blocks tuned for that job. custom uses your own custom_instructions. For the music-video workflow, text_to_video and image_to_video are the scene-prompt writers; captioner_training is for captioning LoRA training data.
  • user_input - your actual task details and creative direction.
  • image_count - how many of the optional image slots (up to 24) to show on the node. Turn it up if you're handing the model a batch of reference frames.
  • advanced - flips on the GGUF runtime controls. n_ctx defaults to Gemma's full 262144-token training context, which is enormous; if RAM or VRAM pressure is high, lower it hard (16384 is plenty for prompt work). n_gpu_layers 99 means offload everything to GPU; -1 also offloads all supported layers. unload_after_run frees memory after each generation - worth enabling if the workflow then wants those GBs back for video.

Outputs: text (the response), used_model, and status.

Installing

Shared pack install:

cd ComfyUI/custom_nodes
git clone https://github.com/vrgamegirl19/comfyui-vrgamedevgirl

or Manager โ†’ search "vrgamedev", restart. No extra Python deps beyond the pack's shared ones - the GGUF runtime is bundled with the node.

The honest verdict

This is the right tool when you want Gemma-class prompt enhancement or captioning inside ComfyUI without juggling an external process, and the task presets genuinely save time. Where people get burned: forgetting the model file (the empty dropdown), leaving n_ctx at 262144 on a 16GB machine, and expecting the mmproj to be optional when they've wired up images. Mind those three and it's a smooth, fully-local Gemma. It's also the rare node where "SuperGemma" being an in-house name is worth knowing - so when you google it and find nothing, you're not missing a secret model, you're just looking at a well-nicknamed wrapper.

CategoryVRGDG/LLM

Inputs (40)

NameTypeDefaultDescription
model_fileCOMBO[No Gemma GGUF found in models/LLM]Gemma GGUF models found under ComfyUI/models/LLM. Only .gguf files with 'gemma' in the name are shown.
mmproj_fileCOMBO[No mmproj GGUF found in models/LLM]mmproj GGUF files found under ComfyUI/models/LLM. Required only when using image inputs.
task_presetCOMBOtext_to_imageSelect a task preset with built-in instructions.
custom_instructionsSTRINGUsed only when task_preset is custom. Enter your own full instruction block.
user_inputSTRINGYour task details and creative direction for the selected preset.
trigger_wordSTRINGOptional LoRA/training trigger token. Used only by Captioner preset.
image_countINT00โ€“24How many optional image inputs to show on the node.
advancedBOOLEANfalseShow advanced GGUF runtime controls such as context, GPU layers, threads, sampler, and token limits.
unload_after_runBOOLEANfalseIf enabled, unload the GGUF model from cache after this run to free RAM/VRAM.
n_ctxINT262144512โ€“262144GGUF context window. SuperGemma defaults to the full 262144-token training context; lower this if RAM/VRAM is too high.
n_gpu_layersINT99-1โ€“200How many layers to offload to GPU. Use -1 to offload all supported layers.
n_threadsINT81โ€“128CPU threads used by llama.cpp.
chat_formatSTRINGOptional llama.cpp chat format override. Leave blank to use the model default.
temperatureFLOAT0.600โ€“2Higher = more creative variation, lower = more deterministic output.
top_pFLOAT0.950โ€“1Nucleus sampling cutoff.
max_new_tokensINT80032โ€“32000Maximum number of output tokens.
image1optIMAGEOptional reference image input.
image2optIMAGEOptional reference image input.
image3optIMAGEOptional reference image input.
image4optIMAGEOptional reference image input.
image5optIMAGEOptional reference image input.
image6optIMAGEOptional reference image input.
image7optIMAGEOptional reference image input.
image8optIMAGEOptional reference image input.
image9optIMAGEOptional reference image input.
image10optIMAGEOptional reference image input.
image11optIMAGEOptional reference image input.
image12optIMAGEOptional reference image input.
image13optIMAGEOptional reference image input.
image14optIMAGEOptional reference image input.
image15optIMAGEOptional reference image input.
image16optIMAGEOptional reference image input.
image17optIMAGEOptional reference image input.
image18optIMAGEOptional reference image input.
image19optIMAGEOptional reference image input.
image20optIMAGEOptional reference image input.
image21optIMAGEOptional reference image input.
image22optIMAGEOptional reference image input.
image23optIMAGEOptional reference image input.
image24optIMAGEOptional reference image input.

Outputs (3)

NameTypeDescription
textSTRINGโ€”
used_modelSTRINGโ€”
statusSTRINGโ€”