ComfyUI Node
ialhabbal VLLM GGUF Advanced
A ComfyUI node in π§ͺialhabbal_VLLM with 19 inputs and 1 output.
ialhabbal VLLM GGUF Advanced
- image
- video
- RESPONSE
βmodel_nameGemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q8_K_P.ggufβΊ
βdeviceautoβΊ
βpreset_promptπΌοΈ Detailed DescriptionβΊ
βcustom_promptβΊ
βmax_tokens512βΊ
βtemperature0.60βΊ
βtop_p0.90βΊ
βrepetition_penalty1.20βΊ
βframe_count16βΊ
βctx8192βΊ
βn_batch512βΊ
βgpu_layers-1βΊ
βimage_max_tokens4096βΊ
βtop_k0βΊ
βpool_size4194304βΊ
βkeep_model_loadedtrueβΊ
βseed1βΊ
Categoryπ§ͺialhabbal_VLLM
Inputs (19)
| Name | Type | Default | Description |
|---|---|---|---|
| model_name | COMBO | Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf | 9 options: Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf, Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf, Huihui-Qwen3-VL-2B-Instruct-abliterated-Q8_0.gguf, Huihui-Qwen3-VL-4B-Instruct-abliterated-Q8_0.gguf, Qwen2.5-VL-7B-Instruct-abliterated.Q8_0.gguf, Qwen3-VL-8B-Instruct-abliterated-v2.0.Q5_K_M.gguf, +3 |
| device | COMBO | auto | 3 options: auto, cpu, mps |
| preset_prompt | COMBO | πΌοΈ Detailed Description | 9 options: πΌοΈ Tags, πΌοΈ Simple Description, πΌοΈ Detailed Description, πΌοΈ Ultra Detailed Description, π¬ Cinematic Description, πΌοΈ Detailed Analysis, +3 |
| custom_prompt | STRING | β | |
| max_tokens | INT | 51264β4096 | β |
| temperature | FLOAT | 0.600β2 | β |
| top_p | FLOAT | 0.900β1 | β |
| repetition_penalty | FLOAT | 1.200.5β2 | β |
| frame_count | INT | 161β64 | β |
| ctx | INT | 81921024β262144 | β |
| n_batch | INT | 51264β32768 | β |
| gpu_layers | INT | -1-1β200 | β |
| image_max_tokens | INT | 4096256β1024000 | β |
| top_k | INT | 00β32768 | β |
| pool_size | INT | 41943041048576β10485760 | β |
| keep_model_loaded | BOOLEAN | true | β |
| seed | INT | 11β4294967295 | β |
| imageopt | IMAGE | β | |
| videoopt | IMAGE | β |
Outputs (1)
| Name | Type | Description |
|---|---|---|
| RESPONSE | STRING | β |