ComfyUI Node: 🦙 Ollama Video Describer 🦙

Authored by alisson-anjos

Created

Updated

122 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

Ollama

Inputs

model
  • llava:7b-v1.6-vicuna-q2_K (Q2_K, 3.2GB)
  • llava:7b-v1.6-mistral-q2_K (Q2_K, 3.3GB)
  • llava:7b-v1.6 (Q4_0, 4.7GB)
  • llava:13b-v1.6 (Q4_0, 8.0GB)
  • llava:34b-v1.6 (Q4_0, 20.0GB)
  • llava-llama3:8b (Q4_K_M, 5.5GB)
  • llava-phi3:3.8b (Q4_K_M, 2.9GB)
  • llama3.2-vision:11b (Q4_K_M, 7.9GB)
  • minicpm-v:8b (Q4_0, 5.5GB)
  • moondream:1.8b (Q4, 1.7GB)
  • moondream:1.8b-v2-q6_K (Q6, 2.1GB)
  • moondream:1.8b-v2-fp16 (F16, 3.7GB)
  • qwen3.5:0.8b (1.0GB)
  • qwen3.5:2b (2.7GB)
  • qwen3.5:4b (3.4GB)
  • qwen3.5:9b (6.6GB)
  • qwen3.5:27b (17GB)
  • qwen3.5:cloud
  • qwen3.5:397b-cloud
custom_model STRING
api_host STRING
timeout INT
temperature FLOAT
top_k INT
top_p FLOAT
repeat_penalty FLOAT
seed_number INT
num_ctx INT
max_tokens INT
keep_model_alive INT
video_frames IMAGE
frame_skip INT
max_frames INT
system_context STRING
prompt STRING
structured_output_format STRING

Outputs

STRING

Extension: ComfyUI-Ollama-Describer

This is an extension for ComfyUI that makes it possible to use some LLM models provided by Ollama, such as Gemma, Llava (multimodal), Llama2, Llama3 or Mistral. Speaking specifically of the LLaVa - Large Language and Vision Assistant model, although trained on a relatively small dataset, it demonstrates exceptional capabilities in understanding images and answering questions about them. This model presents similar behaviors to multimodal models such as GPT-4, even when presented with invisible images and instructions.

Authored by alisson-anjos

Looking for a different node?

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more