Extensions/Unfied Vision Prompt Generator
ComfyUI Extension

Unfied Vision Prompt Generator

A Qwen 2/2.5, Moondream and SmolVLM LLM caption/prompt genrator

By GraftingRayman·Created 9 months ago·Updated 9 months ago· 1
GraftingRayman/Unified-Vision-Prompt-Generator
Nodes1
On cloudLocal install
CategoryGraftingRayman/Image Processing
Stars1
Updated9 months ago
Readme

A prompt generator for ComfyUI using various different LLM models

    'qwen2vl': [
        'Qwen/Qwen2-VL-2B-Instruct',
        'Qwen/Qwen2-VL-7B-Instruct',
        'Qwen/Qwen2.5-VL-3B-Instruct',
        'Qwen/Qwen2.5-VL-7B-Instruct',
        'Qwen/Qwen2.5-VL-72B-Instruct',
    ],
    'moondream': [
        'vikhyatk/moondream2',
        'vikhyatk/moondream1',
    ],
    'smolvlm': [
        'HuggingFaceTB/SmolVLM-Instruct',
        'HuggingFaceTB/SmolVLM-256M-Instruct',
        'HuggingFaceTB/SmolVLM-500M-Instruct',

I am a bit limited with the amount of VRAM (16GB) that I have, so unable to check any of the high parameter Qwen models, os if you have used them, let me know if they are doing what they should be