ComfyUI Extension: Comfyui_CXH_joy_caption

Authored by StartHua

Created

Updated

472 stars

Nodes:Joy_caption_load, Joy_caption

Custom Nodes (0)

    README

    .20240-10-30 添加批量图片分类

    workflow_min2 6classifiy_

    .2024-10-16 添加批量打标:4090大概4~5秒一张图

    批量打标

    1729064090078

    .2024-10-12 添加joy alpha2

    模型下载:https://pan.baidu.com/s/1dOjbUEacUOhzFitAQ3uIeQ?pwd=4ypv#list/path=%2F

    Joy_caption_alpha 放到 models\Joy_caption_alpha 下载:https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main/cgrkzexw-599808

    1728728834716

    joy_alpha

    .2024-9-9 florence2 Add Florence-2-large-PromptGen-v1.5 and MiniCPM3-4B(CXH_MinCP3_4B_Load CXH_MinCP3_4B_Chat) MiniCPM3-4B聊天 翻译,改写都很强

    .2024-9-6 florence2 Add Florence-2-base-PromptGen-v1.5

    .2024-9-2 更新批量打标案例(Update batch marking cases) 速度:florence2<min2.6<joy

    1724901350282

    (1).基于comfyui节点图片放推(Recommended based on comfyui node pictures)

    1.Joy_caption
    
    2.miniCPMv2_6_prompt_generator
    
    3.florence2
    

    (2).安装(Installation):

    1.(Comfyui evn python.exe) python -m pip install -r requirements.txt or click install_req.bat

    注意:transformers 版本不能太低(Note: The version of transformers cannot be too low)

    1. 下载模型或者运行comfyui自动下载模型到合适文件夹(Download the model or run Comfyui to automatically download the model to the appropriate folder)

    (3) 模型安装(Install model)

    1).Joy_caption

    .运行自动下载模型(推荐手动下载) Run automatic download model (manual download recommended)

    1.https://huggingface.co/google/siglip-so400m-patch14-384 放到(put in)clip/siglip-so400m-patch14-384
      
    

    1724901434148

    2. https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit 放到(put in)LLM/Meta-Llama-3.1-8B-bnb-4bit
      
    

    1724901495135

    3.必须手动下载(Must be downloaded manually):https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6   (put in)Joy_caption 
      
    

    1724901527482

    2).MiniCPMv2_6-prompt-generator + CogFlorence

    https://huggingface.co/pzc163/MiniCPMv2_6-prompt-generator

    https://huggingface.co/thwri/CogFlorence-2.2-Large

    1724902196890

    Run with:flux1-dev-Q8_0.gguf

    e8ad7fa14f807184a99ea23b31e8a60

    1724897220972

    1724897584034