Extensions/Comfyui_CXH_joy_caption
ComfyUI Extension

Comfyui_CXH_joy_caption

Recommended based on comfyui node pictures:Joy_caption + MiniCPMv2_6-prompt-generator + florence2

By StartHua·Created 2 years ago·Updated 2 years ago· 624
StartHua/Comfyui_CXH_joy_caption
Nodes19
On cloudLocal install
CategoryCXH/LLM, Florence2
Stars624
Updated2 years ago

Nodes (19)

CXH_DownloadAndLoadFlorence2Model

Florence 2, downloaded and loaded in one node

CXH/LLM
CXH_Florence2Run

Caption, OCR, or find objects — one node, thirteen tasks

Florence2
CXH_HG_Model_Load

Loads the MiniCPM-V 2.6 prompt generator

CXH/LLM
CXH_IC_Lora_Florence2Run

Captioning image pairs for IC-LoRA clothing datasets

Florence2
CXH_Ic_lora_Joy_batch

IC-LoRA pair captioning with JoyCaption Alpha Two

CXH/Images
CXH_IC_lora_reversal

The caption reverser that doubles your IC-LoRA dataset

Florence2
CXH_Min2_6_classifiy

Sort a folder of images into category folders automatically

CXH/LLM
CXH_Min2_6_prompt_Run

Turn any image into a Stable Diffusion prompt with MiniCPM-V

CXH/LLM
CXH_MinCP3_4B_Chat

A local text LLM inside your ComfyUI graph

CXH/LLM
CXH_MinCP3_4B_Load

MiniCPM3-4B — the pack's text-only chat LLM loader

CXH/LLM
CXH_SmolVlm_Load

SmolVLM — the tiny vision model the pack added later

CXH/LLM
CXH_SmolVlm_Run

Caption with a model that fits in low VRAM

CXH/LLM
Joy_caption

The node that made JoyCaption a ComfyUI staple

CXH/LLM
Joy_caption_alpha_batch

Dataset labeling with JoyCaption Alpha Two and a trigger word

CXH/LLM
Joy_caption_alpha_batch_Dirs

Per-folder captioning that reads your trigger from the folder name

CXH/LLM
Joy_caption_alpha_load

Loader for JoyCaption Alpha Two — the smarter captioner

CXH/LLM
Joy_caption_alpha_prompt

JoyCaption's 9 modes and 17 toggles, without the copy-paste

CXH/LLM
Joy_caption_alpha_run

Alpha Two captioning, one image at a time

CXH/LLM
Joy_caption_load

The loader half of ComfyUI's JoyCaption setup

CXH/LLM
Readme

添加批量文件夹打标:文件夹命名规则 名字_trigg workflow 1737366489766

.20240-10-30 添加批量图片分类

workflow_min2 6classifiy_

.2024-10-16 添加批量打标:4090大概4~5秒一张图

批量打标

1729064090078

.2024-10-12 添加joy alpha2

模型下载:https://pan.baidu.com/s/1dOjbUEacUOhzFitAQ3uIeQ?pwd=4ypv#list/path=%2F

Joy_caption_alpha 放到 models\Joy_caption_alpha 下载:https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main/cgrkzexw-599808

1728728834716

joy_alpha

.2024-9-9 florence2 Add Florence-2-large-PromptGen-v1.5 and MiniCPM3-4B(CXH_MinCP3_4B_Load CXH_MinCP3_4B_Chat) MiniCPM3-4B聊天 翻译,改写都很强

.2024-9-6 florence2 Add Florence-2-base-PromptGen-v1.5

.2024-9-2 更新批量打标案例(Update batch marking cases) 速度:florence2<min2.6<joy

1724901350282

(1).基于comfyui节点图片放推(Recommended based on comfyui node pictures)

1.Joy_caption

2.miniCPMv2_6_prompt_generator

3.florence2

(2).安装(Installation):

1.(Comfyui evn python.exe) python -m pip install -r requirements.txt or click install_req.bat

注意:transformers 版本不能太低(Note: The version of transformers cannot be too low)

  1. 下载模型或者运行comfyui自动下载模型到合适文件夹(Download the model or run Comfyui to automatically download the model to the appropriate folder)

(3) 模型安装(Install model)

1).Joy_caption

.运行自动下载模型(推荐手动下载) Run automatic download model (manual download recommended)

1.https://huggingface.co/google/siglip-so400m-patch14-384 放到(put in)clip/siglip-so400m-patch14-384
  

1724901434148

2. https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit 放到(put in)LLM/Meta-Llama-3.1-8B-bnb-4bit
  

1724901495135

3.必须手动下载(Must be downloaded manually):https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6   (put in)Joy_caption 
  

1724901527482

2).MiniCPMv2_6-prompt-generator + CogFlorence

https://huggingface.co/pzc163/MiniCPMv2_6-prompt-generator

https://huggingface.co/thwri/CogFlorence-2.2-Large

1724902196890

Run with:flux1-dev-Q8_0.gguf

e8ad7fa14f807184a99ea23b31e8a60

1724897220972

1724897584034