ComfyUI Extension: ComfyUI MiniCPM-V

Authored by hay86

Created

Updated

42 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Unofficial implementation of a/MiniCPM-V for ComfyUI

Looking for a different extension?

Custom Nodes (1)

README

ComfyUI MiniCPM-V (Unofficial Support)

Unofficial MiniCPM-V support for ComfyUI.

Important Updates

  • 2024/08/09: Added support for MiniCPM-V 2.6 (16GB+ video memory required)
  • 2024/05/22: Added support for MiniCPM-Llama3-V 2.5 (16GB+ video memory required)
  • 2024/04/18: Added ComfyUI nodes and workflow examples

Basic Workflow

This workflow shows the basic usage on querying an image with Chinese and English.

Version 2.6 Workflow

This workflow shows the Verson 2.6's usage on querying multiple images and a video.

Installation

  • Install from ComfyUI Manager (search for minicpm)

  • Download or git clone this repository into the ComfyUI/custom_nodes/ directory and run:

pip install -r requirements.txt

Download Checkpoints

All the models will be downloaded automatically, no worries.

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more