ComfyUI_RH_OminiControl is a ComfyUI plugin based on OminiControl By splitting the pipeline load, the plugin efficiently runs on NVIDIA RTX 4090 GPUs. Additionally, the spatial and fill functionalities are generated using the schnell model, reducing the number of sampling steps and improving overall efficiency.
ComfyUI_RH_OminiControl is a ComfyUI plugin based on OminiControl By splitting the pipeline load, the plugin efficiently runs on NVIDIA RTX 4090 GPUs. Additionally, the spatial and fill functionalities are generated using the schnell model, reducing the number of sampling steps and improving overall efficiency.
Clone the plugin repository into custom_nodes:
git clone https://github.com/HM-RunningHub/ComfyUI_RH_OminiControl.git
/models/flux
tree
.
├── FLUX.1-schnell
│ ├── ae.safetensors
│ ├── model_index.json
│ ├── README.md
│ ├── scheduler
│ │ └── scheduler_config.json
│ ├── schnell_grid.jpeg
│ ├── text_encoder
│ │ ├── config.json
│ │ └── model.safetensors
│ ├── text_encoder_2
│ │ ├── config.json
│ │ ├── model-00001-of-00002.safetensors
│ │ ├── model-00002-of-00002.safetensors
│ │ └── model.safetensors.index.json
│ ├── tokenizer
│ │ ├── merges.txt
│ │ ├── special_tokens_map.json
│ │ ├── tokenizer_config.json
│ │ └── vocab.json
│ ├── tokenizer_2
│ │ ├── special_tokens_map.json
│ │ ├── spiece.model
│ │ ├── tokenizer_config.json
│ │ └── tokenizer.json
│ ├── transformer
│ │ ├── config.json
│ │ ├── diffusion_pytorch_model-00001-of-00003.safetensors
│ │ ├── diffusion_pytorch_model-00002-of-00003.safetensors
│ │ ├── diffusion_pytorch_model-00003-of-00003.safetensors
│ │ └── diffusion_pytorch_model.safetensors.index.json
│ └── vae
│ ├── config.json
│ └── diffusion_pytorch_model.safetensors
└── OminiControl
├── depth-anything-small-hf
│ ├── config.json
│ ├── model.safetensors
│ ├── preprocessor_config.json
│ └── README.md
├── experimental
│ ├── canny.safetensors
│ ├── coloring.safetensors
│ ├── deblurring.safetensors
│ ├── depth.safetensors
│ ├── fill.safetensors
│ └── subject.safetensors
├── omini
│ ├── subject_1024_beta.safetensors
│ └── subject_512.safetensors
└── README.md
12 directories, 39 files
Flux model in diffusers format, download here: https://huggingface.co/black-forest-labs/FLUX.1-schnell
depth-anything-small-hf/ (for depth recognition, download here: https://huggingface.co/LiheYoung/depth-anything-small-hf/tree/main)
experimental/ (download here: https://huggingface.co/Yuanshi/OminiControl/tree/main/experimental)
omini/ (download here: https://huggingface.co/Yuanshi/OminiControl/tree/main/omini)
One-click cloud run: https://www.runninghub.ai/post/1865085524393500674.
Thanks to Yuanshi9815 and the OminiControl project for providing the foundational support.