ComfyUI Extension: ObjectFusion_ComfyUI_nodes

Authored by ducido

Created

Updated

1 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

This is a node to generate new image that combine 2 objects from different scene.

Looking for a different extension?

Custom Nodes (0)

    README

    🎨 Object Fusion Pipeline

    🌟 Motivation

    Have you ever fantasized about crafting a single masterpiece from elements of different photos? 😲 What if I told you that manually prompting each object's shape, color, and features for diffusion could be a thing of the past? And let’s be real, using GPT to describe each object step by step can feel like chasing an AI in slow motion. 🐢💤

    Here, I introduce a complete pipeline that takes two images as input, allowing you to choose which objects from the images you want to fuse seamlessly.

    🚀 Features

    • Combine objects from two different images into a single scene.
    • Easy selection and customization of objects to be fused.
    • Optimized integration with ComfyUI.

    🖼️ Some Examples

    Example 2

    <details> <summary>Click to expand/collapse</summary>

    Example 1 Example 3 Example 4

    </details>

    🛠️ Installation

    1. Clone this repo into the custom_nodes directory in ComfyUI:

      git clone https://github.com/ducido/ObjectFusion_ComfyUI_nodes

    2. Clone these amazing repositories and follow their instructions:

    3. Install the required packages:

      conda create -n objectfusion python=3.10 -y
conda activate objectfusion
pip install -r custom_nodes/ObjectFusion_ComfyUI_nodes/requirements.txt
wget https://huggingface.co/camenduru/YoloWorld-EfficientSAM/resolve/main/efficient_sam_s_gpu.jit -P custom_nodes/ObjectFusion_ComfyUI_nodes/Custom_ComfyUI_YoloWorld_EfficientSAM

    4. Or you can install with ComfyUI-Manager which is much easier and faster.

    📌 Note

    All the folders, except CROP_OBJECT, are from other repositories. Thank you for your amazing works, I appreciate that. Besides, I have made some minor modifications to fit this project. Here are the details:

    • Custom_ComfyUI-YoloWorld-EfficientSAM

      • Added 2 output fields: BBOX, categories.
      • Displayed ID also in the IMAGE output (e.g., {ID} - {class} - {confidence}).

    • comfyui-llm-assistant

      • Removed input field: prompt.
      • Added 4 input fields: object1, desc_obj1, object2, desc_obj2.
      • Change all default value to "" because the newest frontend of ComfyUI consider None value as a bug

    🤝 Contributing

    Contributions are welcome! Please open an issue or submit a pull request.

    📄 License

    This project is licensed under the MIT License.

    Run ComfyUI workflows without the setup

    No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

    Learn more