DiffusionLight-ComfyUI

DiffusionLight-ComfyUI

Project Page | Main Repo

DiffusionLight (Turbo) implemented in ComfyUI

This repository is recommended for non-researchers who want to extract lighting information from any image.

Unlike the main DiffusionLight repository, which requires 16GB of VRAM to run, this ComfyUI implementation enables machines with lower VRAM to operate the model efficiently.

If you are looking for more in-depth details, please visit the DiffusionLight's Main repository and DiffusionLight-Turbo repository

How to use

1. Select Input Image
2. Click Run
3. The output HDR Environment map DiffusionLight-0001.hdr will appear at ComfyUI/output

Installation

1. Get ComfyUI
2. Install ComfyUI-Manager
3. Install comfyui_controlnet_aux
4. Download the Stable Diffusion-releated .safetensors:

• 4.1. SDXL Based model (With VAE fix) and put into ComfyUI/models/checkpoints
• 4.2. SDXL Depth ControlNet and put into ComfyUI/models/controlnet
• 4.3. DiffusionLight's Exposure LoRA and put into ComfyUI/models/loras
• 4.4. DiffusionLight's Turbo LoRA and put into ComfyUI/models/loras

5. Clone this repository and place it in ComfyUI/custom_nodes
6. Run ComfyUI and import the workflow file diffusionlight-workflow.json from this repository

Citation

@inproceedings{Chinchuthakun2025DiffusionLightTurbo,
  author = {Chinchuthakun, Worameth and Phongthawee, Pakkapon and Raj, Amit and Jampani, Varun and Khungurn, Pramook and Suwajanakorn, Supasorn},
  title = {DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting},
  booktitle = {ArXiv},
  year = {2025},
}

Visit us 🦉