Extensions/ComfyUI-Sharp
ComfyUI Extension

ComfyUI-Sharp

SHARP integration for ComfyUI - Monocular 3D Gaussian Splatting in under 1 second. Generate 3D Gaussians from a single image using Apple's SHARP model.

By PozzettiAndrea·Created 8 months ago·Updated 2 months ago· 358
PozzettiAndrea/ComfyUI-Sharp
Nodes17
On cloudLocal install
CategorySHARP
Stars358
Updated2 months ago

Nodes (17)

Align Depth Maps (Global Optimization)

Reconciling scale across multiple SHARP depth predictions

SHARP
Load Image with EXIF (Focal Length)

Stop guessing focal length, read it off the photo

SHARP
(Down)Load SHARP Model

The loader for Apple's 1-second Gaussian Splatting model

SHARP
Merge Gaussians (PLY Files)

Combining multiple PLY files into one point cloud

SHARP
Project Depth to Panorama

Stitching per-view depth back into one equirect map

SHARP
Sample Panorama (Equirect -> Perspective)

Cutting a 360 photo into cameras SHARP can actually see

SHARP
Scale Image Values

A no-knobs normalizer for depth and gaussian data

SHARP
SHARP Image + Attrs to PLY

The save step for hand-edited gaussians

SHARP
Sharp Panorama Cube Split

The WorldStereo-shaped way to cut a panorama

SHARP
SHARP Predict (Image to PLY)

Turn one photo into a 3D Gaussian point cloud

SHARP
SHARP Predict Depth

Just the depth maps, no gaussians

SHARP
SHARP Predict Foreground (Image to PLY)

One clean gaussian layer instead of two

SHARP
SHARP Predict (Depth + Gaussian Attrs)

The raw gaussian data, before anything gets saved

SHARP
SHARP Predict Gaussians (Image + Metric Depth)

Bring your own depth, get consistent gaussians

SHARP
SHARP Predict Metric Depth

Real-world scale depth, both layers, plus raw points

SHARP
SHARP Ray-Distance -> Planar Depth

The unit conversion panorama pipelines need

SHARP
SHARP Refined Depth from Gaussians

Render a saved PLY back into depth maps

SHARP
Readme

[!WARNING] Warning, uses experimental package comfy-env to attempt a one click isolated install. Will download and use pixi package manager.

ComfyUI-Sharp

Installation

Three options, in order of speed → reliability:

  1. ComfyUI Manager (recommended) — search for Sharp in the Manager and click Install from the highest version displayed. If that doesn't work, try nightly.
  2. Manager via Git URL — in ComfyUI Manager: "Install via Git URL" with https://github.com/PozzettiAndrea/ComfyUI-Sharp.git.
  3. Manual (most reliable): 
    cd ComfyUI/custom_nodes
git clone https://github.com/PozzettiAndrea/ComfyUI-Sharp.git
cd ComfyUI-Sharp
pip install -r requirements.txt --upgrade
python install.py

Please report any problems you hit during installation or use of my nodes — open a Discussion or Issue. Very grateful for your help! 🙏

<div align="center"> <a href="https://pozzettiandrea.github.io/ComfyUI-Sharp/"> <img src="https://pozzettiandrea.github.io/ComfyUI-Sharp/gallery-preview.png" alt="Workflow Test Gallery" width="800"> </a> <br> <b><a href="https://pozzettiandrea.github.io/ComfyUI-Sharp/">View Live Test Gallery →</a></b> </div>

ComfyUI wrapper for SHARP by Apple - monocular 3D Gaussian Splatting in under 1 second.

3 Example workflows.

Workflow 1: standard/user input focal length. Workflow

https://github.com/user-attachments/assets/479fb066-4d40-4d7c-a8d4-d1224fc22efa

Workflow 2: focal length extraction from exif data.

Workflow_exif

https://github.com/user-attachments/assets/b0c3e196-aa93-4380-8f8b-9c19b833b818

Workflow 3: Panorama gaussians

https://github.com/user-attachments/assets/f31e6db6-eb3f-4d4a-9d01-089fe9f37326

Note: for PLY inference this model is good on its own, but for the Gaussian Viewer node, you're going to need to install this node as well! https://github.com/PozzettiAndrea/ComfyUI-GeometryPack

Model auto-downloads on first run. For offline use, place sharp_2572gikvuh.pt in ComfyUI/models/sharp/.

Nodes

  • Load SHARP Model - (down)Load the SHARP model
  • SHARP Predict - Generate 3D Gaussians from a single image
  • Load Image with EXIF - Load image and auto-extract focal length from EXIF (35mm equivalent)

Images with EXIF data get focal length auto-calculated when using the Load Image with EXIF node.

Community

Questions or feature requests? Open a Discussion on GitHub.

Join the Comfy3D Discord for help, updates, and chat about 3D workflows in ComfyUI.

Credits

Thanks to Apple for releasing SHARP as open source.