Comfy.ICU
ExploreDocsPricing
Support

ComfyUI Extension: Model and Checkpoint Loaders for NF4 and FP4

Authored by silveroxides

Created

Updated

9 stars

Nodes for loading both Checkpoints and UNET/Diffussion models quantized to bitsandbytes NF4 or FP4 format. Still under development and some limitations such as using LoRA might apply still.

Custom Nodes (0)

    README

    ~~NOTE: This is very likely Deprecated in favor of GGUF which seems to give better results~~

    Some users can experience speedup by combining loading UNET as NF4 using the loader from this repo and load T5XXL as GGUF using the repo from https://github.com/city96/ComfyUI-GGUF

    Now on the manager for easy installation. Make sure to select Channel:dev in the ComfyUI manager menu or install via git url.

    You can find the checkpoints and UNET in the linked repositories on huggingface or by searching for NF4 on Civitai

    CivitAI search link

    nf4 flux unet only

    nf4 flux dev checkpoint

    nf4 flux schnell checkpoint

    Requires installing bitsandbytes.

    Make sure your ComfyUI is updated.

    The nodes are:

    "CheckpointLoaderNF4": "Load NF4 Flux Checkpoint"

    "UNETLoaderNF4": "Load NF4 Flux UNET"

    just plug it in your flux workflow instead of the regular ones.

    Code adapted from the implementation by Illyasviel at Forge.