ComfyUI-AniDoc

ComfyUI Custom Nodes for "AniDoc: Animation Creation Made Easier". These nodes, adapted from the official implementations, enables automated line art video colorization using a novel model that aligns color information from references, ensures temporal consistency, and reduces manual effort in animation production.

Installation

1. Navigate to your ComfyUI's custom_nodes directory:

cd ComfyUI/custom_nodes

2. Clone this repository:

git clone https://github.com/LucipherDev/ComfyUI-AniDoc

3. Install requirements:

cd ComfyUI-AniDoc
python install.py

Or Install via ComfyUI Manager

*Custom nodes from ComfyUI-VideoHelperSuite are required for these nodes to function properly.

Example Workflow

Usage

If you installed from the ComfyUI-Manager, all the necessary models should be automatically downloaded into the models/diffusers folder.

Otherwise they will be automatically downloaded when the LoadAniDoc node is used for the first time.

Manually Download the CoTracker Checkpoint and place it in models/cotracker folder to use AniDoc with tracking enabled.

The nodes can be found in "AniDoc" category as AniDocLoader, LoadCoTracker, GetAniDocControlnetImages, AniDocSampler.

Take a look at the example workflow for more info.

Currently our model expects 14 frames video as input, so if you want to colorize your own lineart sequence, you should preprocess it into 14 frames

However, in our test, we found that in most cases our model works well for more than 14 frames (72 frames)

Showcases

*Some demos from the official demo page

*Multiple Characters

*Reference Background

Citation

@article{meng2024anidoc,
      title={AniDoc: Animation Creation Made Easier},
      author={Yihao Meng and Hao Ouyang and Hanlin Wang and Qiuyu Wang and Wen Wang and Ka Leong Cheng and Zhiheng Liu and Yujun Shen and Huamin Qu},
      journal={arXiv preprint arXiv:2412.14173},
      year={2024}
}