ComfyUI-VideoQuality-Metrics

ComfyUI Video Quality Metrics

A comprehensive suite of video quality assessment metrics for ComfyUI.

Features

Fidelity Metrics

• PSNR - Peak Signal-to-Noise Ratio
• SSIM - Structural Similarity Index
• CIEDE2000 - Perceptually uniform color accuracy

Temporal Metrics

• Warping Error - Optical flow-based temporal consistency
• Flickering Detection - Brightness variance analysis
• Motion Smoothness - Jerk-based motion quality

Distributional Metrics

• FVD - Fréchet Video Distance
• FID - Fréchet Inception Distance

No-Reference Metrics (Deep Learning)

• CLIP-IQA - Aesthetic Scoring & Text Alignment
• DOVER - Disentangled Aesthetic & Technical Quality
• FAST-VQA - Efficient High-Res Quality Assessment

Visualization & Reporting

• Radar Charts - Multi-metric comparison
• JSON Export - Metrics logging
• Statistical Tests - T-test, Wilcoxon for workflow comparison

Installation

cd ComfyUI/custom_nodes
git clone https://github.com/yourusername/ComfyUI-VideoQuality-Metrics.git
pip install -r ComfyUI-VideoQuality-Metrics/requirements.txt

Restart ComfyUI. Nodes appear under VideoQuality/ category.

Video & Batch Handling

All nodes accept Video Tensors [T, H, W, 3] and Image Batches [N, H, W, 3].

• Fidelity Metrics (PSNR, SSIM, ΔE2000): Return the average quality across all frames in the batch.
• Temporal Metrics: Require at least 2 frames (T ≥ 2) to compute motion consistency.
• Distributional Metrics: Compare the entire distribution of the generated batch against the reference batch.

Node Reference

| Node | Inputs | Outputs | |------|--------|---------| | VQ Full-Reference Metrics | images, reference | psnr, ssim, ciede2000, summary | | VQ Temporal Consistency | video_frames | warping_error, flickering_score, summary | | VQ Motion Smoothness | video_frames | smoothness_score, mean_jerk, summary | | VQ FVD | video_generated, video_reference | fvd, summary | | VQ FID | images_generated, images_reference | fid, summary | | VQ CLIP Aesthetic | images | aesthetic_score, summary | | VQ Text Alignment | video, prompt | alignment_score, summary | | VQ DOVER Quality | video | aesthetic, technical, overall, summary | | VQ FAST-VQA | video | quality_score, summary | | VQ Radar Chart | psnr, ssim, ... | radar_chart, metrics_json | | VQ Metrics Logger | metrics | json_output |

Interpretation Guidelines

| Metric | Excellent | Good | Fair | Poor | |--------|-----------|------|------|------| | PSNR | > 35 dB | 30-35 dB | 25-30 dB | < 25 dB | | SSIM | > 0.95 | 0.90-0.95 | 0.85-0.90 | < 0.85 | | ΔE2000 | < 1.0 | 1.0-2.0 | 2.0-5.0 | > 5.0 | | FVD | < 50 | 50-150 | 150-300 | > 300 | | CLIP Aesthetic | > 0.7 | 0.6-0.7 | 0.4-0.6 | < 0.4 | | DOVER (Overall) | > 0.6 | 0.4-0.6 | 0.2-0.4 | < 0.2 | | FAST-VQA | > 0.65 | 0.5-0.65 | 0.3-0.5 | < 0.3 |

Technical Documentation

See doc.md for the complete theoretical framework.

License

MIT License