Extensions/ComfyUI-FunPack
ComfyUI Extension

ComfyUI-FunPack

A set of custom nodes designed for experiments with video diffusion models.

By digital-garbage·Created about a year ago·Updated about 10 hours ago· 21
olivv-cs/ComfyUI-FunPack
Nodes25
On cloudLocal install
CategoryFunUI/Conditioning, FunUI/Latent
Stars21
Updatedabout 10 hours ago

Nodes (25)

FunUI Apply Prompt Markup

Making (word:1.5) mean something on an LLM encoder

FunUI/Conditioning
FunUI Aspect Size
FunUI/Latent
FunUI Checkpoint Loader

The FunUI Checkpoint Loader, Read Honestly

FunUI/Loaders
FunUI CLIP Loader

Four encoder slots and a family dropdown core won't give you

FunUI/Loaders
FunUI Cut Opening

Trim the head off a clip without desyncing the sound

FunUI/Output
FunUI Decode

The VAE decode that knows some latents have two parts

FunUI/Output
FunUI Diffusion Model Loader

The precision knobs, the int8 trick, and the sparse-attention switch that actually earns its keep

FunUI/Loaders
FunUI Empty Latent

How FunUI Empty Latent Gets Its Shape

FunUI/Latent
FunUI Enhance Prompt

An Enhancer That Hands Your Prompt Back Unchanged When It Fails

FunUI/Conditioning
FunUI Guide Frames
FunUI/Conditioning
FunUI Identity Transfer

Carrying a Face Into an LTX Clip Without Training a LoRA

FunUI/Conditioning
FunUI Latent Resample

Sharpen or Upscale Between Passes Without Breaking Your Conditioning

FunUI/Latent
FunUI Load Latent Upscaler

The Latent Upscaler Loader for Files ComfyUI's Own Node Won't Touch

FunUI/Latent
FunUI Load Media

An ID, Not a Filename

FunUI/Media
FunUI Load Modifiers

Turning On FunUI's Sampler Tricks Without Changing Your Sampler

FunUI/Sampling
FunUI LoRA Loader

One LoRA Per Node, and It Tells You When One Did Nothing

FunUI/Loaders
FunUI Modifier Settings

One JSON box that stands in for forty widgets

FunUI/Sampling
FunUI Negative Erase

Giving the negative prompt a job at CFG 1

FunUI/Conditioning
FunUI Prompt Markup

Attention Weights That Actually Work on an LLM Encoder

FunUI/Conditioning
FunUI Sampler

The Sampler With One Dial That Actually Matters

FunUI/Sampling
FunUI Save Video

MP4 Out, on the GPU Encoder, Without the Last Minute of Nothing

FunUI/Output
FunUI Shot Camera

Shot Grammar for H3 Prompts, Written by Rules Instead of a Model

FunUI/Conditioning
FunUI Train LoRA

Train on the clips you rated, not a folder you assembled

FunUI/Training
FunUI Upscale Video

Upscale the Finished MP4 and Keep the Sound, No Graph Rebuild

FunUI/Output
FunUI VAE Loader

Stop Letting ComfyUI Guess Your VAE's Precision

FunUI/Loaders
Readme

FunUI (formerly FunPack)

Welcome to FunUI repository - an open-source video generation and editing studio based on ComfyUI backend.

<p align="left"> <a href="https://ko-fi.com/M4M61MBGIT"><img src="https://img.shields.io/badge/Support%20me%20on%20Ko--fi-FF5E5B?style=for-the-badge&amp;logo=kofi&amp;logoColor=white" alt="Ko-fi" height="36"></a>&nbsp; <a href="https://patreon.com/digitalgarbage?utm_medium=unknown&amp;utm_source=join_link&amp;utm_campaign=creatorshare_creator&amp;utm_content=copyLink"><img src="https://img.shields.io/badge/Become%20a%20Patron-FF424D?style=for-the-badge&amp;logo=patreon&amp;logoColor=white" alt="Patreon" height="36"></a>&nbsp; <a href="https://cloud.vast.ai/?ref_id=308176"><img src="https://img.shields.io/badge/Run%20on-Vast.ai-BCFF41?style=for-the-badge&amp;logoColor=000000" alt="Vast.ai" height="36"></a> </p>

[!IMPORTANT] Despite extensive multi-round testing and reviewing the code with AI agents and personally, some issues and/or undiscovered bugs still may remain in stable releases. If you discover a bug or wish to suggest a new feature, please open a new issue in this repo's Issues.

[!NOTE] "ComfyUI-FunPack" on Comfy Registry and FunUI on GitHub is the same app.

<p align="center"><img src="docs/images/studio.jpg" alt="FunUI studio: preview, scene settings and a six-clip timeline" width="900"></p>

What's FunUI?

The main idea behind FunUI is gathering as many useful features as possible inside one app, while offering a thought-out interface designed for maximum speed of daily operation.

How does it do it?

  • Timeline: add videos, audio, pictures, effects and text. Crop, split, move and render.
  • Media bin: upload media, select and clear aspect ratio sources and references/starting images in one click.
  • Prompt management: build your shortcuts (keywords that expand into full sentences and act like wildcards), use variables (type $variable_name in the prompt and it's replaced with its value), prepend and append text to each scene's prompt with Prefix and Postfix, and split scenes on timeline automatically with Cut words in your prompt.
  • Projects: switch between different pipelines in one click.
  • Presets: you don't have to wire all nodes manually - built-in presets save you time on generic tasks.
  • Controls: fast access to sampler settings, project settings and customizable picker wheel - what's most used is most accessible.
  • Features: lots of operations such as upscaling, interpolation, inference speedup techniques, mixed precision - already built-in or can be activated and installed within 3 clicks.
  • Designed to tend to your taste: rate resulting videos and compatible features will react according to your ratings, gradually changing outputs according to your preferences.

FunUI opens at ComfyUI's host:port/fun/ in your browser after you start ComfyUI, e.g. 127.0.0.1:8888/fun.

A look around

Every picture below is the real app, shown with an abstract demo project (clips made with ffmpeg, no model output).

Write the story once

Composer holds the whole story in one box. A cut word splits it into scenes, $variables fill in what repeats, and templates and shortcuts keep your own wording close. The optional Enhance tab has a language model polish each prompt.

<p align="center"><img src="docs/images/composer-story.jpg" alt="Composer, Story tab" width="900"></p> <p align="center"><img src="docs/images/composer-enhance.jpg" alt="Composer, Enhance tab" width="900"></p>

Start a project in three steps

The Project Setup Wizard picks your look, names the project and loads the pipeline of the model you will use. No tabs, one step at a time.

<p align="center"><img src="docs/images/wizard.jpg" alt="Project Setup Wizard" width="900"></p>

Pipeline as cards, not a graph

Pick a file in each card, swap or add nodes, import a ComfyUI workflow. FunUI says when every slot is filled and names the first thing missing when it is not.

<p align="center"><img src="docs/images/pipeline.jpg" alt="Models and Pipeline" width="900"></p>

Every module, one place

Modules announce their own settings, so Engine settings is always complete. Turn any module on or off in Settings > Modules.

<p align="center"><img src="docs/images/engine.jpg" alt="Engine settings" width="900"></p> <p align="center"><img src="docs/images/modules.jpg" alt="Modules" width="900"></p>

Quick sampler settings

Steps, sampler, scheduler, seed and the common switches are one click away from the timeline, without leaving the clip you are working on.

<p align="center"><img src="docs/images/sampler.jpg" alt="Quick sampler settings" width="900"></p>

Picker wheel

Press the middle mouse button anywhere and your most used actions fan out under the pointer. Release on one to run it. Which actions appear is up to you.

<p align="center"><img src="docs/images/wheel.jpg" alt="Picker wheel" width="900"></p>

Train your own LoRA (add-on)

Teach the model your style from your own media and results you rated. Pick the data, describe each item, press Start. It is an add-on you switch on in Settings > Modules, and it has been run on MiniMax H3 only.

<p align="center"><img src="docs/images/training-data.jpg" alt="LoRA training, data step" width="900"></p> <p align="center"><img src="docs/images/training-tags.jpg" alt="LoRA training, tags step" width="900"></p> <p align="center"><img src="docs/images/training-train.jpg" alt="LoRA training, train step" width="900"></p>

Dark or light

<p align="center"><img src="docs/images/studio-light.jpg" alt="Light theme" width="900"></p>

Installation

With git, inside your ComfyUI/custom_nodes directory:

git clone https://github.com/digital-garbage/FunUI && cd FunUI && pip install -r requirements.txt

comfy-cli (comfy node install ComfyUI-FunPack) and ComfyUI-Manager install ComfyUI-FunPack from Comfy Registry. Check Settings > About FunUI after installing to see which version you have.

Dependencies

FunUI uses your existing ComfyUI/PyTorch install. Optional dependencies install automatically when you install it from ComfyUI-Manager or comfy-cli, or can be manually installed from terminal: pip install -r requirements.txt inside FunUI folder.

Models

Manually tested on Hailuo MiniMax-H3, Lightricks LTX2.3, Lightricks LTX 2.5 and Stable Diffusion 1.5. Running other models using built-in modules is possible but not guaranteed.

Documentation

Start with How to start generating with FunUI. The app also has a guided tour: Help -> Start tour.

Writing a module or a UI feature? Start with Developing FunUI.

Version history is available in CHANGELOG.md.

Feedback

If you have suggestions, questions, or ideas for new features, feel free to open an issue or submit a pull request.

Intent

FunUI is provided under GNU General Public License V3, which gives you broad rights to use, modify and distribute the original/modified version of it as long as the original license text is included. FunUI places no limitations on types of content you can generate by using it, meaning both SFW and NSFW content are fine as long as you don't violate your local laws. GPLv3 does not grant you rights for such violations.

However, I do not endorse using FunUI and/or demonstrating it alongside morally and legally questionable/prohibited content, including:

  • Non-consensual explicit depiction of a real person;
  • Explicit depiction of minors;
  • Depiction of violence and gore targeted at a real person.

I do not provide support to users who use FunUI in such cases, and in case I detect it, any support will be immediately ceased.

Thanks for understanding.

Thank you

I express my deepest gratitude to everyone who inspired FunUI, helped with its development at any stage, and whose ideas and researches have been ported into it:

  • ComfyUI and its whole community;
  • Anthropic and Claude Code;
  • OpenAI and ChatGPT Codex;
  • xAI and Grok Build;
  • Team Cursor and Composer model;
  • DeepSeek team and model;
  • Google and Gemini model;
  • Lightricks and the LTX-Video model; FunUI's identity-transfer phase tag is a port of ltx_core (Apache-2.0);
  • ComfyUI-LTXVideo — the LTX nodes used by the LTX pipeline presets;
  • ComfyUI-KJNodes — utility nodes used by the H3 pipeline presets;
  • ComfyUI-GGUF — reads quantized .gguf encoders when it is installed;
  • ComfyUI-H3-SLA-Attention (MIT) — the SLA block-sparse attention for MiniMax H3 is ported from it, and its kernel and block map come from LightX2V (Apache-2.0);
  • Veda by veda-sparse (MIT; paper "Veda: Scalable Video Diffusion via Distilled Sparse Attention", Han, Yang, Hu, Mei, Jiang and Qi, ICML 2026, arXiv 2605.30325) and its training code Miowtion (MIT) — the "veda" method of the loader's sparse attention (tiling, tile plans, predictor scoring and tile selection) is rewritten from their code; its INT8 kernel derives from SageAttention 1.0.6 by Jintao Zhang and Haofeng Huang (BSD-3-Clause). Licence notices in modules/loaders/VEDA-NOTICE.txt. The Veda predictor files are not part of FunUI: they stay under the MiniMax H3 Community License and are downloaded by you, on your click, from their official Hugging Face repositories;
  • ComfyUI-MiniMaxH3_LatentUpscaler by Tr1dae — the tiled H3 decode and the X2 Detail VAE output handling are ported from its "VAE Decode (fast)";
  • JoyAI-Echo by jd-opensource — the cross-shot memory idea behind the Guide frames "Memory" mode;
  • the authors of the papers behind the sampling modules: ALG (arXiv 2506.08456), FreeSliders (2511.00103), Decisiveness (2510.01184), BachVid (2510.21696) and KV-Lock "When to Lock Attention" (2603.09657) for the Identity bank, momentum (2602.20360), "Pulling The REINS" (2606.17257) STAS (2603.17825) and GSRS (2610.21129, Dai, Chen, Wen, Zhuang, Chen, Zeng: the rising sparsity schedule in SLA);
  • OpenCut — the in-browser non-linear video editor whose UI and interaction patterns inspired FunUI's timeline studio;
  • Inter and IBM Plex Mono — the fonts of the app (SIL Open Font License; copies in app/assets/fonts);
  • musubi-tuner by kohya-ss (Apache-2.0) — the LoRA training add-on's loop (which layers get a LoRA, per-block checkpointing, noise sampling and loss weighting, optimizer and learning rate) and its block swap (a number of transformer blocks kept in system memory) follow its MiniMax H3 training recipe;
  • PTD few-step support for MiniMax H3 is ported from ComfyUI-PTD-Compact by Nynxz (Apache-2.0), which builds on ComfyUI-PTD by EPFL VITA Lab (Apache-2.0; paper "Parametric Trajectory Distillation for Few-Step Video Generation", arXiv 2610.11498) and on ComfyUI-MiniMaxH3-PTD by taobao-content-ai (Apache-2.0); licence notice in modules/sampling/ptd;
  • NVIDIA and the NVIDIA Video Effects SDK (nvidia-vfx, NVIDIA's own licence) — RTX Super Resolution in Upscale and RTX Frame Generation in Interpolate run on it; FunUI installs it only when you switch the add-on on;
  • NVIDIA and the authors of Sol-H3 (arXiv 2609.35110, NVlabs/Sana, Apache-2.0) — the MXFP8 loader option (which blocks stay in bf16) and the Two stages setting (the cross-resolution schedule) follow its recipe;
  • Tero Karras, Miika Aittala, Timo Aila and Samuli Laine (Elucidating the Design Space of Diffusion-Based Generative Models, arXiv 2206.00364) — the churn idea (fresh noise added during sampling) behind the Turbo sampler's fresh-noise step;
  • Don Mitchell and Arun Netravali (the cubic filter family, SIGGRAPH 1988), Edwin Catmull and Raphael Rom (the Catmull-Rom spline, 1974) and Claude Duchon (the Lanczos window, 1979) — the Mitchell, Catmull-Rom and Lanczos choices when Two stages resizes the latent;
  • NVIDIA and the authors of Open-H3-Regenerate-2K (NVlabs/Sana) — the refiner LoRA's published layout, sampling recipe (a second stage at the full size) and strength convention that the LoRA Loader's Diffusers-layout reading and its "Apply to stage" option are built for; and Kijai, whose published conversion notes (fused attention, order of the gated MLP halves) were used to check our translation;
  • Timothy Lottes (NVIDIA, FXAA) - the idea behind the Post setting "Smooth jagged edges": soften only the pixels on a contrasty edge (written fresh, not copied);
  • LBH-123-AI (Comfyui_Minimax_h3_latent_Upscaler) and TripleHeadedMonkey (ComfyUI-MiniMaxH3_LatentUpscaler) — the H3 latent upscaler network (rebuilt from the published weights, not copied) and its use in Second pass and as the Two stages enlarge option;
  • The Turbo sampler (stochastic flow step, polish step) rests on consistency models (Song, Dhariwal, Chen, Sutskever; arXiv 2303.01469), latent consistency models (Luo, Tan, Huang, Li, Zhao; arXiv 2310.04378) and the ancestral noise injection of k-diffusion by Katherine Crowson; its second-order late steps reuse Distilled Flow;

Without all of you, this project would've been impossible.

With <3

DigitalGarbage