ComfyUI Extension: Jovimetrix Composition Nodes

Authored by Amorano

Created

Updated

244 stars

Webcam, MIDI, Spout and GLSL shader support. Animation via tick. Parameter manipulation with wave generator. Math operations, universal value converstion, shape mask generation, image channel ops, batch splitting/merging/randomizing, load image/video from URL, Dynamic bus routing, support for GIPHY, save output anywhere! flatten, crop, transform; check color blindness, make stereograms or stereoscopic images, and much more.

README

<picture> <source media="(prefers-color-scheme: dark)" srcset="https://github.com/Amorano/Jovimetrix-examples/blob/master/res/logo-jovimetrix.png"> <source media="(prefers-color-scheme: light)" srcset="https://github.com/Amorano/Jovimetrix-examples/blob/master/res/logo-jovimetrix-light.png"> <img alt="ComfyUI Nodes for procedural masking, live composition and video manipulation"> </picture> <h2><div align="center"> <a href="https://github.com/comfyanonymous/ComfyUI">COMFYUI</a> Nodes for procedural masking, live composition and video manipulation </div></h2> <h3><div align="center"> JOVIMETRIX IS ONLY GUARANTEED TO SUPPORT <a href="https://github.com/comfyanonymous/ComfyUI">COMFYUI 0.1.3+</a> and <a href="https://github.com/Comfy-Org/ComfyUI_frontend">FRONTEND 1.2.40+</a><br> IF YOU NEED AN OLDER VERSION, PLEASE DO NOT UPDATE. </div></h3> <h2><div align="center">

KNIVES! FORKS!

</div></h2> <!---------------------------------------------------------------------------->

SPONSORSHIP

Please consider sponsoring me if you enjoy the results of my work, code or documentation or otherwise. A good way to keep code development open and free is through sponsorship.

<div align="center">

BE A GITHUB SPONSOR ❤️

DIRECTLY SUPPORT ME VIA PAYPAL

PATREON SUPPORTER

SUPPORT ME ON KO-FI!

</div>

HIGHLIGHTS

  • 30 function BLEND node -- subtract, multiply and overlay like the best
  • Vector support for 2, 3, 4 size tuples of integer or float type
  • Specific RGB/RGBA color vector support that provides a color picker
  • All Image inputs support RGBA, RGB or pure MASK input
  • GLSL shader support
    • GLSL Node provides raw access to Vertex and Fragment shaders
    • Dynamic GLSL dynamically convert existing GLSL scripts file into ComfyUI nodes at runtime
    • Over 20+ Hand written GLSL nodes to speed up specific tasks better done on the GPU (10x speedup in most cases)
  • STREAM READER node to capture monitor, webcam or url media
  • STREAM WRITER node to export media to a HTTP/HTTPS server for OBS or other 3rd party streaming software
  • SPOUT streaming support WINDOWS ONLY
  • MIDI device read support with MIDI FILTER and MIDI FILTER EZ nodes to drive other node parameters
  • Full Text generation support using installed system fonts
  • Basic parametric shape (Circle, Square, Polygon) generator
  • COLOR BLIND check support
  • COLOR MATCH against existing images or create a custom LUT
  • Generate COLOR THEORY spreads from an existing image
  • COLOR MEANS to generate palettes for existing images to keep other images in the same tonal ranges
  • PIXEL SPLIT separate the channels of an image to manipulate and PIXEL MERGE them back together
  • STACK a series of images into a new single image vertically, horizontally or in a grid
  • Or FLATTEN a batch of images into a single image with each image subsequently added on top (slap comp)
  • VALUE Node has conversion support for all ComfyUI types and some 3rd party types (2DCoords, Mixlab Layers)
  • LERP node to linear interpolate all ComfyUI and Jovimetrix value types
  • Automatic conversion of Mixlab Layer types into Image types
  • Generic ARRAY that can Merge, Split, Select, Slice or Randomize a list of ANY type
  • STRINGER node to perform specific string manipulation operations: Split, Join, Replace, Slice.
  • A QUEUE Node that supports recursing directories, filtering multiple file types and batch loading
  • Use the OP UNARY and OP BINARY nodes to perform single and double type functions across all ComfyUI and Jovimetrix value types
  • Manipulate vectors with the SWIZZLE node to swap their XYZW positions
  • DELAY execution at certain parts in a workflow, with or without a timeout
  • Generate curve data with the TICK and WAVE GEN nodes
  • Help System for ALL NODES that will auto-parse unknown knows for their type data and descriptions
  • Colorization for ALL NODES using their own node settings, their node group or via regex pattern matching

HELP SYSTEM

<div align="center">

CLICKING NODES FOR HELP

</div>

The built-in help system will dynamically parse any nodes found at the ComfyUI API endpoint:

<comfyui_web_root>/object_info

If those nodes have descriptions written in HTML or Markdown, they will be converted into HTML for presentation in the panel.

NODE COLORS

<div align="center">

alt text

</div>

UPDATES

2024/10/03 @1.2.42:

  • OpenGL support for macOS with Silicon processors and Linux with Arm64 CPU (aarch64)
  • Shout out to BigCat88 for the PR to fix the above

2024/09/21 @1.2.41:

  • Colorizer panel ported to new frontend.

  • numerical bit conversion for Number fields, String fields (character bits) and Image fields (pixels on/off)

  • new COLOR MEANS node will generate color palettes of the top-k colors of an input

  • new BIT SPLIT node will turn inputs into streams of bits used for modulation and triggering of other inputs

  • Officially Supported Versions:

    • ComfyUI 0.1.3+
    • ComfyUI Frontend 1.2.40+

2024/09/18 @1.2.39:

  • COMPARISON node updated to support NONE for all inputs
  • Fixed bad inputs for IMAGE/MASK where they were compound use on slots
  • Cleaner API Message routes
  • new include system for GLSL shaders
  • GLSL: color, camera, const, curve, noise, sdf, shading and vector library supports
  • new GLSL COLOR PALETTE node based on cosines
  • new GLSL INVERT node
  • new GLSL FILTER RANGE node
  • Officially Supported Versions:
    • ComfyUI 0.1.3+
    • ComfyUI Frontend 1.2.30+

2024/09/09 @1.2.38:

  • QUEUEs will signal true (TRIGGER) on complete unless halted
  • doubled speed of midi reader when idle
  • reduced GLSL footprint for color conversions
    • sorry if that blew someone's network!
  • new GLSL COLOR PALETTE node based on cosines
  • new GLSL HSV ADJUST
  • Officially Supported Versions:
    • ComfyUI 0.1.3+
    • ComfyUI Frontend 1.2.30+

2024/09/08 @1.2.36:

  • MIDI MIDI FILTER and MIDI FILTER EZ Nodes cleaned up
  • COMPARISON Node value conversion fixed
  • new GLSL TRANSFORM Node -- offset, rotate and tile
  • new GLSL POSTERIZE Node
  • new GLSL WARP Node -- warps image based on distortion and strength mask
  • new GLSL CONICAL GRADIENT Node
  • new EDGE mode for GLSL shaders: Clamp, Wrap, Mirror
  • QUEUE TOO Node updated to support batch
  • Officially Supported Versions:
    • ComfyUI 0.1.3+
    • ComfyUI Frontend 1.2.30+

2024/09/05 @1.2.35:

  • VALUE Node defaults fixed on save
  • Colorizer Panel is a undergoing major re-constructive surgery
  • Allow slice reversal in ARRAY Node
  • GLSL Nodes allow for IMAGE or MASK input for RGB(A)
  • NOTE ADJUSTED VERSION NUMBERS TO SHOW OLDEST COMFYUI and FRONTEND VERSIONS SUPPORTED:
    • ComfyUI 0.1.3+
    • ComfyUI Frontend 1.2.30+

INSTALLATION

Please see the wiki for advanced use of the environment variables used during startup

COMFYUI MANAGER

If you have ComfyUI Manager installed, simply search for Jovimetrix and install from the manager's database.

MANUAL INSTALL

Clone the repository into your ComfyUI custom_nodes directory. You can clone the repository with the command:

git clone https://github.com/Amorano/Jovimetrix.git

You can then install the requirements by using the command:

.\python_embed\python.exe -s -m pip install -r requirements.txt

If you are using a <code>virtual environment</code> (<code><i>venv</i></code>), make sure it is activated before installation. Then install the requirements with the command:

pip install -r requirements.txt

WHERE TO FIND ME

You can find me on DISCORD.