ComfyUI Extension: Jovimetrix

Authored by Amorano

Created

Updated

309 stars

Webcam, MIDI, Spout, and GLSL support with animation via tick. Features wave-based parameter modulation, math operations, universal value conversion, shape masking, image channel ops, batch processing, dynamic bus routing, GIPHY and SPOUT integration. Load images/videos from URLs, save output anywhere, and apply transformations like flattening, cropping, and color adjustments. Includes tools for color blindness simulation, stereograms, and stereoscopic imagingโ€”plus much more!

Custom Nodes (60)

README

<picture> <source media="(prefers-color-scheme: dark)" srcset="https://github.com/Amorano/Jovimetrix-examples/blob/master/res/logo-jovimetrix.png"> <source media="(prefers-color-scheme: light)" srcset="https://github.com/Amorano/Jovimetrix-examples/blob/master/res/logo-jovimetrix-light.png"> <img alt="ComfyUI Nodes for procedural masking, live composition and video manipulation"> </picture> <h2><div align="center"> <a href="https://github.com/comfyanonymous/ComfyUI">COMFYUI</a> Nodes for procedural masking, live composition and video manipulation </div></h2> <h3><div align="center"> JOVIMETRIX IS ONLY GUARANTEED TO SUPPORT <a href="https://github.com/comfyanonymous/ComfyUI">COMFYUI 0.1.3+</a> and <a href="https://github.com/Comfy-Org/ComfyUI_frontend">FRONTEND 1.2.40+</a><br> IF YOU NEED AN OLDER VERSION, PLEASE DO NOT UPDATE. </div></h3> <h2><div align="center">

KNIVES! FORKS!

</div></h2> <!---------------------------------------------------------------------------->

SPONSORSHIP

Please consider sponsoring me if you enjoy the results of my work, code or documentation or otherwise. A good way to keep code development open and free is through sponsorship.

<div align="center">

ย |ย |ย |ย  -|-|-|- BE A GITHUB SPONSOR โค๏ธ | DIRECTLY SUPPORT ME VIA PAYPAL | PATREON SUPPORTER | SUPPORT ME ON KO-FI!

</div>

HIGHLIGHTS

  • 30 function BLEND node -- subtract, multiply and overlay like the best
  • Vector support for 2, 3, 4 size tuples of integer or float type
  • Specific RGB/RGBA color vector support that provides a color picker
  • All Image inputs support RGBA, RGB or pure MASK input
  • GLSL shader support
    • GLSL Node provides raw access to Vertex and Fragment shaders
    • Dynamic GLSL dynamically convert existing GLSL scripts file into ComfyUI nodes at runtime
    • Over 20+ Hand written GLSL nodes to speed up specific tasks better done on the GPU (10x speedup in most cases)
  • STREAM READER node to capture monitor, webcam or url media
  • STREAM WRITER node to export media to a HTTP/HTTPS server for OBS or other 3rd party streaming software
  • SPOUT streaming support WINDOWS ONLY
  • MIDI READER Captures MIDI messages from an external MIDI device or controller
  • MIDI MESSAGE Processes MIDI messages received from an external MIDI controller or device
  • MIDI FILTER (advanced filter) to select messages from MIDI streams and devices
  • MIDI FILTER EZ simpler interface to filter single messages from MIDI streams and devices
  • Full Text generation support using installed system fonts
  • Basic parametric shape (Circle, Square, Polygon) generator
  • COLOR BLIND check support
  • COLOR MATCH against existing images or create a custom LUT
  • Generate COLOR THEORY spreads from an existing image
  • COLOR MEANS to generate palettes for existing images to keep other images in the same tonal ranges
  • PIXEL SPLIT separate the channels of an image to manipulate and PIXEL MERGE them back together
  • STACK a series of images into a new single image vertically, horizontally or in a grid
  • Or FLATTEN a batch of images into a single image with each image subsequently added on top (slap comp)
  • VALUE Node has conversion support for all ComfyUI types and some 3rd party types (2DCoords, Mixlab Layers)
  • LERP node to linear interpolate all ComfyUI and Jovimetrix value types
  • Automatic conversion of Mixlab Layer types into Image types
  • Generic ARRAY that can Merge, Split, Select, Slice or Randomize a list of ANY type
  • STRINGER node to perform specific string manipulation operations: Split, Join, Replace, Slice.
  • A QUEUE Node that supports recursing directories, filtering multiple file types and batch loading
  • Use the OP UNARY and OP BINARY nodes to perform single and double type functions across all ComfyUI and Jovimetrix value types
  • Manipulate vectors with the SWIZZLE node to swap their XYZW positions
  • DELAY execution at certain parts in a workflow, with or without a timeout
  • Generate curve data with the TICK and WAVE GEN nodes
  • Help System for ALL NODES that will auto-parse unknown knows for their type data and descriptions
  • Colorization for ALL NODES using their own node settings, their node group or via regex pattern matching

HELP SYSTEM

The built-in help system will dynamically parse any nodes found at the ComfyUI API endpoint:

<comfyui_web_root>/object_info

If those nodes have descriptions written in HTML or Markdown, they will be converted into HTML for presentation in the panel.

<div align="center"> <img src="https://github.com/user-attachments/assets/075f6f9b-b27b-4a6f-84da-a6db486446ff" alt="Clicking Nodes for Help" width="384"/> </div>

NODE COLORS

You can colorize nodes via their title background, node body or title text. This can be done to the node's category as well, so you can quickly color groups of nodes.

<div align="center"> <img src="https://github.com/user-attachments/assets/8de9561a-b231-4a49-a63a-4fd5fdba64d9" alt="node color panel" width="256"/> </div>

UPDATES

2024/02/17 @1.7.20:

  • changed to newer conversion logic on frontend 1.10.3+ -- VECTOR types will auto-switch to conversion logic based on version
  • Fix for VALUE NODE to properly output vector data -- node in deprecation mode
  • Added explcit VECTOR2 / INT, VECTOR3 / INT, VECTOR4 / INT nodes for value input
  • Restructure to remove old UX hide/show widget features for compatibility with frontend (1.10.3+)
  • Added BATCH output to TICK NODE so you can get a normal comfyui list (top output) and a Jovimetrix list (BATCH)
<div align="center"> <img src="https://github.com/user-attachments/assets/8ed13e6a-218c-468a-a480-53ab55b04d21" alt="explicit vector node supports" width="640"/> <img src="https://github.com/user-attachments/assets/4459855c-c4e6-4739-811e-a6c90aa5a90c" alt="TICK Node Batch Support Output" width="384"/> </div>

2024/02/14 @1.7.17:

  • cleaning up image support before split into Jovi_Comp

2024/02/14 @1.7.15:

  • forced "OFF" the auto-scan for web cameras. Kept defaulting to on regardless of setting. reference issue 80

2024/02/10 @1.7.13:

  • cleared serialization bug
  • better "docker" environment check
  • cleaner type hints

2024/02/08 @1.7.9:

  • moved to proper semantic version numbers
  • PyOpenGL-accelerate updated to 3.1.9
  • better versioning in requirements around numpy
  • cleaner 2024/02/07 @1.7.08:
  • JOV_SCAN_DEVICES reset to default off.

2024/02/06 @1.7.06:

  • RESIZE_MATTE option updated to allow transparent mattes

2024/02/06 @1.7.05:

  • updated QUEUE and QUEUE TOO progress while loading all images as "batch"

2024/02/05 @1.7.02:

  • polish on regex parsing for uniforms -- supports are much more lenient on spacing

2024/02/05 @1.7.0:

  • regex entries default to [5] fields
  • issue #4 value in uniforms for GLSL nodes were cancelling values being set

INSTALLATION

Please see the wiki for advanced use of the environment variables used during startup

COMFYUI MANAGER

If you have ComfyUI Manager installed, simply search for Jovimetrix and install from the manager's database.

MANUAL INSTALL

Clone the repository into your ComfyUI custom_nodes directory. You can clone the repository with the command:

git clone https://github.com/Amorano/Jovimetrix.git

You can then install the requirements by using the command:

.\python_embed\python.exe -s -m pip install -r requirements.txt

If you are using a <code>virtual environment</code> (<code><i>venv</i></code>), make sure it is activated before installation. Then install the requirements with the command:

pip install -r requirements.txt

WHERE TO FIND ME

You can find me on DISCORD.