Extensions/ComfyUI-Erosdiffusion-LTX2
ComfyUI Extension

ComfyUI-Erosdiffusion-LTX2

Custom ComfyUI nodes for extending video scenes with synchronized audio generation using LTXAVModel.

By erosDiffusion·Created 7 months ago·Updated 7 months ago· 3
erosDiffusion/ComfyUI-Erosdiffusion-LTX2
Nodes
On cloudLocal install
Stars3
Updated7 months ago
Readme

[!CAUTION] This is a pre-alpha node. It is not stable and in progress and not meant for usage. At the moment it's also broken. I am only sharing upon request in the banodoco server and for timeline editor node for vrgamedevgirl to possibly integrate in a workflow.

ComfyUI-Erosdiffusion-LTX2

Custom ComfyUI nodes for extending video scenes with synchronized audio generation using LTXAVModel.

Nodes

LTXVSceneExtender

All-in-one node for extending video with synchronized audio, image guides, and timestamped prompts.

LTXVTimelineEditor

Visual timeline editor for creating scene scripts, it outputs the files and text for use in the scene extender

Installation

  1. Clone or copy this folder to your ComfyUI custom_nodes directory
  2. Restart ComfyUI

Requirements

  • ComfyUI (latest)
  • LTXVideo model
  • LTXAVModel (for audio-video generation)

Usage

See the analysis document for detailed usage examples and script format specification.

Script Format

[MM:SS-MM:SS] Scene description | audio:spec | first:$0 | MM:SS:$1 | end:$2

# Audio specs:
#   audio:silent              - No speech/sound
#   audio:"dialogue text"     - Speech to generate
#   audio:ambient             - Ambient sounds only

# Image refs:
#   $0, $1, etc.              - Reference to guide_images batch by index
#   first:                    - Guide at first frame
#   end:                      - Guide at last frame
#   MM:SS:                    - Guide at specific timestamp

Example

# === SHOT 1: WOMAN INTRODUCTION ===

[00:00-00:02] Closeup of woman's face, neutral expression | audio:silent | first:$0 | end:$1
[00:02-00:04] Cowboy shot of woman speaking | audio:"Hello, welcome" | first:$2 | 00:03:$3 | end:$4
[00:04-00:06] Side profile, nodding gently | audio:silent | first:$5 | end:$6

License

MIT