Nodes/videoclipgenerator/Vibe Music Engine
ComfyUI Node

Vibe Music Engine

A ComfyUI node in VibeMusicEngine with 24 inputs and 11 outputs.

By lazniak·Created 2 years ago·Updated 10 months ago· 8
Vibe Music Engine
  • audio
  • beats_audio
  • Lyrics
  • frame_based_text
  • Frame_long
  • frame_numbers
  • text_lines
  • start_frame_numbers
  • end_frame_numbers
  • num_of_elements
  • durations
  • Start_ms
  • Duration_ms
choose_modelbase
source_languageauto
target_languagesource
continuation_text<LOGICAL CONTINUATION OF PREVIOUS VIDEO SHOOT>
fps25.0
words_per_line3
prev_context_words0
next_context_words0
context_bracketstrue
max_shot_length_frames125
min_shot_length_frames25
filename_prefixsc
files_in_edlmp4
beat_detectionfalse
beat_sensitivity0.5
beat_brutality0.50
save_edloverwrite
save_srtoverwrite
srt_moderaw
frame_gap1.0
buy_me_a_coffeefalse
usage_counterUsage count: 0
CategoryVibeMusicEngine

Inputs (24)

NameTypeDefaultDescription
audioAUDIOMain audio input for speech-to-text processing. Should contain clear vocal content for optimal transcription.
choose_modelCOMBObaseSelect Whisper model size: tiny: Fastest, lowest accuracy base: Good balance of speed/accuracy small: Better accuracy, slower medium: High accuracy, slower large/large-v2: Best accuracy, slowest *.en models: Optimized for English
source_languageCOMBOautoSelect the source language of the audio: auto: Automatically detect language en: English pl: Polish de: German etc.
target_languageCOMBOsourceSelect the target language for transcription: source: Keep detected/specified source language en: English pl: Polish de: German etc.
continuation_textSTRING<LOGICAL CONTINUATION OF PREVIOUS VIDEO SHOOT>Text to be used for logical continuation of scenes. This text will be inserted when a scene is split into multiple parts.
fpsFLOAT25.00.1–120Frames per second for video output. Common values: 24fps: Film 25fps: PAL 29.97fps: NTSC 30fps: Digital 60fps: High frame rate
words_per_lineINT31–20Number of words to group per subtitle line. Lower values create shorter, more readable lines but more frequent cuts.
prev_context_wordsINT00–20Number of previous words to add as context before the main text line. Helps with context understanding and prompt generation.
next_context_wordsINT00–20Number of next words to add as context after the main text line. Helps with context understanding and prompt generation.
context_bracketsBOOLEANtrueIf enabled, adds [PREV: ...] and [NEXT: ...] brackets around context words. If disabled, adds context words without brackets.
max_shot_length_framesINT125Maximum length of a single shot in frames. Longer shots will be split. At 25fps, 125 frames = 5 seconds.
min_shot_length_framesINT251–100Minimum length of a single shot in frames. Prevents too rapid cuts. At 25fps, 25 frames = 1 second.
filename_prefixSTRINGscPrefix for output files. Will be used for both EDL and SRT files. Example: 'sc' will create 'sc_00001.mp4', 'sc.edl', etc.
files_in_edlSTRINGmp4File extension for video files referenced in EDL. Common formats: mp4, mov, avi, mxf. Must match your video workflow.
beat_detectionBOOLEANfalseEnable automatic beat detection for music-synchronized cuts. Uses advanced audio analysis to find rhythmic patterns.
beat_sensitivityFLOAT0.50.1–1Sensitivity of beat detection: 0.1: Only strongest beats 0.5: Balanced detection 1.0: Detect subtle beats Higher values may create false positives
beat_brutalityFLOAT0.500–1How strictly to align cuts to beats: 0.0: Subtle alignment 0.5: Balanced 1.0: Exact beat alignment Higher values may create jarring cuts
save_edlCOMBOoverwriteEDL save mode: overwrite: Replace existing file no: Don't save EDL iterate: Create numbered versions (sc_001.edl, sc_002.edl, etc.)
save_srtCOMBOoverwriteSRT subtitle save mode: no: Don't save SRT overwrite: Replace existing file iterate: Create numbered versions
srt_modeCOMBOrawSubtitle format mode: raw: Include all system messages clean: Only text content word: Word-by-word timing (karaoke style) original: Raw Whisper output all: Save all formats (raw, clean, word, and original)
frame_gapFLOAT1.00.5–5Gap between words in frames when using word mode. Affects readability and timing precision.
buy_me_a_coffeeBOOLEANfalseSupport the development! ☕ By enabling this option, you'll be directed to a page where you can show your appreciation for this tool. Your support helps maintain and improve these nodes!
usage_counterSTRINGUsage count: 0Tracks the total number of times this node has been used. This helps us understand how the tool is being utilized and guides future development. The counter updates automatically with each use.
beats_audiooptAUDIOOptional separate audio input for beat detection. Useful when vocal track and music track are separate. If not provided, main audio will be used for beat detection.

Outputs (11)

NameTypeDescription
LyricsSTRING
frame_based_textSTRING
Frame_longINT
frame_numbersSTRING
text_linesSTRING
start_frame_numbersSTRING
end_frame_numbersSTRING
num_of_elementsINT
durationsSTRING
Start_msSTRING
Duration_msSTRING