Nodes/VRGameDevGirl Video Enhancement Nodes/VRGDG_LoadAudioSplit_HUMO_Transcribe
ComfyUI Node

VRGDG_LoadAudioSplit_HUMO_Transcribe

Split scenes and grab the lyrics in one pass

By vrgamegirl19·Created about a year ago·Updated a day ago· 742
VRGDG_LoadAudioSplit_HUMO_Transcribe
  • audio
  • meta
  • total_duration
  • lyrics_string
  • audio_1
  • audio_2
  • audio_3
  • audio_4
  • audio_5
  • audio_6
  • audio_7
  • audio_8
  • audio_9
  • audio_10
  • audio_11
  • audio_12
  • audio_13
  • audio_14
  • audio_15
  • audio_16
  • audio_17
  • audio_18
  • audio_19
  • audio_20
  • audio_21
  • audio_22
  • audio_23
  • audio_24
  • audio_25
  • audio_26
  • audio_27
  • audio_28
  • audio_29
  • audio_30
  • audio_31
  • audio_32
  • audio_33
  • audio_34
  • audio_35
  • audio_36
  • audio_37
  • audio_38
  • audio_39
  • audio_40
  • audio_41
  • audio_42
  • audio_43
  • audio_44
  • audio_45
  • audio_46
  • audio_47
  • audio_48
  • audio_49
  • audio_50
◄offset_seconds0.00►
◄scene_count1►
◄languageenglish►
◄enable_lyricsfalse►

VRGDG_LoadAudioSplit_HUMO_Transcribe is where the splitter family learns to talk. It does everything the plain HUMO splitter does - cut an audio track into scenes - and on top of that it transcribes the audio with Whisper, handing you the lyrics as a string. That single addition is what turns "a pile of scene clips" into "a scene list plus the words each scene is singing," which is exactly what the music-video pipeline needs to build per-scene prompts.

The author's own tooltips tell you the mechanism plainly: the language input is described as "Language for Whisper transcription," and enable_lyrics as "If false, skip transcription." So Whisper is doing the transcribing, and you can turn it off if you only want the split.

What it does

Inputs:

  • audio (AUDIO) - the loaded track.
  • offset_seconds (FLOAT, default 0) - skip the first N seconds.
  • scene_count (INT, 1–50, default 1) - number of scene clips.
  • language (enum, 113 choices, default english) - Whisper's target language; auto is available if you're not sure.
  • enable_lyrics (BOOLEAN, default false) - the transcription switch. Note the default: off. If you wire this up and get no lyrics_string, this is why.

Outputs:

  • meta (DICT) and total_duration (FLOAT) - scene bookkeeping.
  • lyrics_string (STRING) - the transcription. This is the payoff: it feeds the LLM (VRGDG_LLM_Multi) that turns the song into scene prompts.
  • audio_1 .. audio_50 (AUDIO) - the scene clips, same as the plain splitter.

Why transcription-first matters

The music-video workflow is lyric-driven: the generated scenes should match what's being sung, shot for shot. To do that, something has to know the words and roughly where they land. This node is the first step of that chain - split and transcribe together, so the scene clips and the lyric text stay in sync by construction. Feed lyrics_string into the prompt-building branch and the model can write "she sings the chorus here" against actual content instead of a guess.

Installing it

Part of the comfyui-vrgamedevgirl pack. ComfyUI Manager: search "vrgamedev", install, restart. Or:

cd ComfyUI/custom_nodes
git clone https://github.com/vrgamegirl19/comfyui-vrgamedevgirl

then install the README's requirements:

pip install -r custom_nodes/comfyui-vrgamedevgirl/requirements.txt

Whisper itself isn't listed in the README's requirements, so if transcription errors on a fresh install, check whether the Whisper backend actually made it into your environment - this node assumes it's available.

If it's not working

  • No lyrics come out - enable_lyrics defaults to false. Flip it on.
  • Garbage transcription - set language explicitly instead of guessing; Whisper's auto-detect is decent but a wrong explicit language beats a confused auto for most songs. English pop is reliably english.
  • Transcription errors on import - the Whisper dependency isn't in the README's short requirements list, so this is the node most likely to fail on a minimal install. Get the Whisper backend installed and restart ComfyUI.
  • Wrong scenes - offset_seconds and scene_count still control the split, independent of transcription. Tune those separately.
CategoryVRGDG

Inputs (5)

NameTypeDefaultDescription
audioAUDIO—
offset_secondsFLOAT0.00—
scene_countINT11–50—
languageCOMBOenglishLanguage for Whisper transcription.
enable_lyricsBOOLEANfalseIf false, skip transcription.

Outputs (53)

NameTypeDescription
metaDICT—
total_durationFLOAT—
lyrics_stringSTRING—
audio_1AUDIO—
audio_2AUDIO—
audio_3AUDIO—
audio_4AUDIO—
audio_5AUDIO—
audio_6AUDIO—
audio_7AUDIO—
audio_8AUDIO—
audio_9AUDIO—
audio_10AUDIO—
audio_11AUDIO—
audio_12AUDIO—
audio_13AUDIO—
audio_14AUDIO—
audio_15AUDIO—
audio_16AUDIO—
audio_17AUDIO—
audio_18AUDIO—
audio_19AUDIO—
audio_20AUDIO—
audio_21AUDIO—
audio_22AUDIO—
audio_23AUDIO—
audio_24AUDIO—
audio_25AUDIO—
audio_26AUDIO—
audio_27AUDIO—
audio_28AUDIO—
audio_29AUDIO—
audio_30AUDIO—
audio_31AUDIO—
audio_32AUDIO—
audio_33AUDIO—
audio_34AUDIO—
audio_35AUDIO—
audio_36AUDIO—
audio_37AUDIO—
audio_38AUDIO—
audio_39AUDIO—
audio_40AUDIO—
audio_41AUDIO—
audio_42AUDIO—
audio_43AUDIO—
audio_44AUDIO—
audio_45AUDIO—
audio_46AUDIO—
audio_47AUDIO—
audio_48AUDIO—
audio_49AUDIO—
audio_50AUDIO—