Nodes/VRGameDevGirl Video Enhancement Nodes/VRGDG_LoadAudioSplit_HUMO_Transcribe
ComfyUI Node

VRGDG_LoadAudioSplit_HUMO_Transcribe

Split scenes and grab the lyrics in one pass

By vrgamegirl19·Created about a year ago·Updated about 7 hours ago· 718
VRGDG_LoadAudioSplit_HUMO_Transcribe
  • audio
  • meta
  • total_duration
  • lyrics_string
  • audio_1
  • audio_2
  • audio_3
  • audio_4
  • audio_5
  • audio_6
  • audio_7
  • audio_8
  • audio_9
  • audio_10
  • audio_11
  • audio_12
  • audio_13
  • audio_14
  • audio_15
  • audio_16
  • audio_17
  • audio_18
  • audio_19
  • audio_20
  • audio_21
  • audio_22
  • audio_23
  • audio_24
  • audio_25
  • audio_26
  • audio_27
  • audio_28
  • audio_29
  • audio_30
  • audio_31
  • audio_32
  • audio_33
  • audio_34
  • audio_35
  • audio_36
  • audio_37
  • audio_38
  • audio_39
  • audio_40
  • audio_41
  • audio_42
  • audio_43
  • audio_44
  • audio_45
  • audio_46
  • audio_47
  • audio_48
  • audio_49
  • audio_50
offset_seconds0.00
scene_count1
languageenglish
enable_lyricsfalse

VRGDG_LoadAudioSplit_HUMO_Transcribe is where the splitter family learns to talk. It does everything the plain HUMO splitter does - cut an audio track into scenes - and on top of that it transcribes the audio with Whisper, handing you the lyrics as a string. That single addition is what turns "a pile of scene clips" into "a scene list plus the words each scene is singing," which is exactly what the music-video pipeline needs to build per-scene prompts.

The author's own tooltips tell you the mechanism plainly: the language input is described as "Language for Whisper transcription," and enable_lyrics as "If false, skip transcription." So Whisper is doing the transcribing, and you can turn it off if you only want the split.

What it does

Inputs:

  • audio (AUDIO) - the loaded track.
  • offset_seconds (FLOAT, default 0) - skip the first N seconds.
  • scene_count (INT, 1–50, default 1) - number of scene clips.
  • language (enum, 113 choices, default english) - Whisper's target language; auto is available if you're not sure.
  • enable_lyrics (BOOLEAN, default false) - the transcription switch. Note the default: off. If you wire this up and get no lyrics_string, this is why.

Outputs:

  • meta (DICT) and total_duration (FLOAT) - scene bookkeeping.
  • lyrics_string (STRING) - the transcription. This is the payoff: it feeds the LLM (VRGDG_LLM_Multi) that turns the song into scene prompts.
  • audio_1 .. audio_50 (AUDIO) - the scene clips, same as the plain splitter.

Why transcription-first matters

The music-video workflow is lyric-driven: the generated scenes should match what's being sung, shot for shot. To do that, something has to know the words and roughly where they land. This node is the first step of that chain - split and transcribe together, so the scene clips and the lyric text stay in sync by construction. Feed lyrics_string into the prompt-building branch and the model can write "she sings the chorus here" against actual content instead of a guess.

Installing it

Part of the comfyui-vrgamedevgirl pack. ComfyUI Manager: search "vrgamedev", install, restart. Or:

cd ComfyUI/custom_nodes
git clone https://github.com/vrgamegirl19/comfyui-vrgamedevgirl

then install the README's requirements:

pip install -r custom_nodes/comfyui-vrgamedevgirl/requirements.txt

Whisper itself isn't listed in the README's requirements, so if transcription errors on a fresh install, check whether the Whisper backend actually made it into your environment - this node assumes it's available.

If it's not working

  • No lyrics come out - enable_lyrics defaults to false. Flip it on.
  • Garbage transcription - set language explicitly instead of guessing; Whisper's auto-detect is decent but a wrong explicit language beats a confused auto for most songs. English pop is reliably english.
  • Transcription errors on import - the Whisper dependency isn't in the README's short requirements list, so this is the node most likely to fail on a minimal install. Get the Whisper backend installed and restart ComfyUI.
  • Wrong scenes - offset_seconds and scene_count still control the split, independent of transcription. Tune those separately.
CategoryVRGDG

Inputs (5)

NameTypeDefaultDescription
audioAUDIO
offset_secondsFLOAT0.00
scene_countINT11–50
languageCOMBOenglishLanguage for Whisper transcription.
enable_lyricsBOOLEANfalseIf false, skip transcription.

Outputs (53)

NameTypeDescription
metaDICT
total_durationFLOAT
lyrics_stringSTRING
audio_1AUDIO
audio_2AUDIO
audio_3AUDIO
audio_4AUDIO
audio_5AUDIO
audio_6AUDIO
audio_7AUDIO
audio_8AUDIO
audio_9AUDIO
audio_10AUDIO
audio_11AUDIO
audio_12AUDIO
audio_13AUDIO
audio_14AUDIO
audio_15AUDIO
audio_16AUDIO
audio_17AUDIO
audio_18AUDIO
audio_19AUDIO
audio_20AUDIO
audio_21AUDIO
audio_22AUDIO
audio_23AUDIO
audio_24AUDIO
audio_25AUDIO
audio_26AUDIO
audio_27AUDIO
audio_28AUDIO
audio_29AUDIO
audio_30AUDIO
audio_31AUDIO
audio_32AUDIO
audio_33AUDIO
audio_34AUDIO
audio_35AUDIO
audio_36AUDIO
audio_37AUDIO
audio_38AUDIO
audio_39AUDIO
audio_40AUDIO
audio_41AUDIO
audio_42AUDIO
audio_43AUDIO
audio_44AUDIO
audio_45AUDIO
audio_46AUDIO
audio_47AUDIO
audio_48AUDIO
audio_49AUDIO
audio_50AUDIO