Nodes/IAMCCS-nodes/IAMCCS Cine Videoclip Maker Planner
ComfyUI Node

IAMCCS Cine Videoclip Maker Planner

Planning a music video shot by shot, beat by beat, from one node

By IAMCCS·Created 11 months ago·Updated 7 days ago· 113
IAMCCS Cine Videoclip Maker Planner
  • audio
  • music_linx
  • image_prompt
  • video_global_prompt
  • video_local_prompts
  • segment_lengths
  • negative_prompt
  • frame_count_true
  • frame_count_adjusted
  • start_seconds
  • duration_seconds
  • total_shots
  • report
shot_index0
fps24.00
manual_shot_seconds4.00
manual_total_shots8
duration_modemanual_shot_seconds
frame_roundingup_8n_plus_1
beats_per_shot4
image_model_hintz_image_turbo
video_backend_hintltx23_i2v_audio
sequence_json
global_video_promptcinematic music video with rhythm-driven camera movement, coherent subject identity and continuous visual energy
image_style_modifierphotorealistic, cinematic music video still, real-world materials, physically accurate lighting, subtle film grain, high detail, no text, no watermark
image_prompt_banklead singer in a moody neon rehearsal room, cinematic portrait, expressive eyes wide shot of the band performing under colored stage lights, smoke haze, high energy close-up of hands on an electric guitar, strings vibrating, dramatic side light urban night exterior, performer walking through rain reflections, music video look abstract close-up of light beams and glass reflections moving with the beat final heroic performance frame, camera low angle, intense backlight
video_action_bankthe performer breathes with the beat, subtle head movement and eye contact, slow push-in the camera cuts to a wider energetic performance feeling, lights pulse with the rhythm hands strike instruments in sync with the beat, sharp close-up motion and quick details the performer walks forward through the environment, confident rhythm-driven movement abstract lights and reflections swell on the chorus, dynamic camera drift the shot builds to a final powerful performance moment, camera pushes forward
negative_prompttext, watermark, logo, subtitles, low detail, plastic CGI, broken anatomy, bad hands, flicker, random objects, incoherent identity

Making a music video with local AI is a two-model job: an image model for the stills, then a video model to animate them. IAMCCS Cine Music Video Planner is the node that plans that pipeline for you, shot by shot. For each shot in the sequence it produces the image prompt (with your style modifier), the video prompt for animating that still, the beat segmentation, and the exact frame counts - so a Z-Image Turbo still can become an LTX-2.3 audio-i2v shot that lands on the beat.

The display name says "Videoclip Maker Planner," which is accurate: it's the planning layer, not the generation. You still wire up the image generator and the video backend; this node just makes sure every shot is sized, prompted, and timed consistently. It's the most "music-sequencer-inspired" node in the pack, and it shows.

How it works

You have three ways to size a shot:

  • manual_shot_seconds (default 4) with manual_total_shots (default 8) - flat, even shots.
  • audio_divided_by_total_shots - split the connected audio evenly across shots.
  • max_manual_audio_slice - the longer of manual or audio-divided.

Or skip all that and feed sequence_json from an external music-video sequencer (it reads shots/sequence/segments/timeline arrays, with per-shot duration, prompt, action, frame counts). The planner then assembles each shot from two banks: image_prompt_bank (stills: "lead singer in a moody neon rehearsal room…") and video_action_bank (motion: "the performer breathes with the beat…"), cycling through them per shot. image_style_modifier gets appended to every image prompt; beats_per_shot (default 4) splits each shot's frames into sub-beats for the video segment math. The image_model_hint (z_image_turbo, flux_9b, …) and video_backend_hint (ltx23_i2v_audio, ltx23_i2v, wan22_i2v, custom) are metadata that keep your downstream choices consistent.

The outputs that matter

  • image_prompt - the still prompt for this shot, ready for your image model.
  • video_global_prompt and video_local_prompts - for the video backend (and PromptRelay-style segment conditioning).
  • segment_lengths - the beat/sub-beat frame counts.
  • frame_count_true vs frame_count_adjusted - the raw frame count and the 8n+1-rounded one LTX actually wants. If these differ, feed frame_count_adjusted to the latent.
  • start_seconds, duration_seconds, total_shots - timeline positioning.
  • music_linx - the plan bus for the rest of the pipeline.
  • negative_prompt - passthrough.

Install

In IAMCCS-nodes:

cd ComfyUI/custom_nodes
git clone https://github.com/IAMCCS/IAMCCS-nodes.git

or Manager → search IAMCCS. README floor: ComfyUI ≥ 0.3.0, Python ≥ 3.12, Torch ≥ 2.8. For the full intended stack you'll also want an image model (Z-Image Turbo is the hinted default), an LTX 2.3 audio-i2v setup, and - if you're making something that actually syncs to music - MelBand vocal conditioning per the pack's SuperNodes requirements doc.

Where people get burned

  • It plans; it doesn't sync. The node sizes shots to the beat, but whether motion actually lands on the beat is up to the video model and your audio conditioning. Manage expectations: this gives you planned rhythm, not guaranteed sync.
  • The prompt banks are the product. The default banks are good starting points, but the quality ceiling is your image_prompt_bank/video_action_bank. Thin banks → repetitive shots; the node cycles them, so keep at least as many entries as you have shots.
  • shot_index is 0-based here (starts at 0), unlike the Multi-Gen Director (1-based). Inconsistent across the pack - double-check when looping.
  • Frame rounding. Watch frame_count_adjusted vs true. The adjusted value is what LTX accepts; feeding the true count into an LTX latent is a classic "why is my latent the wrong length" bug.
  • Zero search impressions, one-author tooling. It's a solid planner but it's opinionated about the whole stack - adopt the whole Cine/Videoclip pipeline or just steal its prompt-bank structure for your own workflow.
CategoryIAMCCS/Cine/05 Videoclip Maker

Inputs (16)

NameTypeDefaultDescription
shot_indexINT00–10000
fpsFLOAT24.001–120
manual_shot_secondsFLOAT4.000.1–120
manual_total_shotsINT81–512
duration_modeCOMBOmanual_shot_seconds3 options: manual_shot_seconds, audio_divided_by_total_shots, max_manual_audio_slice
frame_roundingCOMBOup_8n_plus_13 options: up_8n_plus_1, nearest_8n_plus_1, none
beats_per_shotINT41–64
image_model_hintCOMBOz_image_turbo3 options: z_image_turbo, flux_9b, any_i2i_image_generator
video_backend_hintCOMBOltx23_i2v_audio4 options: ltx23_i2v_audio, ltx23_i2v, wan22_i2v, custom
sequence_jsonSTRING
global_video_promptSTRINGcinematic music video with rhythm-driven camera movement, coherent subject identity and continuous visual energy
image_style_modifierSTRINGphotorealistic, cinematic music video still, real-world materials, physically accurate lighting, subtle film grain, high detail, no text, no watermark
image_prompt_bankSTRINGlead singer in a moody neon rehearsal room, cinematic portrait, expressive eyes wide shot of the band performing under colored stage lights, smoke haze, high energy close-up of hands on an electric guitar, strings vibrating, dramatic side light urban night exterior, performer walking through rain reflections, music video look abstract close-up of light beams and glass reflections moving with the beat final heroic performance frame, camera low angle, intense backlight
video_action_bankSTRINGthe performer breathes with the beat, subtle head movement and eye contact, slow push-in the camera cuts to a wider energetic performance feeling, lights pulse with the rhythm hands strike instruments in sync with the beat, sharp close-up motion and quick details the performer walks forward through the environment, confident rhythm-driven movement abstract lights and reflections swell on the chorus, dynamic camera drift the shot builds to a final powerful performance moment, camera pushes forward
negative_promptSTRINGtext, watermark, logo, subtitles, low detail, plastic CGI, broken anatomy, bad hands, flicker, random objects, incoherent identity
audiooptAUDIO

Outputs (12)

NameTypeDescription
music_linxIAMCCS_SUPERNODE_LINX
image_promptSTRING
video_global_promptSTRING
video_local_promptsSTRING
segment_lengthsSTRING
negative_promptSTRING
frame_count_trueINT
frame_count_adjustedINT
start_secondsFLOAT
duration_secondsFLOAT
total_shotsINT
reportSTRING