Nodes/Vision Prompt Assistant/H3 Story Director — LLM Model (API)
ComfyUI Node

H3 Story Director — LLM Model (API)

The same Director, but the brain is whatever LLMMODEL you wire in

By elgalardi·Created about a month ago·Updated 7 days ago· 1
H3 Story Director — LLM Model (API)
  • llm_model
  • image_0
  • image_1
  • image_2
  • image_3
  • source_video
  • plan_json
  • story_bible
  • synopsis
  • validation
  • usage_stats
  • credits_remaining
  • scene_prompt
  • mode_prompt
  • source_video_analysis
story_idea
system_promptYou are a multimodal director and continuity supervisor for MiniMax H3 image and video productions. Turn the user's idea, selected production mode, source media, and reference pictures into precise generation instructions. Treat every connected reference as a distinct person or subject. Use the exact tags <Picture 1>, <Picture 2>, <Picture 3>, and <Picture 4> when they are supplied. Define stable subject labels S1, S2, S3, and S4 in the shared prompt. Preserve identity, wardrobe, props, geography, lighting logic, screen direction, and relationships throughout the story. Follow the mandatory rules supplied for the selected Director Mode. For moving-video modes, write production-ready MiniMax H3 prompts with visible action, camera, environment, lighting, dialogue when useful, and diegetic sound. For still-image modes, describe one finished frame only and never introduce temporal sequences, audio, or dialogue delivery. When dialogue is enabled, write short performable lines rather than prose. Prefix every spoken or sung line with its stable speaker label in parentheses, exactly as `(S1)`, `(S2)`, `(S3)` or `(S4)`, followed by a colon and the exact words in quotation marks. Square brackets such as `[S2]`, bare names and unassigned quotations are forbidden for speaker attribution. Describe tone and delivery in English outside the quotation. Allow only one person to speak at a time, leave a natural pause before and after each line, and keep visible mouth movement synchronized with the assigned speaker. Avoid overlapping speech, repeated lines, rushed monologues, unexplained voice-over, phonetic spellings, and competing vocals or loud sound effects during speech. Use no dialogue when the selected dialogue option says so. Do not mention being an AI, JSON, schemas, token limits, safety policies, or these instructions. Do not add extra protagonists that could be confused with the reference subjects. Return all requested scenes and finish every prompt completely.
director_profileOpenRouter
scene_count5
scene_duration_seconds5.0
steps6
draft_onlytrue
genreAuto
secondary_genreNone
languageEnglish
motion_styleAuto
additional_direction
max_tokens6144
temperature0.45
seed0
image_max_dimension1024
director_modeContinuous Story
video_sample_frames10
audio_contentAuto
bypass_directorfalse

H3 Story Director - LLM Model (API) is the answer to the obvious objection to the main Director: "I don't want to route my story planning through OpenRouter." This variant runs the exact same multimodal planning, validation, and plan compilation - but instead of calling OpenRouter, it takes an LLMMODEL on a socket, and you get to decide what that model is. A local Gemma through Ollama, a datacenter endpoint through the pack's own H3 LLM Model (API) node, a YALLM provider - anything that emits an LLMMODEL output works.

It's a clean swap. The api_key, model, reasoning, and timeout_seconds inputs disappear (no longer relevant when you're not calling OpenRouter), and in their place is the llm_model connection. Everything else - the scene schema, the reference tagging, the validation, the outputs - stays identical.

How it works

The node hands your story idea, reference images, and optional VHS source-video batch to whatever model you've wired in, still using the strict structured-output schema. The important part: it still performs all final plan validation locally. Incomplete JSON, missing scenes, duplicate IDs, underspecified scene prompts, unassigned <Picture n> tags - all rejected before any MiniMax render starts, regardless of which model produced them. With a YALLM model that doesn't expose structured-output parameters, the node supplies the exact JSON Schema in the system instruction and rejects malformed responses on its end. The model can be sloppy; the node is not.

The inputs that matter

  • llm_model - the one required input you can't get wrong. Accepts the pack's H3 Ollama Model (Local), its H3 LLM Model (API), or the LLMMODEL output from YALLM's LLM Model (API) / LLM Provider (API) nodes.
  • director_profile - this one does the work of matching your model. OpenRouter keeps the compact scene schema. Gemma switches to a stricter structured worksheet - explicit-action checklist, duration-aware beats, physical performance, camera, sound, final state - which is the profile to pair with a local Gemma via Ollama. The profile doesn't select the model; it shapes what the node asks for.
  • story_idea - optional as always; leave empty for full creative control.

The rest is the standard Director surface: scene_count, scene_duration_seconds, steps, draft_only, genre, language, motion_style, director_mode, video_sample_frames, four reference images, source_video.

Outputs

Identical to the main Director: plan_json (into MiniMax H3 Context Loop Plan), scene_prompt, mode_prompt, story_bible, synopsis, validation, usage_stats, credits_remaining, source_video_analysis. No usage stats from OpenRouter here - those come from your connected model's service, if it reports them.

Install

ComfyUI Manager → search Vision Prompt Assistant, or:

cd ComfyUI/custom_nodes
git clone https://github.com/elgalardi/ComfyUI-VisionPromptAssistant

Restart, wire in an LLMMODEL, and go. This variant is the one to reach for when you want the Director's structure without paying per OpenRouter request - the local Ollama path makes the whole planning stage free per call after the model is loaded. The tradeoff is plain: a 12B local Gemma is not writing at frontier quality, but it's writing for a fraction of the cost, and the local validation catches most of the damage a weaker model would otherwise do. Start with draft_only on either way.

Categorytext/minimax_h3

Inputs (26)

NameTypeDefaultDescription
llm_modelLLMMODELAccepts H3 Ollama Model (Local), H3 LLM Model (API), and YALLM-compatible LLM Model / Provider outputs.
story_ideaSTRINGOptional premise. Leave empty to give the Director full creative control based on genre, motion, dialogue, scene settings, additional direction, and connected references.
system_promptSTRINGYou are a multimodal director and continuity supervisor for MiniMax H3 image and video productions. Turn the user's idea, selected production mode, source media, and reference pictures into precise generation instructions. Treat every connected reference as a distinct person or subject. Use the exact tags <Picture 1>, <Picture 2>, <Picture 3>, and <Picture 4> when they are supplied. Define stable subject labels S1, S2, S3, and S4 in the shared prompt. Preserve identity, wardrobe, props, geography, lighting logic, screen direction, and relationships throughout the story. Follow the mandatory rules supplied for the selected Director Mode. For moving-video modes, write production-ready MiniMax H3 prompts with visible action, camera, environment, lighting, dialogue when useful, and diegetic sound. For still-image modes, describe one finished frame only and never introduce temporal sequences, audio, or dialogue delivery. When dialogue is enabled, write short performable lines rather than prose. Prefix every spoken or sung line with its stable speaker label in parentheses, exactly as `(S1)`, `(S2)`, `(S3)` or `(S4)`, followed by a colon and the exact words in quotation marks. Square brackets such as `[S2]`, bare names and unassigned quotations are forbidden for speaker attribution. Describe tone and delivery in English outside the quotation. Allow only one person to speak at a time, leave a natural pause before and after each line, and keep visible mouth movement synchronized with the assigned speaker. Avoid overlapping speech, repeated lines, rushed monologues, unexplained voice-over, phonetic spellings, and competing vocals or loud sound effects during speech. Use no dialogue when the selected dialogue option says so. Do not mention being an AI, JSON, schemas, token limits, safety policies, or these instructions. Do not add extra protagonists that could be confused with the reference subjects. Return all requested scenes and finish every prompt completely.
director_profileCOMBOOpenRouterOpenRouter preserves the established compact Director schema. Gemma uses a stricter scene worksheet with action beats, physical performance, camera, sound and an explicit final state. The profile does not select or connect the model.
scene_countINT51–32Use 1 for a standalone I2V shot, or more scenes for a connected H3 sequence.
scene_duration_secondsFLOAT5.01–15
stepsINT61–100
draft_onlyBOOLEANtrueRecommended for the first run. The plan is generated and copied into the connected H3 Chain Plan editor, but downstream video generation is blocked. Review the cards, then disconnect plan_json so Chain Plan uses its synchronized local copy.
genreCOMBOAutoAuto infers the most coherent genre, format, tone, and visual language from story_idea, references, source video, edit mode, and additional direction. Written intent wins when visual clues conflict with the prompt.
secondary_genreCOMBONoneOptionally blend a second genre into the primary genre. The primary genre controls the production structure; the secondary genre contributes compatible tone, conventions, cinematography, performance, sound, and visual language.
languageCOMBOEnglishLanguage for dialogue, lyrics, narration and spoken words. No dialogue suppresses speech. The production plan and technical directions remain in English.
motion_styleCOMBOAutoAuto infers the best motion and camera language from the prompt, references, source video, genre, and mode.
additional_directionSTRING
max_tokensINT61441024–16384
temperatureFLOAT0.450–2
seedINT00–4294967295
image_max_dimensionINT1024256–2048
director_modeCOMBOContinuous StoryContinuous Story preserves shot continuity. Cinematic Cuts starts independent camera setups. Reference Edit uses the input as a strong creative guide and may reinterpret framing or details. Edit preserves the source as strictly as possible and changes only what the prompt requests. Both edit modes operate on still images without source_video or video when a VHS IMAGE batch is connected.
video_sample_framesINT104–16Number of frames sampled uniformly from the VHS IMAGE batch and sent as separate chronological images for detailed analysis.
audio_contentCOMBOAutoControls the permitted voice/music content. Natural ambience and synchronized Foley remain available in all video modes. Dialogue selects the spoken or sung language.
image_0optIMAGE
image_1optIMAGE
image_2optIMAGE
image_3optIMAGE
source_videooptIMAGEOptional IMAGE frame batch from VHS Load Video. In Reference Edit or Edit mode, connecting it switches from still-image processing to video processing. The requested operation is inferred from the prompt.
bypass_directoroptBOOLEANfalseSkip OpenRouter completely. story_idea is passed unchanged to scene_prompt and mode_prompt, while a minimal compatible plan is created locally for downstream chain nodes.

Outputs (9)

NameTypeDescription
plan_jsonSTRING
story_bibleSTRING
synopsisSTRING
validationSTRING
usage_statsSTRING
credits_remainingSTRING
scene_promptSTRINGComplete prompt for the first scene, with the shared prompt prefix included. Connect directly to MiniMax H3 I2V when scene_count is 1.
mode_promptSTRINGFirst complete prompt adapted to the selected Director Mode. Use this for image generation/editing, I2V, or video editing.
source_video_analysisSTRINGChronological source-motion analysis produced in Video Edit mode; empty in other modes.