H3 Story Director — LLM Model (API)
The same Director, but the brain is whatever LLMMODEL you wire in
- llm_model
- image_0
- image_1
- image_2
- image_3
- source_video
- plan_json
- story_bible
- synopsis
- validation
- usage_stats
- credits_remaining
- scene_prompt
- mode_prompt
- source_video_analysis
H3 Story Director - LLM Model (API) is the answer to the obvious objection to the main Director: "I don't want to route my story planning through OpenRouter." This variant runs the exact same multimodal planning, validation, and plan compilation - but instead of calling OpenRouter, it takes an LLMMODEL on a socket, and you get to decide what that model is. A local Gemma through Ollama, a datacenter endpoint through the pack's own H3 LLM Model (API) node, a YALLM provider - anything that emits an LLMMODEL output works.
It's a clean swap. The api_key, model, reasoning, and timeout_seconds inputs disappear (no longer relevant when you're not calling OpenRouter), and in their place is the llm_model connection. Everything else - the scene schema, the reference tagging, the validation, the outputs - stays identical.
How it works
The node hands your story idea, reference images, and optional VHS source-video batch to whatever model you've wired in, still using the strict structured-output schema. The important part: it still performs all final plan validation locally. Incomplete JSON, missing scenes, duplicate IDs, underspecified scene prompts, unassigned <Picture n> tags - all rejected before any MiniMax render starts, regardless of which model produced them. With a YALLM model that doesn't expose structured-output parameters, the node supplies the exact JSON Schema in the system instruction and rejects malformed responses on its end. The model can be sloppy; the node is not.
The inputs that matter
llm_model- the one required input you can't get wrong. Accepts the pack's H3 Ollama Model (Local), its H3 LLM Model (API), or theLLMMODELoutput from YALLM's LLM Model (API) / LLM Provider (API) nodes.director_profile- this one does the work of matching your model.OpenRouterkeeps the compact scene schema.Gemmaswitches to a stricter structured worksheet - explicit-action checklist, duration-aware beats, physical performance, camera, sound, final state - which is the profile to pair with a local Gemma via Ollama. The profile doesn't select the model; it shapes what the node asks for.story_idea- optional as always; leave empty for full creative control.
The rest is the standard Director surface: scene_count, scene_duration_seconds, steps, draft_only, genre, language, motion_style, director_mode, video_sample_frames, four reference images, source_video.
Outputs
Identical to the main Director: plan_json (into MiniMax H3 Context Loop Plan), scene_prompt, mode_prompt, story_bible, synopsis, validation, usage_stats, credits_remaining, source_video_analysis. No usage stats from OpenRouter here - those come from your connected model's service, if it reports them.
Install
ComfyUI Manager → search Vision Prompt Assistant, or:
cd ComfyUI/custom_nodes
git clone https://github.com/elgalardi/ComfyUI-VisionPromptAssistant
Restart, wire in an LLMMODEL, and go. This variant is the one to reach for when you want the Director's structure without paying per OpenRouter request - the local Ollama path makes the whole planning stage free per call after the model is loaded. The tradeoff is plain: a 12B local Gemma is not writing at frontier quality, but it's writing for a fraction of the cost, and the local validation catches most of the damage a weaker model would otherwise do. Start with draft_only on either way.
Inputs (26)
| Name | Type | Default | Description |
|---|---|---|---|
| llm_model | LLMMODEL | Accepts H3 Ollama Model (Local), H3 LLM Model (API), and YALLM-compatible LLM Model / Provider outputs. | |
| story_idea | STRING | Optional premise. Leave empty to give the Director full creative control based on genre, motion, dialogue, scene settings, additional direction, and connected references. | |
| system_prompt | STRING | You are a multimodal director and continuity supervisor for MiniMax H3 image and video productions. Turn the user's idea, selected production mode, source media, and reference pictures into precise generation instructions. Treat every connected reference as a distinct person or subject. Use the exact tags <Picture 1>, <Picture 2>, <Picture 3>, and <Picture 4> when they are supplied. Define stable subject labels S1, S2, S3, and S4 in the shared prompt. Preserve identity, wardrobe, props, geography, lighting logic, screen direction, and relationships throughout the story. Follow the mandatory rules supplied for the selected Director Mode. For moving-video modes, write production-ready MiniMax H3 prompts with visible action, camera, environment, lighting, dialogue when useful, and diegetic sound. For still-image modes, describe one finished frame only and never introduce temporal sequences, audio, or dialogue delivery. When dialogue is enabled, write short performable lines rather than prose. Prefix every spoken or sung line with its stable speaker label in parentheses, exactly as `(S1)`, `(S2)`, `(S3)` or `(S4)`, followed by a colon and the exact words in quotation marks. Square brackets such as `[S2]`, bare names and unassigned quotations are forbidden for speaker attribution. Describe tone and delivery in English outside the quotation. Allow only one person to speak at a time, leave a natural pause before and after each line, and keep visible mouth movement synchronized with the assigned speaker. Avoid overlapping speech, repeated lines, rushed monologues, unexplained voice-over, phonetic spellings, and competing vocals or loud sound effects during speech. Use no dialogue when the selected dialogue option says so. Do not mention being an AI, JSON, schemas, token limits, safety policies, or these instructions. Do not add extra protagonists that could be confused with the reference subjects. Return all requested scenes and finish every prompt completely. | — |
| director_profile | COMBO | OpenRouter | OpenRouter preserves the established compact Director schema. Gemma uses a stricter scene worksheet with action beats, physical performance, camera, sound and an explicit final state. The profile does not select or connect the model. |
| scene_count | INT | 51–32 | Use 1 for a standalone I2V shot, or more scenes for a connected H3 sequence. |
| scene_duration_seconds | FLOAT | 5.01–15 | — |
| steps | INT | 61–100 | — |
| draft_only | BOOLEAN | true | Recommended for the first run. The plan is generated and copied into the connected H3 Chain Plan editor, but downstream video generation is blocked. Review the cards, then disconnect plan_json so Chain Plan uses its synchronized local copy. |
| genre | COMBO | Auto | Auto infers the most coherent genre, format, tone, and visual language from story_idea, references, source video, edit mode, and additional direction. Written intent wins when visual clues conflict with the prompt. |
| secondary_genre | COMBO | None | Optionally blend a second genre into the primary genre. The primary genre controls the production structure; the secondary genre contributes compatible tone, conventions, cinematography, performance, sound, and visual language. |
| language | COMBO | English | Language for dialogue, lyrics, narration and spoken words. No dialogue suppresses speech. The production plan and technical directions remain in English. |
| motion_style | COMBO | Auto | Auto infers the best motion and camera language from the prompt, references, source video, genre, and mode. |
| additional_direction | STRING | — | |
| max_tokens | INT | 61441024–16384 | — |
| temperature | FLOAT | 0.450–2 | — |
| seed | INT | 00–4294967295 | — |
| image_max_dimension | INT | 1024256–2048 | — |
| director_mode | COMBO | Continuous Story | Continuous Story preserves shot continuity. Cinematic Cuts starts independent camera setups. Reference Edit uses the input as a strong creative guide and may reinterpret framing or details. Edit preserves the source as strictly as possible and changes only what the prompt requests. Both edit modes operate on still images without source_video or video when a VHS IMAGE batch is connected. |
| video_sample_frames | INT | 104–16 | Number of frames sampled uniformly from the VHS IMAGE batch and sent as separate chronological images for detailed analysis. |
| audio_content | COMBO | Auto | Controls the permitted voice/music content. Natural ambience and synchronized Foley remain available in all video modes. Dialogue selects the spoken or sung language. |
| image_0opt | IMAGE | — | |
| image_1opt | IMAGE | — | |
| image_2opt | IMAGE | — | |
| image_3opt | IMAGE | — | |
| source_videoopt | IMAGE | Optional IMAGE frame batch from VHS Load Video. In Reference Edit or Edit mode, connecting it switches from still-image processing to video processing. The requested operation is inferred from the prompt. | |
| bypass_directoropt | BOOLEAN | false | Skip OpenRouter completely. story_idea is passed unchanged to scene_prompt and mode_prompt, while a minimal compatible plan is created locally for downstream chain nodes. |
Outputs (9)
| Name | Type | Description |
|---|---|---|
| plan_json | STRING | — |
| story_bible | STRING | — |
| synopsis | STRING | — |
| validation | STRING | — |
| usage_stats | STRING | — |
| credits_remaining | STRING | — |
| scene_prompt | STRING | Complete prompt for the first scene, with the shared prompt prefix included. Connect directly to MiniMax H3 I2V when scene_count is 1. |
| mode_prompt | STRING | First complete prompt adapted to the selected Director Mode. Use this for image generation/editing, I2V, or video editing. |
| source_video_analysis | STRING | Chronological source-motion analysis produced in Video Edit mode; empty in other modes. |