Nodes/ComfyUI-JZL-MiniMax-H3/JZL - 🚀 模型加载Pro
ComfyUI Node

JZL - 🚀 模型加载Pro

The GGUF loader with every sampling knob, and a backend that doesn't fight ComfyUI

By wjluoxiao·Created 13 days ago·Updated 3 days ago· 57
JZL - 🚀 模型加载Pro
    • llama_model
    • parameters
    model
    mmprojNone
    chat_handlerNone
    advanced_settingsfalse
    n_ctx32768
    vram_limit-1
    image_min_tokens0
    image_max_tokens0
    max_tokens8192
    top_k40
    top_p0.90
    min_p0.05
    typical_p1.00
    temperature0.60
    repeat_penalty1.05
    frequency_penalty0.00
    present_penalty0.00
    mirostat_mode0
    mirostat_eta0.10
    mirostat_tau5.00
    state_uid-1
    backendllama-cpp-python
    gpu_deviceauto

    "JZL - 🚀 模型加载Pro" is the local-LLM end of the JZL-MiniMax-H3 pack's "漫剧" (short drama) pipeline. The pack's Script Processor uses a Qwen-class VLM to write storyboards and camera directions, and this node is where you load that GGUF model and set every sampling parameter the writing quality depends on. If you're only doing reference-to-video encoding, you don't need it - but if you want the LLM-written script chain, this is the loader.

    How it works

    It lists models from ComfyUI's LLM folder (the same folder the built-in GGUF loader uses) into the model dropdown, lists mmproj projector files for vision-language models, and offers 33 chat_handler presets - LLaVA-1.5/1.6, Moondream2, MiniCPM-v2.6, Gemma3, Qwen2.5-VL, Qwen3-VL and more - so the pack knows how to talk to the model you picked.

    The interesting part is the backend switch. Default is llama-cpp-python (in-process). The newer option is llama-server: the pack no longer calls llama-cpp-python at all - it spawns a pinned llama.cpp b10436 binary as a separate subprocess, runs inference, then kills it, which isolates crashes and releases VRAM when the pass is done. That path requires running the pack's installer first (see below).

    The inputs that matter

    • model - your GGUF, from the LLM folder. mmproj and chat_handler follow from that choice.
    • backend - llama-cpp-python or llama-server. Try llama-server if the in-process backend keeps wedging your ComfyUI.
    • n_ctx - context length, default 32768, up to 262144. The tooltip's rule of thumb: a short story at 32K, a 56-segment epic at 131K–256K.
    • temperature - default 0.6, which the pack says keeps [SHOT_START] formatting strict and reduces hallucinations.
    • top_k (40), top_p (0.9), min_p (0.05), repeat_penalty (1.05) - the usual suspects, all with sensible defaults.
    • max_tokens - 8192 default; scale up for many segments.
    • vram_limit - GB cap, -1 = unlimited.
    • gpu_device - only for the llama-server backend; auto follows ComfyUI's current card, or pick an index.

    Outputs are llama_model and parameters, which plug straight into the pack's Script Processor.

    How to install it

    Pack install as usual - ComfyUI Manager, search "ComfyUI-JZL-MiniMax-H3", or git clone https://github.com/wjluoxiao/ComfyUI-JZL-MiniMax-H3 into custom_nodes, then restart.

    If you want the llama-server backend (recommended if you hit in-process crashes), run the runtime installer once. On Windows double-click install_runtime.bat; otherwise:

    cd ComfyUI/custom_nodes/ComfyUI-JZL-MiniMax-H3
    python install_runtime.py          # --dry-run to preview, --force to reinstall
    

    It's pure-Python stdlib, auto-detects your OS/arch/GPU, and downloads a pinned, SHA256-verified llama.cpp b10436 build - zero pip installs. If you already have llama-cpp-python, it won't conflict; you can even pip uninstall llama-cpp-python to reclaim disk.

    Common issues

    The big one: llama-server fails with "no runtime found" if you never ran the installer - it's a subprocess, so there's no pip fallback. Another classic is picking a chat_handler that doesn't match the model (e.g. Qwen3-VL handler with a Qwen2.5-VL file) and getting garbage tokens instead of [SHOT_START] blocks. And remember the model goes in the LLM folder, not models/checkpoints - the dropdown only sees the former.

    CategoryJZL/MiniMax

    Inputs (23)

    NameTypeDefaultDescription
    modelCOMBO0 options:
    mmprojCOMBONone1 options: None
    chat_handlerCOMBONone33 options: None, LLaVA-1.5, LLaVA-1.6, Moondream2, nanoLLaVA, llama3-Vision-Alpha, +27
    advanced_settingsBOOLEANfalse开启后显示上下文长度、显存上限、图像token 及全部推理参数
    n_ctxINT327681024–262144上下文长度上限 Qwen3.5-9B 原生 262144(256K);短篇 32768,56 段调到 131072-262144
    vram_limitINT-1-1–1024显存使用上限(GB), -1=不限制 参考值, 实际可能略超
    image_min_tokensINT00–4096
    image_max_tokensINT00–4096
    max_tokensINT81920–262144生成 Token 上限(Qwen3.5-9B 上限 262144) 6 段约 12K,56 段约 128K,请按段数调整
    top_kINT400–1000词汇库检索范围 40 配合 0.60 温度,兼顾格式严谨与词汇多样
    top_pFLOAT0.900–1
    min_pFLOAT0.050–1
    typical_pFLOAT1.000–1
    temperatureFLOAT0.600–2温度 0.60 确保 [SHOT_START] 格式严谨,减少幻觉
    repeat_penaltyFLOAT1.050–10重复惩罚 1.05 轻微防句式复读,同时保留台词(太高会让 LLM 省略已在故事里写过的台词)
    frequency_penaltyFLOAT0.000–1
    present_penaltyFLOAT0.000–2
    mirostat_modeINT00–2
    mirostat_etaFLOAT0.100–1
    mirostat_tauFLOAT5.000–10
    state_uidINT-1-1–999999使用特定 ID 保存对话状态 (-1 = 使用节点 unique_id)
    backendCOMBOllama-cpp-python本地推理后端:llama-cpp-python(默认,进程内)或 llama-server(子进程,需先运行 install_runtime.bat)
    gpu_deviceCOMBOautoGPU 设备(仅 llama-server 后端):auto = 自动跟随 ComfyUI 当前显卡;也可手动指定索引

    Outputs (2)

    NameTypeDescription
    llama_modelLLAMACPPMODEL
    parametersLLAMACPPARAMS