Nodes/Tikpan Official Nodes/分析|AI 音视频双轨解析
ComfyUI Node

分析|AI 音视频双轨解析

Dual-track video + audio analysis that writes shot-by-shot reports

By htrert·Created 5 months ago·Updated 2 months ago· 1
分析|AI 音视频双轨解析
  • 视频流_IMAGE
  • 音频流_AUDIO
  • 📄_专业分镜与脚本报告
获取密钥地址
API_密钥sk-
视频帧率FPS24
分析模型gemini-3.1-flash
中转站地址https://tikpan.com
重点分析要求请重点关注物理规律、光影变化和人物微表情。
校验HTTPS证书true

Most vision nodes describe a video. TikpanGeminiVideoAnalystNode is built to decompose one: it takes video frames and an optional audio track, and produces a professional 分镜 (shot-by-shot) report - 机位 (camera position), 动作, 光影, 场景 - pitched at "好莱坞级" (Hollywood-grade) in the author's own description. The pack's README frames it as the front half of a two-node pipeline: analyze here, then feed the report into the Grok reconstruction node to rewrite the video with matching prompts. If you're reverse-engineering a competitor's ad or turning a reference video into a shootable brief, this is the node.

How it works

Notably, it does not take a video file. The required input is 视频流_IMAGE - a frame sequence from a LoadVideo-style node - plus the source 视频帧率FPS (default 24) so the node can convert frame count back into timestamps. Internally it does automatic frame extraction + an "8MB 智能熔断" (smart chunking cap on the media payload) + synchronized audio analysis when you connect the optional 音频流_AUDIO track. The analysis model is a dropdown - gemini-3.1-flash (fast, default), gemini-3.1-pro (detailed), gpt-5.4-mini, or gpt-4o (stronger at text) - all through the Tikpan relay. The single output is 📄_专业分镜与脚本报告 (STRING), which wires straight into a text viewer or the Grok reconstruct node.

The inputs that actually matter

  • API_密钥 - sk- from tikpan.com.
  • 视频流_IMAGE - the required frames. This is a real ComfyUI-native design: extract frames locally (free, no upload of a whole file), analyze only what's needed. If you're used to other nodes swallowing a video path, unlearn that here.
  • 视频帧率FPS - tell it the source frame rate so the report's timestamps are honest. 24 is the default; an 8 fps source fed in as 24 gives you nonsense timecodes.
  • 分析模型 - the quality/cost tradeoff. Flash for drafts, pro for the keepers.
  • 音频流_AUDIO - optional, but it's the "双轨" in the name: connecting the audio lets the model follow dialogue and music alongside the visuals. The two-track sync is the feature.
  • 重点分析要求 - tell it what you care about (运镜/光影/情绪/带货卖点), default focuses on physical rules, lighting, and micro-expressions.

Installing it

cd ComfyUI/custom_nodes
git clone https://github.com/htrert/ComfyUI-Tikpan-Pro

restart (or Manager → "Tikpan"). No models to download; the heavy lifting is the relay call plus local frame handling.

Where people get burned

  • Wrong input type. Feeding a video file path instead of an IMAGE frame batch fails at the socket. Load frames with a video-frame node first. The ~18MB/48MB inline-video conveniences of other nodes don't exist here - this one is frames-only by design.
  • FPS mismatches. Wrong 视频帧率FPS → wrong timestamps in the report. Set it to the actual source.
  • Skipping the audio track. The single-track report misses the dialogue/voiceover layer - you're paying for dual-track, so connect the 音频流_AUDIO if the video has sound.
  • Model choice = cost. Pro on a long clip is the expensive combo; flash is fine for a first pass.

The honest pitch: it's an analysis node that respects ComfyUI's local-frame workflow and hands you a report you can actually act on - and if you pair it with the Grok reconstruct node, it becomes the "clone this video's grammar" pipeline the README promises.

Category👑 Tikpan 官方独家节点/04 文字与多模态 Text & Multimodal

Inputs (9)

NameTypeDefaultDescription
获取密钥地址COMBO1 options: 👉 https://tikpan.com (官方授权Key获取点)
API_密钥STRINGsk-Tikpan 平台的 API 密钥,以 sk- 开头,从 https://tikpan.com 获取
视频流_IMAGEIMAGE接入 LoadVideo 等节点输出的视频帧序列
视频帧率FPSINT248–60源视频的真实帧率,用于换算视频时长
分析模型COMBOgemini-3.1-flash选择负责分析的多模态模型:flash 快、pro 精细、gpt 更擅长文字
中转站地址optCOMBOhttps://tikpan.comTikpan 中转站地址,一般保持默认即可
音频流_AUDIOoptAUDIO可选音轨:让 AI 同步理解对白/音乐/音效
重点分析要求optSTRING请重点关注物理规律、光影变化和人物微表情。告诉 AI 你最在意的分析维度,例如运镜/光影/情绪/带货卖点
校验HTTPS证书optBOOLEANtrue默认开启;遇到本地证书问题再关闭(不推荐关闭)

Outputs (1)

NameTypeDescription
📄_专业分镜与脚本报告STRING