Nodes/ComfyUI-QING/Doubao视觉丨API
ComfyUI Node

Doubao视觉丨API

ByteDance's Doubao vision — strong on UI and document understanding

By sheengoa·Created about a year ago·Updated 20 days ago· 16
Doubao视觉丨API
  • image
  • generated_text
  • conversation_info
  • total_tokens
text_input请描述这张图片的内容。
platform火山引擎
modelDoubao-1.5-vision-pro
max_tokens4096
history10
temperature0.7
top_p0.90
image_qualityauto
clear_historyfalse

Doubao is ByteDance's answer to the vision-model game, and its strong suit, per the pack's own tooltip, is UI analysis, document understanding, and scene recognition - the kinds of jobs where you're reading a screenshot, a form, or a diagram rather than asking for art criticism. DoubaoVisionAPI wires that into a ComfyUI graph: image in, question in, text answer out, with a short conversation history. It's one platform only - 火山引擎 (Volcano Engine), ByteDance's cloud - so there's no platform dropdown to fight over; the single choice is which Doubao model to use.

It's part of ComfyUI-QING's API category and uses the same shared framework as the pack's other vision nodes, so key handling and history management are familiar if you've set up any of them.

How it works. The image and text_input (default "请描述这张图片的内容") go to the Volcano Engine endpoint; the model field offers nine Doubao variants, including the current-generation Doubao-Seed-1.6 family, Doubao-1.5-vision-pro, and the UI-specific Doubao-1.5-UI-TARS. The tooltip on the model field is unusually specific about what each is for: Seed-1.6 is the newest, -thinking does chain-of-thought visual reasoning, -flash is the fast real-time option, and UI-TARS is the interface-element recognizer. The image_quality knob (auto/low/high) is there if you need to trade accuracy for speed.

The inputs that matter.

  • image - the screenshot, document scan, or scene you're analyzing.
  • text_input - your question.
  • model - pick the variant that matches the job (9 choices).
  • max_tokens (default 4096) and history (default 10 rounds).
  • Optional: temperature, top_p, image_quality, clear_history.

Outputs: generated_text, conversation_info, total_tokens. Same trio as the rest of the pack - text result, conversation metadata, and token usage.

How to install. ComfyUI-QING installs as one pack - search "ComfyUI-QING" in ComfyUI Manager, or:

cd ComfyUI/custom_nodes
git clone https://github.com/GAO-SHIQING/ComfyUI-QING
cd ComfyUI-QING
python install_dependencies.py

Configure the Volcano Engine key in Settings → QING → API Configuration (or the matching env var) and restart. The README's clone URL is typo'd (GAOSHI-QING, missing the H) - use the URL above or Manager.

Troubleshooting. Because the platform is fixed, the key is the main thing to get right - a Volcano Engine (火山方舟/Volcengine Ark) API key, not some other ByteDance product key. If you get auth errors, that's almost always it. Second, model availability shifts as ByteDance retires old versions - if a listed model 404s, switch to the current Seed generation rather than assuming the pack is broken. And the standard API-node reminders: your image and prompt go to ByteDance's servers (relevant if the screenshot is sensitive), and Doubao enforces its own content policy. For purely local captioning of a training set, the open-source captioner path in the KB is still the better default; this node shines when you specifically want Doubao's UI/document strengths inside a live workflow.

CategoryQING/API

Inputs (10)

NameTypeDefaultDescription
imageIMAGE输入要分析的图像
text_inputSTRING请描述这张图片的内容。输入要发送给Doubao视觉模型的文本问题,Doubao擅长图像理解、UI分析和视觉推理
platformCOMBO火山引擎选择API服务提供商
modelCOMBODoubao-1.5-vision-pro选择要使用的Doubao视觉模型 📋 模型特点: 🔸 Doubao-Seed-1.6:最新种子版本,全面提升的视觉理解能力 🔸 Doubao-Seed-1.6-thinking:思维链推理版本,擅长复杂视觉分析 🔸 Doubao-Seed-1.6-flash:快速响应版本,适合实时应用 🔸 Doubao-1.5-vision-pro:专业视觉版本,高精度图像理解 🔸 Doubao-1.5-UI-TARS:UI专用版本,擅长界面元素识别 💡 Doubao视觉模型在UI分析、文档理解、场景识别方面表现卓越
max_tokensINT40961–32768模型生成文本时最多能使用的token数量
historyINT101–25保持的历史对话轮数
temperatureoptFLOAT0.70–2控制生成文本的随机性
top_poptFLOAT0.900–1控制生成文本的多样性
image_qualityoptCOMBOauto图像处理质量:auto(自动选择), low(低质量,速度快), high(高质量,精度高)
clear_historyoptBOOLEANfalse是否清除历史对话记录

Outputs (3)

NameTypeDescription
generated_textSTRING
conversation_infoSTRING
total_tokensINT