Vidu Reference2Video
Vidu Reference2Video
- client
- image1
- image2
- image3
- image4
- image5
- image6
- image7
- url
- task_id
The hardest problem in AI video is keeping the same character from frame one to frame sixty - and doing it on purpose. Vidu Reference2Video is the node in this pack built for exactly that. You hand it up to seven reference images of your subject (from different angles, or in different outfits), give it a prompt, and it generates video where the subject stays recognizable. No training, no LoRA, no identity-pinning workflow - just reference images sent up with the request.
That's a big deal for the character-consistency problem the KB keeps circling: normally you'd spend real effort building identity-preservation pipelines locally. This node does the "same person, different action" shot in one call. It's the one I'd point someone at for a talking-head video, a product shot with a consistent prop, or a character doing something new across multiple clips.
The inputs that matter
client- standard wiring from the Modelverse Client or Secret Client.model-viduq3-turbo(default, "fast generation") orviduq2(older). For a hosted tool, turbo is the sensible daily driver.prompt- the action. Default ismake it dance; replace it with what you actually want the subject to do. Max 2000 characters.duration- 1–10 seconds.aspect_ratio-16:9,9:16,3:4,4:3, or1:1.resolution-540p,720p(default),1080p.- Reference images:
image1throughimage7(wireIMAGEtensors), orimage_urls- a multiline text field, one URL per line, for web-hosted references. You can mix both; the node collects everything, base64-encodes the tensors, and trims to the first 7 with a warning if you overshoot. seedandbgm(adds background music).
Outputs are url and task_id; url feeds Modelverse Preview Video.
How it works
The node bundles all your reference images into the task input with a vidu_type: reference2video flag, submits it, and polls every 5 seconds until the clip is done. The consistency comes from the model reading all references together - which is exactly why you should feed it varied shots (different angles, expressions, maybe different clothing) rather than seven near-identical frames. One reference image of a face from one angle gives the model much less to lock onto than three good views.
Install
Pack install: ComfyUI Manager → search "ComfyUl-UCloud" → Install → restart, or git clone https://github.com/ucloud/comfyui-plugin into custom_nodes. No model downloads, light deps, API key from the Modelverse console.
Honest caveats: reference-to-video is the fiddliest of the Vidu modes, so budget a few tries before the subject locks in - that's normal, not a broken node. And everything here is metered, so those retries cost. Start with a single strong reference, confirm the subject reads, then add more.
Inputs (16)
| Name | Type | Default | Description |
|---|---|---|---|
| client | MODELVERSE_API_CLIENT | — | |
| model | COMBO | viduq3-turbo | viduq3-turbo: 生成快, viduq2: 旧版模型 |
| prompt | STRING | make it dance | 文本提示词,最长2000字符 |
| duration | INT | 51–10 | 视频时长(秒) |
| aspect_ratio | COMBO | 16:9 | 长宽比 |
| resolution | COMBO | 720p | 分辨率 |
| image1opt | IMAGE | 参考图片1 | |
| image2opt | IMAGE | 参考图片2 | |
| image3opt | IMAGE | 参考图片3 | |
| image4opt | IMAGE | 参考图片4 | |
| image5opt | IMAGE | 参考图片5 | |
| image6opt | IMAGE | 参考图片6 | |
| image7opt | IMAGE | 参考图片7 | |
| image_urlsopt | STRING | 参考图片URL列表,每行一个 | |
| seedopt | INT | 00–2147483647 | 随机种子 |
| bgmopt | BOOLEAN | false | 是否添加背景音乐 |
Outputs (2)
| Name | Type | Description |
|---|---|---|
| url | STRING | — |
| task_id | STRING | — |