Nodes/Comfyui-zhenzhen/Zhenzhen_vidu_ref2video
ComfyUI Node

Zhenzhen_vidu_ref2video

Characters that hold still, and voices that don't

By T8mars·Created about a year ago·Updated 3 days ago· 749
Zhenzhen_vidu_ref2video
  • image
  • image1
  • image2
  • image3
  • image4
  • image5
  • image6
  • image7
  • video
  • video_url
  • task_id
  • response
◄prompt—►
◄modelviduq2►
◄api_key►
◄audiofalse►
◄subject1_id1►
◄subject1_voice_id►
◄subject2_id2►
◄subject2_voice_id►
◄subject3_id3►
◄subject3_voice_id►
◄duration5►
◄seed0►
◄aspect_ratio16:9►
◄resolution720p►
◄movement_amplitudeauto►
◄bgmfalse►
◄off_peakfalse►
◄watermarkfalse►
◄wm_position3►
◄skip_errorfalse►

Vidu's reference-to-video mode is the one where you hand it a character still and it keeps that character consistent while the scene moves - no ControlNet, no IPAdapter, no local weights at all, because Comfly_vidu_ref2video is a paid API client for the Vidu relay. That's the whole appeal: character consistency without fighting a local identity stack. You feed up to seven reference images, optionally tell it which subject each image belongs to, and even assign the subject a voice so the generated character can talk. This is about as close to "generate a scene with my OC" as a ComfyUI node gets without local training.

Inputs that matter

  • prompt - the scene description. Required.
  • model - viduq2 (default), viduq1, vidu2.0, or vidu1.5. Newer isn't always better for your exact job; q2 is the current default for a reason.
  • image1…image7 - your reference stills. Fewer is fine; the subject consistency comes from Vidu, not from quantity.
  • audio - toggles whether the output gets a generated voice track.
  • subject1_id … subject3_id - map each reference image to a subject slot (defaults "1", "2", "3").
  • subjectN_voice_id - the kicker: hundreds of voices, from female-shaonv to the male-qn-* premium set. Assign one per subject and your character talks.
  • duration - 1–10 seconds.
  • aspect_ratio / resolution - 16:9/9:16/4:3/3:4/1:1 and 540p/720p/1080p.
  • movement_amplitude - auto/small/medium/large; large is where the shot gets lively.
  • bgm - background music track on/off.
  • off_peak - run during off-peak hours for a cheaper rate (Vidu's discount window).
  • watermark / wm_position - if you don't want Vidu's watermark baked in, keep it off.

Outputs: video (into ComfyUI's native Save Video), plus video_url, task_id, response.

Install

Standard Comfly:

cd ComfyUI/custom_nodes
git clone https://github.com/ainewsto/Comfyui_Comfly

Or ComfyUI Manager → "Comfyui_Comfly" → restart. Nothing runs locally; you need credits at https://ai.comfly.chat and the key in Comflyapi.json (or the node's api_key override).

Gotchas

Voice assignment is the fiddly part - the subject ids are strings ("1", "2", "3") and if your images aren't clearly separable subjects, the voice lands on the wrong one and you've paid for a weird result. And remember the relay is a third-party service: a render that fails still cost you a slot, so keep off_peak in mind for batch work and use the task_id/response outputs to check what actually happened before re-queuing. The watermark toggle defaults off, which is nice - just don't assume it stays off if you load an example workflow someone else saved.

Categoryzhenzhen/Vidu

Inputs (28)

NameTypeDefaultDescription
promptSTRING—
modelCOMBOviduq24 options: viduq2, viduq1, vidu2.0, vidu1.5
api_keyoptSTRING—
imageoptIMAGE—
image1optIMAGE—
image2optIMAGE—
image3optIMAGE—
image4optIMAGE—
image5optIMAGE—
image6optIMAGE—
image7optIMAGE—
audiooptBOOLEANfalse—
subject1_idoptSTRING1—
subject1_voice_idoptCOMBO304 options: , male-qn-qingse, male-qn-jingying, male-qn-badao, male-qn-daxuesheng, female-shaonv, +298
subject2_idoptSTRING2—
subject2_voice_idoptCOMBO304 options: , male-qn-qingse, male-qn-jingying, male-qn-badao, male-qn-daxuesheng, female-shaonv, +298
subject3_idoptSTRING3—
subject3_voice_idoptCOMBO304 options: , male-qn-qingse, male-qn-jingying, male-qn-badao, male-qn-daxuesheng, female-shaonv, +298
durationoptINT51–10—
seedoptINT00–2147483647—
aspect_ratiooptCOMBO16:95 options: 16:9, 9:16, 4:3, 3:4, 1:1
resolutionoptCOMBO720p3 options: 540p, 720p, 1080p
movement_amplitudeoptCOMBOauto4 options: auto, small, medium, large
bgmoptBOOLEANfalse—
off_peakoptBOOLEANfalse—
watermarkoptBOOLEANfalse—
wm_positionoptCOMBO34 options: 1, 2, 3, 4
skip_erroroptBOOLEANfalse开启后,节点失败时不报错、按旧行为返回默认空结果;关闭时(默认)失败直接抛出错误。

Outputs (4)

NameTypeDescription
videoVIDEO—
video_urlSTRING—
task_idSTRING—
responseSTRING—