FAL Video2Video Request
FAL Video2Video Request
- ref_image
- first_frame
- last_frame
- video
- width
- height
- fps
- url
This is the pack's heaviest video node, and it's built for a specific job: pose-driven motion transfer. Feed it a driving video (a source clip of someone moving) and a reference image (the subject you want performing that motion), and it calls FAL's fal-ai/wan-22-vace-fun-a14b/pose endpoint to generate a new video of your reference subject doing whatever the driving video does. VACE-style motion transfer is one of the more genuinely useful things the Wan ecosystem does well, and this node exposes essentially all of the endpoint's surface area rather than a trimmed-down subset.
The inputs that actually drive the result: video_name points at your driving video, already present in ComfyUI's input/ folder - not a URL. prompt describes the scene/subject; the node ships a long, opinionated default negative_prompt covering the usual video-generation failure modes (extra fingers, deformed limbs, static frames, subtitles, cluttered backgrounds) so you're not starting from a blank negative prompt. ref_image is your subject reference; ref_image_urls is an alternative if your references are already hosted somewhere rather than loaded locally, one URL per line. first_frame and last_frame are separate optional image inputs for pinning the exact start and end of the generated clip, on top of the general ref_image. match_input_num_frames and match_input_frames_per_second (both true by default) auto-derive num_frames (81–241) and frames_per_second from your driving video; turn them off to set those explicitly instead.
Frame-rate and interpolation controls worth knowing about: num_interpolated_frames, temporal_downsample_factor, and enable_auto_downsample let you insert or reduce frames relative to the raw generation - combined with interpolator_model (rife or film, default film) choosing which interpolation algorithm handles the in-between frames, and auto_downsample_min_fps setting the floor enable_auto_downsample won't drop below. This is a lot of surface area for one node - if you're not chasing a specific frame-rate target, leave these at default and only start adjusting once you know exactly what output cadence you need.
Other knobs: preprocess (on by default) runs pose extraction on your driving video automatically; resolution (auto default, plus 240p through 720p) and aspect_ratio (auto default) set output framing; acceleration, video_quality, and video_write_mode are the same speed/quality/file-size trade-offs seen across this pack's other FAL video nodes.
Outputs: video, width, height, fps, url.
Install and setup: search "ComfyUI-utils-nodes" in ComfyUI Manager, or git clone https://github.com/zhangp365/ComfyUI-utils-nodes into custom_nodes, restart. Needs a FAL API key from fal.ai, via api_key or fal_config.yml.
Where this actually breaks:
- With this many optional inputs, it's easy to leave
preprocesson while feeding a driving video that's already a pose-extracted control video - double-preprocessing produces motion that doesn't track correctly. Know what your input video actually is before toggling this. timeoutdefaults to 300 seconds; this endpoint does more work per call than a plain i2v request (pose extraction plus generation plus optional interpolation), so it's genuinely more likely to need the higher end of the 1–3000 second range than the simpler nodes in this pack.enable_safety_checkerdefaults tofalsehere too - flip it on deliberately if you need content filtering rather than assuming it's active.- With
num_interpolated_frames,temporal_downsample_factor, andenable_auto_downsampleall touching frame count simultaneously, it's easy to end up with an output frame rate you didn't intend. If your final video's motion looks too smooth or too choppy relative to what you expected, this stack of settings - not the base generation - is the first place to look. - This is a metered call on a relatively expensive endpoint given everything it's doing under the hood. Test on a short driving-video clip before running your full-length footage through it.
Inputs (32)
| Name | Type | Default | Description |
|---|---|---|---|
| video_name | STRING | 输入视频文件名(位于input目录) | |
| prompt | STRING | 视频描述 | |
| model | STRING | fal-ai/wan-22-vace-fun-a14b/pose | FAL模型名称 |
| api_keyopt | STRING | FAL API密钥 | |
| negative_promptopt | STRING | letterboxing, borders, black bars, bright colors, overexposed, static, blurred details, subtitles, style, artwork, painting, picture, still, overall gray, worst quality, low quality, JPEG compression residue, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn faces, deformed, disfigured, malformed limbs, fused fingers, still picture, cluttered background, three legs, many people in the background, walking backwards | 负面提示词 |
| match_input_num_framesopt | BOOLEAN | true | 匹配输入视频帧数 |
| num_framesopt | INT | 8181–241 | 生成帧数 |
| match_input_frames_per_secondopt | BOOLEAN | true | 匹配输入视频帧率 |
| frames_per_secondopt | INT | 165–30 | 视频帧率 |
| seedopt | INT | 00–18446744073709550000 | 随机种子 |
| resolutionopt | COMBO | auto | 视频分辨率 |
| aspect_ratioopt | COMBO | auto | 宽高比 |
| num_inference_stepsopt | INT | 301–100 | 推理步数 |
| guidance_scaleopt | FLOAT | 5.01–20 | 引导强度 |
| shiftopt | FLOAT | 5.00–10 | 偏移参数 |
| ref_imageopt | IMAGE | 参考图像 | |
| ref_image_urlsopt | STRING | 参考图像URL列表,每行一个 | |
| first_frameopt | IMAGE | 首帧图像 | |
| last_frameopt | IMAGE | 末帧图像 | |
| enable_safety_checkeropt | BOOLEAN | false | 启用安全检查 |
| enable_prompt_expansionopt | BOOLEAN | false | 启用提示扩展 |
| preprocessopt | BOOLEAN | true | 预处理输入视频 |
| accelerationopt | COMBO | regular | 加速模式 |
| video_qualityopt | COMBO | high | 视频质量 |
| video_write_modeopt | COMBO | balanced | 视频写入模式 |
| num_interpolated_framesopt | INT | 00–100 | 插值帧数 |
| temporal_downsample_factoropt | INT | 00–10 | 时间下采样因子 |
| enable_auto_downsampleopt | BOOLEAN | false | 启用自动下采样 |
| auto_downsample_min_fpsopt | FLOAT | 15.01–30 | 自动下采样最小帧率 |
| interpolator_modelopt | COMBO | film | 插值模型 |
| sync_modeopt | BOOLEAN | false | 同步模式 |
| timeoutopt | INT | 3001–3000 | 超时时间(秒) |
Outputs (5)
| Name | Type | Description |
|---|---|---|
| video | VIDEO | — |
| width | INT | — |
| height | INT | — |
| fps | FLOAT | — |
| url | STRING | — |