ComfyUI Node: VideoImageWarp

Authored by blob8

Created

Updated

3 stars

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Category

Image to video

Inputs

video_images IMAGE
compute_flow_resolution FLOAT
stabilization FLOAT
motion_scale FLOAT
grid_spacing INT
first_frame IMAGE
warp_smooting FLOAT
tau FLOAT
lambda_ FLOAT
theta FLOAT
nscales INT
warps INT
epsilon FLOAT
inner_iterations INT
outer_iterations INT
influence_map IMAGE

Outputs

IMAGE

Extension: ComfyUI_video-image-motion-transfer

Introduces a node that tries to approximate the entire video using it's first frame (that we stylize) by warping it using optical flow extracted from the video. First we do image-to-image using the reference video's first frame and a depth controlnet. The generated object doesn't have to closely resemble the reference like on the demo. Then the generated image and the video frames are fed into the node and it returns a warped video. No ai models are used by the node. The example workflow uses SDXL but you can get it to work with any arch if you manage i2i.

Authored by blob8

View Nodes

Looking for a different node?

Run ComfyUI workflows without the setup

No installs, no CUDA version roulette, no GPU sitting idle on your bill. Bring a workflow and run it in the browser.

Learn more