WanTrackToVideo (Tiled VAE encode)
Animate objects along trajectories with Wan, on a budget
- positive
- negative
- vae
- start_image
- clip_vision_output
- positive
- negative
- latent
WanTrackToVideo (Tiled VAE encode) is the odd one in this pack. Most Wan nodes condition on images or video; this one conditions on tracks - JSON lists of object trajectories - and uses Wan's patch_motion machinery to move objects along them. It's a drop-in replacement for the core WanTrackToVideo node with the VAE encode run in tiles, and it's the most specialized node here. If you're not doing trajectory-based animation, you almost certainly want the plain I2V node instead.
How it works
You feed it a start_image plus a tracks string - JSON describing where objects are and how they move over the clip. The node pads and processes the track points (using helpers pulled straight from ComfyUI's comfy_extras.nodes_wan), encodes the start frame with the tiled VAE, and then runs patch_motion to build a concat_mask and concat_latent_image that steer the denoiser along your trajectories. The temperature and topk knobs control how that motion-patching behaves - higher temperature, looser. If you leave tracks empty, the node quietly falls back to plain image-to-video behavior, which is a nice safety net.
Inputs that matter
- tracks - a multiline JSON string of trajectories. This is the whole ballgame; the format mirrors what the core ComfyUI
WanTrackToVideoexpects, so copy from a working example before you improvise. - start_image - the scene you're animating.
- temperature (default 220) and topk (default 2) - motion-patch sampling controls; leave at defaults until you know why you're changing them.
- The standard width / height / length / batch_size and the four tiling knobs tile_size / overlap / temporal_size / temporal_overlap, plus optional clip_vision_output.
Outputs: positive, negative, latent, wired to your sampler as usual.
Install
The pack installs as a unit:
cd ComfyUI/custom_nodes
git clone https://github.com/stduhpf/ComfyUI--WanImageToVideoTiled
or ComfyUI Manager → search "WanImageToVideoTiled" → Install, then restart. Nothing extra to download - the track-processing helpers come from core ComfyUI.
The honest caveats
The README lists this node as unchecked (untested by the author), and it's built on one of the more experimental corners of core ComfyUI's Wan code, so treat it as "try it, report back" rather than battle-tested. It's also the rare node where tiling isn't the hard part - parsing and patching tracks is where things go wrong, and there's little community help to lean on because the pack barely registers on reddit. If your goal is just "animate my first frame," save yourself the JSON debugging and use WanImageToVideo (Tiled VAE encode) instead. And as always in this pack: tiling only relieves the encode stage, and pair it with VAE Decode (Tiled) on the way out.
Inputs (16)
| Name | Type | Default | Description |
|---|---|---|---|
| positive | CONDITIONING | — | |
| negative | CONDITIONING | — | |
| vae | VAE | — | |
| tracks | STRING | [] | — |
| width | INT | 83216–16384 | — |
| height | INT | 48016–16384 | — |
| length | INT | 811–16384 | — |
| batch_size | INT | 11–4096 | — |
| temperature | FLOAT | 220.01–1000 | — |
| topk | INT | 21–10 | — |
| start_image | IMAGE | — | |
| tile_size | INT | 51264–4096 | — |
| overlap | INT | 640–4096 | — |
| temporal_size | INT | 648–4096 | Amount of frames to encode at a time. |
| temporal_overlap | INT | 84–4096 | Amount of frames to overlap. |
| clip_vision_outputopt | CLIP_VISION_OUTPUT | — |
Outputs (3)
| Name | Type | Description |
|---|---|---|
| positive | CONDITIONING | — |
| negative | CONDITIONING | — |
| latent | LATENT | — |