ComfyUI_StreamingT2V
ComfyUI_StreamingT2V
Nodes (24)
A boring text-file reader that the prompt-travel workflow quietly depends on
The little node that answers 'which prompt is running at frame N?'
The save half of StreamingT2V's state loop
The all-in-one loader that crams an entire long-video pipeline into one node
The AnimateDiff seed generator, loaded on its own
Turn 256px long videos into 720p
The Modelscope T2V short-video generator, on its own
Modelscope seed, StreamingT2V extension, enhance built in
Load just the autoregressive heart of StreamingT2V
SVD seed, StreamingT2V extension, enhance
The image-to-video seed generator
VidXTend, the 5GB StreamingT2V that runs on 10GB VRAM
Upscale your long 256px video to 720p with one pass
SVD seed, StreamingT2V extension, enhance
Extend your seed into a long 256px video
VidXTend long extension, IMAGE in, IMAGE out
VidXTend extension with custom reference frames for appearance control
The VidXTend variant that conditions on the whole video so far
VidXTend long extension where the prompt changes mid-video
16 frames of AnimateDiff, the seed every long video starts from
The 16-frame seed that starts every StreamingT2V long video
One still image becomes the opening of a long video
The all-in-one node that turns a prompt into a minutes-long mp4
A tiny bridge that turns a VHS filename into a plain string
ComfyUI-StreamingT2V
Painebenjamin created the VidXTend model, which reduces the size from the original 25.6GB to 5GB. When using the VidXTend process, there is no need to manually download the model, as it will be downloaded automatically.
If you use the original model, please download the StreamingT2V model and place it in folder ComfyUI/model/checkpoints
VidXTend (<10G VRAM) | Original (<15G VRAM)
workflow
<img src="workflow/wf_final.png" raw=true> <img src="workflow/wf_VidXTend.png" raw=true>Test prompt travel cyclist Workflow
<img src="workflow/wf_prompttravel.png" raw=true>Open the Auto Queue option, Stop it when you want to.
<img src="workflow/cyclist.png" raw=true> <details> <summary>More Workflow</summary>Step 1 (It's not necessary.) Generate short video (16x256x256):
You can freely generate a 16x256x256 video without using the process below. You can even use videos downloaded from the internet.
AnimateDiff Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_ad.json
<img src="workflow/wf_short_ad.png" raw=true>Modelscope Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_ms.json
<img src="workflow/wf_short_ms.png" raw=true>SVD Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_svd.json
<img src="workflow/wf_short_svd.png" raw=true>Step 2 Generate long video (nx256x256):
VidXTend Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_VidXTend.json
<img src="workflow/wf_VidXTend.png" raw=true>Original Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_long.json
<img src="workflow/wf_long.png" raw=true>Step 3 Generate long enhanced video (nx512x512):
https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_enhance.json
<img src="workflow/wf_enhance.png" raw=true>You can generate all by one workflow (MORE VRAM)
ModelscopeT2V (T2V)
https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf.json
<img src="workflow/wf.png" raw=true>AnimateDiff (T2V)
https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_ad.json
<img src="workflow/wf_ad.png" raw=true>SVD (I2V)
https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_svd.json
<img src="workflow/wf_svd.png" raw=true>