ComfyUI Extension: ComfyUI-IPAnimate

Authored by Chan-0312

Created

Updated

71 stars

This is a project that generates videos frame by frame based on IPAdapter+ControlNet. Unlike a/Steerable-motion, we do not rely on AnimateDiff. This decision is primarily due to the fact that the videos generated by AnimateDiff are often blurry. Through frame-by-frame control using IPAdapter+ControlNet, we can produce higher definition and more controllable videos.

Custom Nodes (1)

README

ComfyUI-IPAnimate

  • 这是一个基于IPAdapter+ControlNet逐帧生成视频的工作,与Steerable-motion不同,我们不依赖于AnimateDiff,这主要是考虑到当前AnimateDiff生成的视频较为模糊所决定的。通过IPAdapter+ControlNet的逐帧控制,使得我们可以生成更高清和可控的视频。 输入图片 生成视频

使用介绍

  • Steerable-motion结构类似,我们提供了线性和动态两种控制方式,并且提供了外置ControlNet图片的输入,以提供更多的可玩性。

模型

  • 主要参数:
    • 变化帧长度
    • 影响强度范围
    • 相对IPA和CN的影响力度
  • 具体工作流请参考:demo

参考来源