IPIV’s Morph AnimateDiff
Metadata
Prompts
Increasing Motion Scale results in more motion but can sometimes give wild results.
1.0 - 1.4 seems to be the range from my testing but feel free to experiment!
Hyper-SD15-8steps-lora.safetensors
https://huggingface.co/ByteDance/Hyper-SD/resolve/main/Hyper-SD15-8steps-lora.safetensors?download=true
Any SD1.5 checkpoint should work.
Make sure to match VAE according to the Checkpoint you use. If none is specified use embedded VAE or vae-ft-MSE-840000-ema-pruned
/ComfyUI/models/clip_vision folder
Download and rename to "CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors" https://huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors
Download and rename to "CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors" https://huggingface.co/h94/IP-Adapter/resolve/main/sdxl_models/image_encoder/model.safetensors
To keep the look closer to original images you can increase the weights of ipadapters and/or change to ipadapter Plus model in the Unified Loader node.
v3_sd15_mm.ckpt
Installable via Manager -> Install Models
or
https://huggingface.co/guoyww/animatediff/resolve/main/v3_sd15_mm.ckpt?download=true
animatediff/v3_sd15_adapter.ckpt
Installable via Manager -> Install Models
or
https://huggingface.co/guoyww/animatediff/resolve/main/v3_sd15_adapter.ckpt?download=true
On higher VRAM cards I suggest you use starting resolution 320x568 or higher. (Longer to process + higher vram usage)
Keep batch_size same unless you know what you're doing - Currently, IPAdapter attention mask values aren't modular and need to be hand adjusted when changing the batch size.
Negative
You can bypass the 3 video outputs on the right to skip the upscaling process until u are happy with the motion/look of the preview. (Keep seed randomized until u are happy with preview then Fix the seed and unbypass)
Positive
Groups
- IPAdapters
- AnimateDiff
- QrCode Controlnet
- Settings
- Samplers
- Upscale /w Model
- Frame Interpolation
- Color Correct
Checkpoints
- film_net_fp32.pt
- /ComfyUI/models/clip_vision folder Download and rename to "CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors" https://huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors Download and rename to "CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors" https://huggingface.co/h94/IP-Adapter/resolve/main/sdxl_models/image_encoder/model.safetensors
- v3_sd15_adapter.ckpt
- juggernaut_reborn.safetensors
- vae-ft-mse-840000-ema-pruned.safetensors
- v3_sd15_mm.ckpt
- control_v1p_sd15_qrcode_monster.safetensors
- rife47.pth
- Hyper-SD15-8steps-lora.safetensors
- 4x-UltraMix_Smooth.pth
ComfyUI Nodes
- VAEEncode
- ADE_ApplyAnimateDiffModelSimple
- PreviewImage
- RepeatImageBatch
- MaskToImage
- Note
- Reroute
- ADE_MultivalDynamic
- ImageScaleBy
- ADE_UseEvolvedSampling
- FILM VFI
- VAEDecode
- KSampler
- ADE_LoopedUniformContextOptions
- CreateFadeMaskAdvanced
- CLIPTextEncode
- ACN_AdvancedControlNetApply
- LoadImage
- ImageSharpen
- BatchCount+
- VHS_SplitImages
- SimpleMath+
- LoraLoaderModelOnly
- CheckpointLoaderSimple
- VAELoader
- ADE_LoadAnimateDiffModel
- ControlNetLoaderAdvanced
- VHS_VideoCombine
- RIFE VFI
- UpscaleModelLoader
- VHS_LoadVideoPath
- VHS_LoadVideo
- ImageUpscaleWithModel
- ImageScale
- EmptyLatentImage
- IPAdapterUnifiedLoader
- IPAdapterAdvanced
- PrimitiveNode
ComfyUI Extensions
- BadCafeCode__masquerade-nodes-comfyui
- BlenderNeko__ComfyUI_ADV_CLIP_emb
- BlenderNeko__ComfyUI_Cutoff
- BlenderNeko__ComfyUI_Noise
- BlenderNeko__ComfyUI_SeeCoder
- BlenderNeko__ComfyUI_TiledKSampler
- Derfuu__Derfuu_ComfyUI_ModdedNodes
- Davemane42__ComfyUI_Dave_CustomNode
- EllangoK__ComfyUI-post-processing-nodes
- Fannovel16__ComfyUI-Frame-Interpolation
- Fannovel16__ComfyUI-Loopchain
- Jcd1230__rembg-comfyui-node
- Kosinkadink__ComfyUI-VideoHelperSuite
- LEv145__images-grid-comfy-plugin
- WASasquatch__ASTERR
- WASasquatch__FreeU_Advanced
- WASasquatch__PPF_Noise_ComfyUI
- WASasquatch__PowerNoiseSuite
- WASasquatch__WAS_Extras
- WASasquatch__was-node-suite-comfyui
- WASasquatch__ComfyUI_Preset_Merger
- guoyk93__yk-node-suite-comfyui
- jags111__efficiency-nodes-comfyui
- lilly1987__ComfyUI_node_Lilly
- omar92__ComfyUI-QualityOfLifeSuit_Omar92
- paulo-coronado__comfy_clip_blip_node
- trojblue__trNodes
- cubiq__ComfyUI_essentials
- comfyanonymous__ComfyUI
- Kosinkadink__ComfyUI-AnimateDiff-Evolved
- Kosinkadink__ComfyUI-Advanced-ControlNet
- kijai__ComfyUI-KJNodes
- cubiq__ComfyUI_IPAdapter_plus