Extensions/ComfyUI-RAVE Attention
ComfyUI Extension

ComfyUI-RAVE Attention

ComfyUI nodes to use RAVE attention as a temporal attention mechanism. This differs from other implementations in that it does not concatenate the images together, but within the UNet's Self-Attention mechanism performs the RAVE technique. By not altering the images/latents throughout the UNet, this method does not affect other temporal techniques, style mechanisms, or other UNet modifications. For example, it can be combined with AnimateDiff, ModelScope/ZeroScope, or FLATTEN.

By logtd·Created 2 years ago·Updated 2 years ago· 13
logtd/ComfyUI-RAVE_ATTN
Nodes3
On cloudLocal install
Categoryattention
Stars13
Updated2 years ago

Nodes (3)

Apply Rave Attention
attention
Attention Override (SD1.5)
attention
Attention Override (SDXL)
attention
Readme

ComfyUI-RAVE Attention

ComfyUI nodes to use RAVE attention as a temporal attention mechanism.

This differs from other implementations in that it does not concatenate the images together, but within the UNet's Self-Attention mechanism performs the RAVE technique. By not altering the images/latents throughout the UNet, this method does not affect other temporal techniques, style mechanisms, or other UNet modifications.

For example, it can be combined with AnimateDiff, ModelScope/ZeroScope, or FLATTEN.

Installation

This repository does not require any additional packages. Just git clone this into your custom_nodes/ directory.

Examples

See the example_workflows directory for example workflows.

Acknowledgements