Nodes/ComfyUI-WanAnimatePreprocessV2/Wan Gaze — ETH-XGaze Post-Processor (V2)
ComfyUI Node

Wan Gaze — ETH-XGaze Post-Processor (V2)

Replace pose_data['iris_data'] gaze vectors with predictions from the ETH-XGaze ResNet-50 model (ECCV 2020). Requires the pretrained checkpoint epoch_24_ckpt.pth.tar in ComfyUI/models/ethxgaze/.

By Code2Collapse·Created 7 months ago·Updated 12 days ago· 17
Wan Gaze — ETH-XGaze Post-Processor (V2)
  • pose_data
  • images
  • pose_data
  • info
checkpoint
checkpoint_path_override
deviceauto
blend1.00
batch_size8
CategoryWanAnimatePreprocessV2/extras

Inputs (7)

NameTypeDefaultDescription
pose_dataPOSEDATAPOSEDATA bundle from the V2 preprocessor (with iBUG-68 keypoints_face).
imagesIMAGESame RGB image stack the POSEDATA was computed from. Used for the 224x224 face normalisation.
checkpointCOMBOETH-XGaze pretrained weights. Auto-discovered from models/ethxgaze/ and third_party/ETH-XGaze/ckpt/.
checkpoint_path_overrideoptSTRINGAbsolute path to override the dropdown selection. Empty = use the dropdown.
deviceoptCOMBOauto3 options: auto, cuda, cpu
blendoptFLOAT1.000–10 = keep original iris_data gaze, 1 = full ETH-XGaze. Useful to smooth-blend in the new model.
batch_sizeoptINT81–64Number of normalised face crops fed through gaze_network per forward pass.

Outputs (2)

NameTypeDescription
pose_dataPOSEDATA
infoSTRING