arXiv Computer Vision

DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluation

The paper introduces DirectSwap, a mask‑free video head‑swapping method that leverages a newly created cross‑identity paired dataset, HeadSwapBench. By synthesizing expression‑synchronized video pairs from real footage, the authors provide frame‑aligned ground truth for full‑reference evaluation of identity, expression, pose, reconstruction fidelity, and temporal stability. DirectSwap outperforms traditional same‑identity masked reconstruction, especially when head silhouettes change, and can restore non‑head content without external segmentation.

arXiv AI
Jun 11

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation

arXiv:2606. 11670v1 Announce Type: cross Abstract: Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and conflicts among text, first-frame, and identity references.

By Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu, Yuanxing Zhang, Yulong Xu, Pengfei Wan
arXiv Computer Vision
Aug 21

ID-V2V: Identity-Preserving Video Restylization

arXiv:2607. 22830v2 Announce Type: replace Abstract: In visual storytelling, human performances are central to creative intent and narrative meaning.

By Yuancheng Xu, Mingming He, Pablo Salamanca, Li Ma, Yash Kant, Emmett Steven, Paul Debevec, Ning Yu
arXiv Machine Learning
Oct 9

GHARP: Real-time Gaussian Head Animation from Large-scale Reconstruction Prior

GHARP is a two‑stage method that animates 3D human heads in real time using a large‑scale reconstruction prior. The first offline identity stage builds a compact Gaussian representation of a subject’s geometry and appearance, while the lightweight runtime animation stage predicts expression‑dependent residuals in a semantically structured latent space. A body alignment network further refines the animation by aligning body pose and clothing, enabling state‑of‑the‑art quality on the Ava‑256 benchmark with significantly faster performance and fewer Gaussians.

By Ali Benlalah, Sepehr Johari, Patricia Vitoria, Armin Kappeler, Artem Sevastopolsky, Alexander Jung, Gabriele Fanelli, Kevin Mader, Manuel Breitenstein, Claudia Pl\"uss, Jan R\"uegg, Simon Biland, Thomas Etterlin, Dmitry Kostiaev, Mathias Deschler, Brian Amberg, Sebastian Martin
arXiv Computer Vision
Oct 9

Expression-Diverse References for Identity-Preserving Video Generation

The paper addresses the challenge of identity‑preserving video generation when a single reference portrait cannot capture the subject’s appearance across varied expressions. It introduces a compact, expression‑diverse reference gallery and a new evaluation metric that measures identity similarity for mild, intense, and extreme expressions. By extending the Stand‑In model to use these galleries and curating diverse face crops from training videos, the authors demonstrate improved identity preservation, especially for extreme expressions, on both real and synthesized reference sets.

By Tianwen Fu, Wenbin Teng, Gonglin Chen, Junyi Ouyang, Haolin Xiong, Yajie Zhao
arXiv Computer Vision
Aug 28

EditaLive! Unified Character Video Editing for Live Streaming

EditaLive! is a new real‑time framework for character video editing in live streaming, built on a pretrained image animation model (Wan‑Animate) that separates appearance from motion. It uses the CharEdit‑50K dataset for reference‑frame editing and video reconstruction, and adapts the model from offline bidirectional to causal streaming generation. A self‑rollout distillation strategy compresses the model into a two‑step sampler, employing fixed RoPE, alignment forcing, and first‑frame preserved sparse attention to reduce appearance drift and achieve low‑latency inference while preserving facial expressions.

By Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang, Bo Li, Xiaodong Cun