arXiv AI

FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation

FaithfulFaces introduces a pose‑faithful facial identity preservation framework for text‑to‑video generation, addressing identity distortion caused by large pose variations or occlusions. The method employs a pose‑shared identity aligner that refines and aligns facial poses across views using a pose‑shared dictionary and a pose‑variation‑identity invariance constraint. By mapping single‑view inputs into a global pose representation with explicit Euler angle embeddings, the framework provides a robust facial prior that guides generation toward consistent identity and structural clarity, achieving state‑of‑the‑art performance on a curated high‑quality video dataset.

Hugging Face Trending Papers
Jul 23

GroupVideo: Multi-Identity Customized Text-to-Video Generation

Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity separation mechanisms often leads to identity confusion in multi-identity settings. Existing multi-identity approaches, which directly extend single-identity frameworks by concatenating face images as input conditions, frequently result in unnatural facial expressions and motions, manifesting as the "copy-paste" phenomenon.

arXiv Computer Vision
Aug 21

ID-V2V: Identity-Preserving Video Restylization

arXiv:2607. 22830v2 Announce Type: replace Abstract: In visual storytelling, human performances are central to creative intent and narrative meaning.

By Yuancheng Xu, Mingming He, Pablo Salamanca, Li Ma, Yash Kant, Emmett Steven, Paul Debevec, Ning Yu
arXiv Computer Vision
Oct 9

Expression-Diverse References for Identity-Preserving Video Generation

The paper addresses the challenge of identity‑preserving video generation when a single reference portrait cannot capture the subject’s appearance across varied expressions. It introduces a compact, expression‑diverse reference gallery and a new evaluation metric that measures identity similarity for mild, intense, and extreme expressions. By extending the Stand‑In model to use these galleries and curating diverse face crops from training videos, the authors demonstrate improved identity preservation, especially for extreme expressions, on both real and synthesized reference sets.

By Tianwen Fu, Wenbin Teng, Gonglin Chen, Junyi Ouyang, Haolin Xiong, Yajie Zhao
arXiv AI
Jun 11

ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation

arXiv:2606. 11670v1 Announce Type: cross Abstract: Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and conflicts among text, first-frame, and identity references.

By Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu, Yuanxing Zhang, Yulong Xu, Pengfei Wan