arXiv AI By Yuanzhi Wang, Xuhua Ren, Jiaxiang Cheng, Bing Ma, Kai Yu, Sen Liang, Wenyue Li, Tianxiang Zheng, Qinglin Lu, Zhen Cui

FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation

Read the original on arXiv AI →

FaithfulFaces introduces a pose‑faithful facial identity preservation framework for text‑to‑video generation, addressing identity distortion caused by large pose variations or occlusions. The method employs a pose‑shared identity aligner that refines and aligns facial poses across views using a pose‑shared dictionary and a pose‑variation‑identity invariance constraint. By mapping single‑view inputs into a global pose representation with explicit Euler angle embeddings, the framework provides a robust facial prior that guides generation toward consistent identity and structural clarity, achieving state‑of‑the‑art performance on a curated high‑quality video dataset.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Jul 23

GroupVideo: Multi-Identity Customized Text-to-Video Generation

Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity separation mechanisms often leads to identity confusion in multi-identity settings. Existing multi-identity approaches, which directly extend single-identity frameworks by concatenating face images as input conditions, frequently result in unnatural facial expressions and motions, manifesting as the "copy-paste" phenomenon.

arXiv Computer Vision
Aug 21

ID-V2V: Identity-Preserving Video Restylization

arXiv:2607. 22830v2 Announce Type: replace Abstract: In visual storytelling, human performances are central to creative intent and narrative meaning.

By Yuancheng Xu, Mingming He, Pablo Salamanca, Li Ma, Yash Kant, Emmett Steven, Paul Debevec, Ning Yu
arXiv Computer Vision
Oct 9

Expression-Diverse References for Identity-Preserving Video Generation

The paper addresses the challenge of identity‑preserving video generation when a single reference portrait cannot capture the subject’s appearance across varied expressions. It introduces a compact, expression‑diverse reference gallery and a new evaluation metric that measures identity similarity for mild, intense, and extreme expressions. By extending the Stand‑In model to use these galleries and curating diverse face crops from training videos, the authors demonstrate improved identity preservation, especially for extreme expressions, on both real and synthesized reference sets.

By Tianwen Fu, Wenbin Teng, Gonglin Chen, Junyi Ouyang, Haolin Xiong, Yajie Zhao