arXiv:2609.13264v1 Announce Type: cross Abstract: Generating human-centric videos that preserve both visual identity and person-specific expressive behavior remains a fundamental challenge. In additi...
arXiv:2511.05575v2 Announce Type: replace Abstract: Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based meth...
Video Diffusion Avatars (VDAs) fine‑tune video diffusion models to generate photo‑realistic, multi‑view consistent avatars from a single image, allowing precise control over camera viewpoint, facial expression, and upper‑body pose. VDAs replace traditional 3D morphable models with a learned expression space, overcoming viewpoint bias through disentanglement and enabling independent control of expression, pose, and viewpoint via proxy‑mesh renderings. The method trains efficiently—34 hours on a single A100—and outperforms state‑of‑the‑art single‑image 3D avatars, improving novel‑view reenactment metrics and producing physically plausible hair dynamics, shadows, reflections, and refractions.
Vorch-Human is a unified framework for human‑centric audio‑visual generation that handles multiple tasks—animating a person from speech, jointly generating speech and video from a voice reference, and synthesizing a scene from paired appearance and voice references—using a single dual‑stream audio‑video diffusion transformer. The model incorporates clean condition‑audio and condition‑video tokens, per‑token task embeddings, temporal position types, condition masks, and a shared multimodal prompt encoder to express diverse inputs such as driving speech, timbre examples, first frames, and subject images. A two‑level data pipeline supplies the necessary supervision by extracting speech, appearance, and timbre annotations from clips and linking consistent identity and outfit references across videos, while a frozen‑prefix recurrence enables long‑form audio‑driven generation with reduced boundary discontinuity and identity drift.
The paper addresses the challenge of identity‑preserving video generation when a single reference portrait cannot capture the subject’s appearance across varied expressions. It introduces a compact, expression‑diverse reference gallery and a new evaluation metric that measures identity similarity for mild, intense, and extreme expressions. By extending the Stand‑In model to use these galleries and curating diverse face crops from training videos, the authors demonstrate improved identity preservation, especially for extreme expressions, on both real and synthesized reference sets.
arXiv:2607. 16760v1 Announce Type: cross Abstract: Driver monitoring systems (DMS) increasingly rely on facial cues to infer drowsiness, distraction, and cognitive load in real time.
The paper introduces MiRA, a plug‑in framework that reweights framewise attention in Vision Transformer video models to better capture subtle facial dynamics for expression recognition. MiRA computes frame‑level confidence and intra‑frame concentration from self‑attention maps, redistributing attention toward localized facial cues without adding trainable parameters. Two modes—an exact post‑softmax redistribution and a lightweight flashLite pre‑softmax approximation—are proposed, and experiments on facial expression recognition benchmarks show consistent gains over strong ViT baselines.
arXiv:2606.24232v2 Announce Type: replace Abstract: We introduce FiCA, a Feed-forward, instant Gaussian Codec Avatar generation pipeline that creates lifelike avatars from a single portrait image. Ge...
arXiv:2610.08433v1 Announce Type: new Abstract: Modern action recognition models rely on video transformers pretrained on massive collections of web-crawled videos, such as Kinetics-700. However, the...
arXiv:2609.12668v1 Announce Type: new Abstract: Recent deepfake detection studies increasingly suggest remote photoplethysmography (rPPG) signals as an authenticity cue. However, existing benchmarks...
arXiv:2604. 07282v2 Announce Type: replace-cross Abstract: Automated face recognition has made rapid strides over the past decade due to the unprecedented rise of deep neural network (DNN) models that can be trained for domain-specific tasks.
arXiv:2609.00411v1 Announce Type: new Abstract: Modern face recognition (FR) owes much of its success to deep neural networks that learn to extract compact identity embeddings from face images. These...