The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2609.18632v1 Announce Type: new Abstract: Multi-modal talking avatar synthesis aims to generate realistic talking videos from a reference portrait and speech. Despite rapid progress in diffusio...
arXiv:2606. 28568v1 Announce Type: cross Abstract: Speech-driven 3D facial animation methods face significant challenges in simultaneously achieving high-fidelity motion and precise artistic control at production quality.
Emo-LiveSync is a real‑time universal lip‑sync video generation framework that builds on LivePortrait and a warp‑based portrait animation model. By aligning audio signals to an implicit motion space through knowledge distillation from a pre‑trained video‑to‑motion model, it achieves high visual fidelity and lip‑sync accuracy while remaining computationally efficient. The method also introduces an expressive control gate for explicit emotion manipulation, enabling content enrichment and generalization to stylized characters beyond photo‑realistic humans.
arXiv:2609.22913v1 Announce Type: cross Abstract: Talking-head and dyadic models now achieve real-time inference, yet fast motion generation alone does not produce an interactive conversation. A live...
arXiv:2608. 05218v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) enables fast, photorealistic talking-head rendering, yet accurate lip articulation remains elusive: mouth motion is often over-smoothed and may violate hard articulatory constraints such as bilabial closures, producing the notorious ``leaky mouth'' artifact.
arXiv:2610.19290v1 Announce Type: new Abstract: We present Kandinsky S2V 1.0, an open family of speech-to-video models for controllable audio-driven human animation, comprising Kandinsky S2V 1.0 Lite...