arXiv AI August 7, 2026 By Ao Fu, Yi Zhou

PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

arXiv:2608. 05218v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) enables fast, photorealistic talking-head rendering, yet accurate lip articulation remains elusive: mouth motion is often over-smoothed and may violate hard articulatory constraints such as bilabial closures, producing the notorious ``leaky mouth'' artifact.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision

6d ago

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

arXiv:2606.15848v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, an...

By Tingting Chen, Shaojun Wang, Huaye Zhang, Diqiong Jiang, Chenglizhao Chen

multimodal safety

arXiv AI

Sep 16

Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splatting

arXiv:2609.17422v1 Announce Type: new Abstract: Audio-driven digital human generation plays an important role in virtual communication, immersive interaction, and media production. With the developme...

By Ziheng Yang, Yinfeng Yu, Yongming Li

arXiv Machine Learning

5d ago

Seeing Speech: Learning Visible Articulatory Dynamics for Speech-Driven 3D Facial Animation

The paper introduces a new framework for speech‑driven 3D facial animation that explicitly models visible articulatory dynamics. It uses a Speech‑Articulatory Memory (SAM) to link speech to three directional articulatory motions—spreading, opening, and protrusion—under phonetic context, and a Topology‑aware Articulatory Composition (TAC) to integrate these motions into surface‑consistent facial motion. Experiments on VOCASET and TFHP demonstrate state‑of‑the‑art reconstruction quality and improved lip articulation metrics, with a user study confirming better lip sync and realism.

By Hyung Kyu Kim, Byungchan Hwang, Hak Gu Kim

benchmarks

arXiv Machine Learning

Jun 30

KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization

arXiv:2606. 28568v1 Announce Type: cross Abstract: Speech-driven 3D facial animation methods face significant challenges in simultaneously achieving high-fidelity motion and precise artistic control at production quality.

By Arthur Josi, Emeline Got, Abdallah Dib, Luiz Gustavo Hafemann, Rafael M. O. Cruz

benchmarks

Hugging Face Trending Papers

Jul 1

GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting

Audio-driven talking head synthesis has achieved impressive progress in lip synchronization and visual quality, yet generating expressive emotional avatars with controllable intensity remains challenging, especially under real-time constraints. In this paper, we present GaussianEmoTalker, an audio-driven framework for real-time emotional talking head synthesis based on 3D Gaussian Splatting.

arXiv Computer Vision

Sep 4

EmbedTalk: Talking Head Synthesis using Gaussian Embeddings

EmbedTalk introduces per‑Gaussian embeddings to drive speech‑driven facial deformations in real‑time talking head synthesis, replacing traditional tri‑plane encodings. This approach improves rendering quality, lip synchronisation, and motion consistency compared to prior 3D Gaussian Splatting methods while producing more compact models that run at 60+ FPS on a laptop GPU. The technique demonstrates competitive performance against state‑of‑the‑art generative models.

By Arpita Saggar, Jonathan C. Darling, Duygu Sarikaya, David C. Hogg

rag benchmarks