arXiv Machine Learning June 30, 2026 By Arthur Josi, Emeline Got, Abdallah Dib, Luiz Gustavo Hafemann, Rafael M. O. Cruz

KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization

Read the original on arXiv Machine Learning →

arXiv:2606. 28568v1 Announce Type: cross Abstract: Speech-driven 3D facial animation methods face significant challenges in simultaneously achieving high-fidelity motion and precise artistic control at production quality.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

benchmarks

arXiv AI

Jun 6

PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation

arXiv:2503. 14295v3 Announce Type: replace-cross Abstract: Recent advancements in audio-driven talking face generation have made great progress in lip synchronization.

By Baiqin Wang, Xiangyu Zhu, Fan Shen, Hao Xu, Zhen Lei

benchmarks safety

arXiv Computer Vision

Sep 28

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

arXiv:2606.15848v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, an...

By Tingting Chen, Shaojun Wang, Huaye Zhang, Diqiong Jiang, Chenglizhao Chen

multimodal safety

arXiv AI

Jun 2

Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation

arXiv:2606. 01031v1 Announce Type: cross Abstract: Audio-driven talking-head generation has advanced rapidly, yet existing evaluation protocols mainly rely on frame-wise metrics that assume strict temporal correspondence between generated and reference videos.

By Zhicheng Zhang, Lei Wang, Yu Zhang, Yongsheng Gao

benchmarks safety

arXiv AI

Sep 16

Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splatting

arXiv:2609.17422v1 Announce Type: new Abstract: Audio-driven digital human generation plays an important role in virtual communication, immersive interaction, and media production. With the developme...

By Ziheng Yang, Yinfeng Yu, Yongming Li

arXiv AI

Aug 7

PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

arXiv:2608. 05218v1 Announce Type: new Abstract: 3D Gaussian Splatting (3DGS) enables fast, photorealistic talking-head rendering, yet accurate lip articulation remains elusive: mouth motion is often over-smoothed and may violate hard articulatory constraints such as bilabial closures, producing the notorious ``leaky mouth'' artifact.

By Ao Fu, Yi Zhou

rag multimodal safety

Hugging Face Trending Papers

Jul 1

GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting

Audio-driven talking head synthesis has achieved impressive progress in lip synchronization and visual quality, yet generating expressive emotional avatars with controllable intensity remains challenging, especially under real-time constraints. In this paper, we present GaussianEmoTalker, an audio-driven framework for real-time emotional talking head synthesis based on 3D Gaussian Splatting.

One email a morning, machine-written

Related stories

PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation

EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units

Temporally-Aligned Evaluation for Audio-Driven Talking Head Generation

Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splatting

PD-GS: Phoneme-Driven 3DGS for Audio-Driven Talking Heads

GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting