arXiv Machine Learning June 16, 2026 By Adam Wynn, Jingyun Wang, Xiangyu Tan

Semi-Supervised Speech Confidence Detection using Pseudo-Labelling and Whisper Embeddings

Read the original on arXiv Machine Learning →

arXiv:2606. 16505v1 Announce Type: cross Abstract: Understanding speaker confidence is crucial in educational settings, as it can enhance personalised feedback and improve learning outcomes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 10

PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

arXiv:2607. 08111v1 Announce Type: cross Abstract: Training target speaker extraction (TSE) models for real conversational mixtures remains challenging because large-scale training corpora and clean target speech for supervision are unavailable.

By Wanyi Ning, Wei Zhou, Yingpeng Li, Yinshang Guo, Haitao Qian, Yiming Cheng

fine-tuning multimodal benchmarks

arXiv Computation and Language

3d ago

VOSSA: Voiceprint Optimization for Streaming Speech Architectures

arXiv:2609.38887v1 Announce Type: cross Abstract: Real-time voice conversion (VC) systems commonly rely on pretrained speaker embeddings from automatic speaker verification (ASV) models. While effect...

By Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah, Ricardo Gutierrez-Osuna

rag

arXiv AI

Jun 18

Speaker Verification with Speech-Aware LLMs: Evaluation and Augmentation

arXiv:2603. 10827v2 Announce Type: replace-cross Abstract: Speech-aware large language models (LLMs) can accept speech inputs, yet their training objectives largely emphasize linguistic content or specific fields such as emotions or the speaker's gender, leaving it unclear whether they encode speaker identity.

By Thomas Thebaud, Yuzhe Wang, Laureano Moro-Velazquez, Jesus Villalba-Lopez, Najim Dehak

llms rag fine-tuning benchmarks

arXiv AI

Jul 17

RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems

arXiv:2607. 14846v1 Announce Type: cross Abstract: Current voice AI benchmarks typically evaluate isolated capabilities such as speech intelligibility, word error rate, or text-based dialogue quality, but they rarely test whether systems harness the acoustic information that distinguishes spoken language from its textual representation.

By David Ayllon, Alice Baird, Jeffrey Brooks, Franc Camps-Febrer, Jakub Piotr C{\l}apa, Theo Lebryk, Jens Madsen, Olya Ossipova, Sharath Rao, Hoon Shin, Tigran Soghbatyan, Georg Streich, Rashish Tandon, Panagiotis Tzirakis

agents multimodal benchmarks

arXiv Machine Learning

Jul 2

Automatic Detection of Stress from Speech in the Trier Social Stress Test

arXiv:2607. 00986v1 Announce Type: new Abstract: Automatically detecting stress in speech provides an unobtrusive way to gain insights relevant to behavioral research or clinical assessment.

By Hanna Drimalla, Wieland R. Cremer, Christine Kraus, Oliver T. Wolf

arXiv Machine Learning

Aug 31

Rethinking Speaker Embeddings for Speech Generation: Sub-Center Modeling for Capturing Intra-Speaker Diversity

arXiv:2407.04291v4 Announce Type: replace-cross Abstract: Modeling speech variation is key to natural, expressive generation. Speaker embeddings are commonly used to condition personalized speech sys...

By Ismail Rasim Ulgen, John H. L. Hansen, Carlos Busso, Berrak Sisman

rag

One email a morning, machine-written

Related stories

PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

VOSSA: Voiceprint Optimization for Streaming Speech Architectures

Speaker Verification with Speech-Aware LLMs: Evaluation and Augmentation

RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems

Automatic Detection of Stress from Speech in the Trier Social Stress Test

Rethinking Speaker Embeddings for Speech Generation: Sub-Center Modeling for Capturing Intra-Speaker Diversity