arXiv Machine Learning June 30, 2026 By Karl El Hajal, Mathew Magimai. -Doss

OLIVE: View-Augmented Latent Prediction with Waveform Reconstruction for Speech SSL

Read the original on arXiv Machine Learning →

arXiv:2606. 30356v1 Announce Type: cross Abstract: We propose Online Latent prediction with Invariant Views and rEconstruction (OLIVE), a self-supervised speech representation learning framework that jointly optimizes analysis and synthesis objectives.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 6

F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

arXiv:2606. 06357v1 Announce Type: cross Abstract: Continuous audio autoencoders reconstruct waveforms well but often produce latents with weak structure for understanding, while self-supervised audio encoders capture semantics but are not directly decodable.

By Dinghao Zhou, Xingchen Song, Di Wu, Pengyu Cheng, Shengfan Shen, Sixiang Lv

llms nlp

arXiv AI

Aug 5

GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement

arXiv:2604. 01832v1 Announce Type: cross Abstract: We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge.

By Xiaobin Rong, Yushi Wang, Zheng Wang, Jing Lu

arXiv Machine Learning

Jun 16

From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation

arXiv:2606. 14791v1 Announce Type: cross Abstract: Self-supervised learning advances audio representation for multimedia analysis.

By Fengrui Liu, Ruiyang Huang, Qijian Zheng, Yuanfang Wang, Feng Liu

llms diffusion benchmarks safety

arXiv AI

Jul 2

Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis

arXiv:2607. 00363v1 Announce Type: cross Abstract: Flow Matching (FM) has emerged as a powerful paradigm for speech generation but remains constrained by high inference latency and timbre leakage.

By Zuda Yu, Qianhui Xu, Ting Chen, Junhui Zhang, Tao Fu, Hongjiang Yu, Qiangqing Wang, Yang Song

diffusion efficiency benchmarks

arXiv Machine Learning

Jun 29

Elastic Time: Dynamic Frame Rate Bottlenecks for Neural Audio Coding

arXiv:2606. 27320v1 Announce Type: cross Abstract: Neural audio autoencoders have become a core component of compression, feature extraction, and generation.

By Dimitrios Bralios, Paris Smaragdis, Minje Kim

arXiv AI

Jul 1

BEST-RQ-2: Contextualize-Then-Predict, a Two-Step Approach for Self-Supervised Audio Representations

arXiv:2606. 30700v1 Announce Type: cross Abstract: Self-supervised learning enables audio representations that transfer across domains and tasks.

By Ludovic K. Tuncay (IRIT-SAMoVA), Etienne Labb\'e (IRIT-SAMoVA), Thomas Pellegrini (IRIT-SAMoVA)

llms benchmarks

Related stories

F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement

From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation

Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis

Elastic Time: Dynamic Frame Rate Bottlenecks for Neural Audio Coding

BEST-RQ-2: Contextualize-Then-Predict, a Two-Step Approach for Self-Supervised Audio Representations