arXiv AI

Semi-Supervised Sound Event Detection with Conditional Mixup and Embedding-Level Contrastive Loss

arXiv:2606. 29901v1 Announce Type: cross Abstract: Sound event detection (SED) is a core module for acoustic environmental analysis, yet its performance is often limited by scarce labeled data.

arXiv AI

Aug 21

Listening Forward: Next Patch Embedding Prediction Enables Scalable Audio Learners

arXiv:2608. 19863v1 Announce Type: cross Abstract: Self-supervised learning (SSL) has driven substantial progress in audio representation learning, though existing methods have increasingly relied on elaborate pre-training recipes to reach competitive performance.

By Umberto Cappellazzo, Xubo Liu, Stavros Petridis, Maja Pantic

llms rag fine-tuning benchmarks

arXiv Machine Learning

Sep 15

MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training

arXiv:2609.15221v1 Announce Type: cross Abstract: Passive acoustic monitoring can measure biodiversity at larger scales, but time--frequency annotation of animal vocalizations is expensive, site-spec...

By Tianyi Xu, Daniel Pimentel-Alarc\'on, Zuzana Bu\v{r}ivalov\'a, Claudia Sol\'is-Lemus

arXiv AI

Jul 21

RealDESED: A Real-World Domestic Sound Event Detection Benchmark

arXiv:2607. 16736v1 Announce Type: cross Abstract: This paper presents RealDESED, a real-world domestic sound event detection (SED) benchmark comprising 5,710 audio recordings collected by 652 participants in their homes.

By Florian Schmid, Paul Primus, Alexander Fichtinger, Tara Jadidi, Tobias Morocutti, Gerhard Widmer

llms benchmarks

arXiv AI

Jul 7

Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Grounding

arXiv:2607. 04383v1 Announce Type: cross Abstract: Large Audio-Language Models (LALMs) reason fluently about sound yet struggle to localize precisely when events occur, while classical Sound Event Detection attains frame-level precision only over a closed label set.

By Zihan Zhang, Xize Cheng, Wenhao Yan, Tong Zhang, Dongjie Fu, Boyun Zhang, Yongbo He, Tao Jin

llms reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 21

SONAR: Spectral-Contrastive Audio Residuals for Generalizable Deepfake Detection

arXiv:2511. 21325v2 Announce Type: replace-cross Abstract: Deepfake (DF) audio detectors still struggle to generalize to out of distribution inputs.

By Ido Nitzan Hidekel, Gal lifshitz, Khen Cohen, Dan Raviv

rag diffusion benchmarks safety

arXiv Machine Learning

Aug 17

Trajectory Dynamics in Self-Supervised Learning Latent Space for Audio Deepfake Detection

arXiv:2608. 13817v1 Announce Type: cross Abstract: Human speech production is constrained by physiology, giving rise to characteristic temporal structure on acoustic signals.

By Tom\'as Andrade Weber

diffusion benchmarks

arXiv AI

Jun 16

Dual-Granularity Orthogonal Disentanglement for Generalizable Audio Deepfake Detection

arXiv:2606. 16532v1 Announce Type: cross Abstract: Audio deepfake detectors often fail to generalize across speakers, as they learn speaker-identity features rather than synthesis artifacts, known as implicit identity leakage.

By Zhuodong Liu, Hugen Lv, Xiangyu Li, Chunhong Yuan

rag safety

arXiv AI

Jun 4

SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classification

arXiv:2605. 13672v1 Announce Type: cross Abstract: Few-shot classification (FSC) is widely used for learning from limited labeled data, yet most evaluations implicitly assume that target concepts are independent of contextual cues.

By Giries Abu Ayoub, Morad Tukan, Loay Mualem

computer-vision benchmarks

arXiv AI

Jul 1

BEST-RQ-2: Contextualize-Then-Predict, a Two-Step Approach for Self-Supervised Audio Representations

arXiv:2606. 30700v1 Announce Type: cross Abstract: Self-supervised learning enables audio representations that transfer across domains and tasks.

By Ludovic K. Tuncay (IRIT-SAMoVA), Etienne Labb\'e (IRIT-SAMoVA), Thomas Pellegrini (IRIT-SAMoVA)

llms benchmarks

arXiv AI

Sep 23

Bearings: Self-Supervised Soundfield Embeddings from First-Order Ambisonics

arXiv:2609.23152v1 Announce Type: cross Abstract: Recently proposed self-supervised audio encoders learn powerful general-purpose representations of sound scenes, yet they are spatially blind. To sup...

By Goksenin Yuksel, Marcel van Gerven, Kiki van der Heijden

rag

arXiv AI

Jul 10

PS4: Proxy-Supervised Joint Training for Real Target Speaker Extraction

arXiv:2607. 08111v1 Announce Type: cross Abstract: Training target speaker extraction (TSE) models for real conversational mixtures remains challenging because large-scale training corpora and clean target speech for supervision are unavailable.

By Wanyi Ning, Wei Zhou, Yingpeng Li, Yinshang Guo, Haitao Qian, Yiming Cheng

fine-tuning multimodal benchmarks

arXiv Computer Vision

Sep 1

Acoustically Grounded Cost Learning for Open-Vocabulary Audio-Visual Semantic Segmentation

arXiv:2608.29121v1 Announce Type: new Abstract: Open-Vocabulary Audio-Visual Semantic Segmentation (OV-AVSS) aims to perform pixel-level segmentation of sound-emitting objects from an open set of cat...

By Tianrui Hui, Shaofei Huang, Qisong Han, Yaxiong Wang, Lechao Cheng, Zhedong Zheng, Zhun Zhong, Richang Hong, Meng Wang

computer-vision multimodal benchmarks

Related stories