arXiv Machine Learning

EarLog: Opportunistic Ear Physiology Sensing toward Personalized Hearing Risk Awareness

EarLog is a real‑time, embedded system that opportunistically uses headphone playback as a probe to detect the acoustic reflex (AR), an involuntary ear response indicating protective activation during high‑load listening. By employing content‑conditioned residual sensing, a resonance‑constrained sparse FIR model, and dual‑microphone observations, EarLog suppresses noise from nonstationary content, individual ear acoustics, and device variations to identify weak AR signals. In a study with 81 participants, 16 headphone models, and over 400 hours of recordings, EarLog achieved 99.0% sensitivity and 98.7% specificity against a clinically referenced benchmark, enabling continuous, listener‑specific AR monitoring during everyday listening.

arXiv Machine Learning
Sep 11

Active noise cancellation on open-ear smart glasses

The paper introduces an active noise cancellation (ANC) system designed for open‑ear wearables such as smart glasses and VR headsets, eliminating the need for an in‑ear error microphone. Using eight microphones around the frame and a neural network to predict ear‑level noise, the system generates real‑time anti‑noise signals. In tests with eleven users and eight environments, it achieved a mean noise reduction of 9.6 dB without calibration and 11.2 dB with brief calibration, and the approach generalizes to other open‑ear devices.

By Kuang Yuan, Freddy Yifei Liu, Tong Xiao, Yiwen Song, Chengyi Shen, Saksham Bhutani, Justin Chan, Swarun Kumar
arXiv AI
Sep 25

When Temporal Perturbations Act Like Sensor Biases: Label-Free Auditing of Wearable Activity Recognizers

The paper introduces SpectrumAudit, a label‑sealed auditing method for wearable human‑activity recognition models that uses phase‑randomized full‑window stimuli to probe sensor biases. By replaying the DC component and a zero‑mean residual on held‑out subjects, the audit demonstrates significant accuracy drops across 27 victim models, with DC perturbations proving more harmful than AC in most cases. The study also shows that the audit can distinguish between persistent sensor offsets and zero‑mean variations under a fixed peak‑budget.

By Qingyu Wu, Yuan Wei, Renju Liu, Hua Cheng
arXiv AI
Jun 4

The Differentiable Auditory Loop (DAL): An ML Framework for Hyper-Personalized Hearing Aids

arXiv:2606. 04103v1 Announce Type: cross Abstract: Conventional hearing aids rely on fixed, frequency-dependent amplification and compression to manage reduced sensitivity, which often fails to provide sufficient listening support in complex environments, such as situations with multiple speakers (the ``cocktail party'' problem).

By Alejandro Ballesta Rosen, Jason Mikiel-Hunter, Julian Maclaren, Jack Collins, Richard F. Lyon, Simon Carlile
arXiv Machine Learning
Oct 23

CoarseSoundNet: Building a reliable model for ecological soundscape analysis

CoarseSoundNet is a deep learning framework designed to classify ecological soundscapes into biophony, geophony, and anthropophony under realistic passive acoustic monitoring conditions. The study systematically explores model architectures, training data composition, and evaluation strategies, finding that adding more domain‑similar data, a silence class, and post‑hoc calibration improves performance. An ecological case study shows that pre‑filtering recordings with CoarseSoundNet produces acoustic index trends similar to ground‑truth filtering, though the impact on avian alpha‑diversity relationships is modest.

By Alexander Gebhard, Andreas Triantafyllopoulos, Dominik Arend, Sandra M\"uller, Svenja Schmidt, Michael Scherer-Lorenzen, Bj\"orn W. Schuller
arXiv Machine Learning
Sep 11

Single Microphone Own Voice Detection based on Simulated Transfer Functions for Hearing Aids

The paper introduces a simulation-based method for detecting a user's own voice in hearing aids using only a single microphone. It employs a data augmentation strategy with simulated acoustic transfer functions to train a transformer classifier, achieving over 90% accuracy on both simulated and real-world recordings. The approach reduces hardware complexity and power consumption while maintaining robust performance across varied spatial conditions.

By Mathuranathan Mayuravaani, W. Bastiaan Kleijn, Andrew Lensen, Charlotte S{\o}rensen
arXiv Machine Learning
Oct 3

NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching

The paper introduces NEUROTOKEN, a unified neural network for auditory attention decoding (AAD) that jointly predicts the attended speaker’s direction and source by modeling the conditional likelihood of the attended envelope given EEG. It employs a conditional flow‑matching head (ATTUNEFLOW) and two inference‑time ensembles (QUADTRACK and ENV‑FLOW) to improve source‑AAD accuracy and reduce variance across subjects. Experiments on KU Leuven, DTU, and NJU datasets show significant gains over existing baselines and reveal that prior direction‑AAD results overestimate performance under stricter protocols.

By Ali Alavi, Donald S. Williamson
arXiv Computation and Language
4d ago

One Waveform, Two Stories: Benchmarking Speech-Acoustic Conflict in Audio-Language Models

The paper introduces SAC‑Bench, a benchmark of 616,031 audio clips that test audio‑language models (ALMs) on how they handle conflicts between spoken claims and acoustic evidence. It covers 188 sound‑event classes across seven semantic, temporal, and spatial tasks, pairing environmental recordings with either compatible or contradictory synthesized spoken claims and including audio‑only controls. Evaluation of five open‑weight ALMs shows that high audio‑only accuracy often coexists with significant drops in performance under conflicting claims, revealing gaps in conflict robustness and the mixed effects of prompt interventions.

By Wenbin Wang, Yuheng Li, Koichiro Yoshino
arXiv AI
Oct 2

Multi-Party Backchannel Prediction: a Diagnosis, a Benchmark, and a Ceiling

The paper introduces a multi‑party backchannel prediction benchmark built from the AMI meeting corpus, featuring 682 masked‑listener views, 190 speakers, and 18,697 backchannel events. A state‑of‑the‑art dyadic model performs at chance when applied zero‑shot to meetings, but its frozen acoustic features are still informative, and retraining improves performance to an AUROC of 0.751. The study reveals that listener conditioning helps only for listeners seen during training, that speaker identity is entangled with useful cues, and that backchannel rates vary significantly across individuals, prompting the authors to report both AUROC and event‑F1 metrics. whyItMatters":"The benchmark and evaluation tools provide a standardized, person‑disjoint testbed for advancing multi‑party backchannel prediction research."

By Mohammed Hafsati, Ahmed Loughzali
arXiv Machine Learning
Sep 24

"What's That Sound?": A Versatile, Robust, and Lightweight Convolutional Transformer for Environment Sound Recognition

The paper introduces RALCT, a lightweight Convolutional Transformer that combines randomized audio augmentations, MFCCs, and log‑mel spectrograms to extract robust features for environmental sound recognition. With only about 310,000 parameters, RALCT achieves state‑of‑the‑art accuracy—over 93% on UrbanSound8K, peaking at 94.56%—making it suitable for deployment on mobile devices. The authors also develop a mobile app that integrates the model to provide real‑time safety alerts for hearing‑impaired users.

By Julia Huang