arXiv Machine Learning

Active noise cancellation on open-ear smart glasses

The paper introduces an active noise cancellation (ANC) system designed for open‑ear wearables such as smart glasses and VR headsets, eliminating the need for an in‑ear error microphone. Using eight microphones around the frame and a neural network to predict ear‑level noise, the system generates real‑time anti‑noise signals. In tests with eleven users and eight environments, it achieved a mean noise reduction of 9.6 dB without calibration and 11.2 dB with brief calibration, and the approach generalizes to other open‑ear devices.

arXiv Machine Learning
Oct 12

EarLog: Opportunistic Ear Physiology Sensing toward Personalized Hearing Risk Awareness

EarLog is a real‑time, embedded system that opportunistically uses headphone playback as a probe to detect the acoustic reflex (AR), an involuntary ear response indicating protective activation during high‑load listening. By employing content‑conditioned residual sensing, a resonance‑constrained sparse FIR model, and dual‑microphone observations, EarLog suppresses noise from nonstationary content, individual ear acoustics, and device variations to identify weak AR signals. In a study with 81 participants, 16 headphone models, and over 400 hours of recordings, EarLog achieved 99.0% sensitivity and 98.7% specificity against a clinically referenced benchmark, enabling continuous, listener‑specific AR monitoring during everyday listening.

By Yongzhi Huang, Jiayi Zhao, Kaishun Wu
arXiv Machine Learning
Sep 11

Single Microphone Own Voice Detection based on Simulated Transfer Functions for Hearing Aids

The paper introduces a simulation-based method for detecting a user's own voice in hearing aids using only a single microphone. It employs a data augmentation strategy with simulated acoustic transfer functions to train a transformer classifier, achieving over 90% accuracy on both simulated and real-world recordings. The approach reduces hardware complexity and power consumption while maintaining robust performance across varied spatial conditions.

By Mathuranathan Mayuravaani, W. Bastiaan Kleijn, Andrew Lensen, Charlotte S{\o}rensen
arXiv Machine Learning
Jul 13

Fine-grained Soundscape Control for Augmented Hearing

arXiv:2603. 00395v3 Announce Type: replace-cross Abstract: Hearables are becoming ubiquitous, yet their sound controls remain blunt: users can either enable global noise suppression or focus on a single target sound.

By Seunghyun Oh, Malek Itani, Aseem Gauri, Shyamnath Gollakota
arXiv Machine Learning
Oct 8

VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

VM-ARRAYDPS introduces virtual microphones with higher signal‑to‑noise ratios to augment a limited physical microphone array, providing additional multi‑channel consistency constraints for blind speech separation. By leveraging a pretrained speech diffusion model and posterior sampling, the method improves upon the existing ArrayDPS approach. Experiments on 2‑speaker and 3‑speaker datasets show significant performance gains, and ablation studies reveal the impact of virtual microphone count and consistency weighting.

By Jingqi Sun, Haozhan Tang, Shulin He, Zhong-Qiu Wang
arXiv Machine Learning
Sep 24

"What's That Sound?": A Versatile, Robust, and Lightweight Convolutional Transformer for Environment Sound Recognition

The paper introduces RALCT, a lightweight Convolutional Transformer that combines randomized audio augmentations, MFCCs, and log‑mel spectrograms to extract robust features for environmental sound recognition. With only about 310,000 parameters, RALCT achieves state‑of‑the‑art accuracy—over 93% on UrbanSound8K, peaking at 94.56%—making it suitable for deployment on mobile devices. The authors also develop a mobile app that integrates the model to provide real‑time safety alerts for hearing‑impaired users.

By Julia Huang
arXiv AI
Jun 4

The Differentiable Auditory Loop (DAL): An ML Framework for Hyper-Personalized Hearing Aids

arXiv:2606. 04103v1 Announce Type: cross Abstract: Conventional hearing aids rely on fixed, frequency-dependent amplification and compression to manage reduced sensitivity, which often fails to provide sufficient listening support in complex environments, such as situations with multiple speakers (the ``cocktail party'' problem).

By Alejandro Ballesta Rosen, Jason Mikiel-Hunter, Julian Maclaren, Jack Collins, Richard F. Lyon, Simon Carlile
arXiv Computation and Language
Sep 23

CHiME-9 ECHI: A Machine Learning Challenge for Enhancing Conversations to Address Hearing Impairment

arXiv:2609.26306v1 Announce Type: new Abstract: This work presents the task and results of the CHiME-9 challenge for Enhancing Conversations to address Hearing Impairment. The challenge considers the...

By Robert Sutherland, Thomas Kuebert, Marko Lugger, Stefan Petrausch, Eline Borch Petersen, Juan Azcarreta Ortiz, Buye Xu, Stefan Goetze, Jon Barker