arXiv Computation and Language By Liwei Liu, Jun Tao, Xingyuan Li, Xuenan Xu, Chen Zhang, Junyi Wang, Boya Zhang, Xiaoyu Yang, Zhen-Hua Ling, Wen Wu, Chao Zhang

Machine Hearing: Can Audio LLMs Generalize Beyond Human Auditory Perception?

Read the original on arXiv Computation and Language →

The paper introduces the Machine Hearing Benchmark (MHB), a dataset of 6,128 instances covering 13 tasks across seven domains with diverse audio regimes, from extremely low to high sampling rates and varying sequence lengths. Evaluations show that existing Audio LLMs have limited zero‑shot transfer to these machine‑hearing tasks, and supervised adaptation alone does not close the performance gap, indicating a mismatch between current audio front ends and machine‑hearing inputs. To bridge this gap, the authors propose MachEar, a lightweight encoder extension that enhances a pretrained Audio LLM’s machine‑hearing capabilities while largely preserving its original audio understanding performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Aug 10

MetaSICL: Globalizing Auditory LLMs for Underserved Speakers and Languages via Meta Speech In-Context Learning

arXiv:2601. 18904v3 Announce Type: replace-cross Abstract: Generative AI for speech and audio is increasingly expected to serve users across languages, cultures, and communities, yet current auditory Large Language Models (LLMs) are still largely trained and evaluated on high-resource data.

By Haolong Zheng, Siyin Wang, Zengrui Jin, Mark Hasegawa-Johnson
arXiv Computation and Language
Sep 24

Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding

Mizar is a 159.3‑million‑parameter audio‑language model designed for devices with limited memory and computation. It couples a compact CED‑Small audio encoder with SmolLM2‑135M via a frequency‑merging mapper and is trained in three stages—audio‑language alignment, audio‑dependent fine‑tuning, and post‑training—to improve performance on audio‑question tasks. Across five random seeds, Mizar outperforms all other sub‑200M‑parameter ALMs on MMAU, MMAR, and ADQA‑clean, achieving mean accuracies of 52.92%, 42.42%, and 36.02% respectively, while enabling local inference on a single CPU with an average latency of 1.09 seconds for MMAU questions.

By Kaiyang Li, Shaobo Han, Yue Tian, Shihao Ji