arXiv AI
Sep 23

When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning

arXiv:2603.02266v2 Announce Type: replace-cross Abstract: Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-La...

By Ruixiang Mao, Xiangnan Ma, Dan Chen, Ziming Zhu, Yuan Ge, Aokai Hao, Haishu Zhao, Yifu Huo, Qing Yang, Kaiyan Chang, Xiaoqian Liu, Chenglong Wang, Qiaozhi He, Tong Xiao, Jingbo Zhu
arXiv AI
Sep 7

Tracing Audio Grounding and Answer Selection in Audio LLMs

The paper investigates how Audio Large Language Models (Audio LLMs) actually use audio input to determine answers, rather than relying on textual cues. It finds that replacing audio with silence or unrelated audio degrades performance more after training than before, that acoustic information shapes representations in early-to-middle layers and influences final predictions in middle-to-late layers, and that training impacts specific layer bands most strongly. These observations offer a mechanistic view of how training enhances the use of acoustic evidence in Audio LLMs.

By Hyebin Cho, Suho Yoo, Jihoo Jung, Joon Son Chung
arXiv AI
Oct 27

Audio-R1: Audio Reasoning through Reinforcement Learning on Self-Supervised Tasks

Audio-R1 is a reinforcement learning post‑training framework that leverages audio self‑supervised learning tasks to provide verifiable rewards for large audio‑language models. By automatically determining answers during task construction, Audio‑R1 verifies model responses and computes rewards, leading to consistent performance gains across multiple models and audio benchmarks. Ablation studies show each self‑supervised task contributes to the improvement, and joint training yields additional benefits, especially on downstream tasks distinct from the training tasks.

By Jihoon Jeong, Mirco Ravanelli, Zhepei Wang, Cem Subakan