A large audio-language model (LALM) can answer "is a cat present?" about a mixture correctly, and its confidence can drop when the cat is removed, yet this does not show that it can tell the cat's pre...
The paper investigates how large audio‑language models (LALMs) hallucinate objects by affirming sounds that are not present. Using a black‑box causal test, the authors isolate and remove the claimed evidence region via spectral gating and compare the effect against a random‑window control across a 2×2×2 grid on three LALMs. The study finds that localization of evidence improves detection over random removal, that raw detection values are model‑dependent, and that contrastive decoding combining blank and language‑prior contrasts can significantly boost accuracy, but a unified causal‑grounding profile does not transfer between models.
By Mohammad Khalooei, Mohammad Sabokrou
arXiv:2609.30483v1 Announce Type: cross
Abstract: Audio language models state numbers for acoustic quantities, and neither human opinion nor a judge model says whether such a number is true of the si...
By Sheng-Tse Lin, Siyuan Zhai, Chien-Liang Kuo, Massa Baali, Bhiksha Raj
arXiv:2610. 37605v1 Announce Type: cross Abstract: For audio-language models, an answer change after a local sound-event edit can reflect a response to the event's class, sensitivity to waveform rewriting, or both.
By Yunuo Wang, Maoyuan Chen, Yuanjin Huang, Xing Liu
The paper investigates how large audio‑language models (LALMs) hallucinate objects by affirming sounds that are not present. Using a black‑box causal test, the authors isolate evidence regions via CLAP similarity, remove them with spectral gating, and compare against random windows across a 2×2×2 grid on three LALMs. The study finds that evidence localization improves detection over random removal, that raw detection scores are model‑dependent, and that a contrastive decoding strategy combining blank and language‑prior cues boosts Qwen2‑Audio accuracy from 57.1 % to 71.9 %, outperforming Audio‑Aware Decoding alone.
The paper investigates how audio-language models react to local sound‑event edits by comparing matched same‑class and different‑class replacements. Using consistent editing parameters across 600 synthetic soundscapes and three models, the study finds that different‑class replacements cause 49.7 to 60.9 percentage points more answer changes, while same‑class replacements keep accuracy within 5.2 percentage points of the original. Soundscape‑weighted selective accuracy for the inserted class ranges from 73.7 to 81.9%.