arXiv AI By Yunuo Wang, Maoyuan Chen, Yuanjin Huang, Xing Liu

Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence

Read the original on arXiv AI →

arXiv:2610. 37605v1 Announce Type: cross Abstract: For audio-language models, an answer change after a local sound-event edit can reflect a response to the event's class, sensitivity to waveform rewriting, or both.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Oct 27

Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence

The paper investigates how audio-language models react to local sound‑event edits by comparing matched same‑class and different‑class replacements. Using consistent editing parameters across 600 synthetic soundscapes and three models, the study finds that different‑class replacements cause 49.7 to 60.9 percentage points more answer changes, while same‑class replacements keep accuracy within 5.2 percentage points of the original. Soundscape‑weighted selective accuracy for the inserted class ranges from 73.7 to 81.9%.

arXiv AI
3d ago

Right Answers, Inconsistent Evidence: Source-Level Counterfactual Auditing of Large Audio-Language Models

The paper introduces TRACE, a method for auditing large audio‑language models (LALMs) by deleting the queried source and each rival sound in turn to test whether views containing the target sound consistently score higher than those without it. Across 8 LALMs and 3,456 controlled mixtures, 6.3% of correct answers fail this ordering, a failure that a simple target‑only score check misses 42.5% of the time. The failure rate rises from 4.9% to 8.4% as the target signal‑to‑noise ratio drops from +5 to –5 dB, and the issue persists even under loudness and re‑pairing controls.

By Yi Zhang, Yi Li, Hongwei Du
arXiv Computation and Language
Nov 4

One Waveform, Two Stories: Benchmarking Speech-Acoustic Conflict in Audio-Language Models

The paper introduces SAC‑Bench, a benchmark of 616,031 audio clips that test audio‑language models (ALMs) on how they handle conflicts between spoken claims and acoustic evidence. It covers 188 sound‑event classes across seven semantic, temporal, and spatial tasks, pairing environmental recordings with either compatible or contradictory synthesized spoken claims and including audio‑only controls. Evaluation of five open‑weight ALMs shows that high audio‑only accuracy often coexists with significant drops in performance under conflicting claims, revealing gaps in conflict robustness and the mixed effects of prompt interventions.

By Wenbin Wang, Yuheng Li, Koichiro Yoshino
arXiv Computation and Language
Aug 31

Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation

The paper investigates how to evaluate audio‑language models by separating the use of acoustic evidence from the need to invoke a generative audio model. Using a controlled call‑decision framework, the authors compare policies that rely on transcript labels, encoder outputs from CLAP, AST, or WavLM, and optional calls to generative models such as Qwen2‑Audio, Qwen2.5‑Omni, or MOSS‑Audio. Results on the VocalSound dataset show that while transcript‑only accuracy is low (0.296), encoder‑only controls achieve high accuracy (≈0.85) without any generative calls, and adding generative calls yields only a marginal improvement (0.925 vs. 0.921).

By Mengzhe Geng
arXiv Machine Learning
Oct 3

AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models

AnchorPrompt is an adaptation technique for large audio‑language models that keeps the base model frozen and learns a single block of prompt vectors inserted at the decoder input. By training these prompts through self‑distillation on diverse audio and text perturbations, the method improves answer consistency and reduces hallucinations across multiple benchmarks. The approach is perturbation‑agnostic at inference, enabling zero‑shot transfer to unseen distortions such as reverberation and choice permutations.

By Pooneh Mousavi, Amir Ivry, Mirco Ravanelli, Cem Subakan