The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2609.22452v1 Announce Type: new Abstract: Long-context understanding remains a fundamental challenge for large language models, as excessively long inputs often lead models to forget salient in...
The paper introduces SAC‑Bench, a benchmark of 616,031 audio clips that test audio‑language models (ALMs) on how they handle conflicts between spoken claims and acoustic evidence. It covers 188 sound‑event classes across seven semantic, temporal, and spatial tasks, pairing environmental recordings with either compatible or contradictory synthesized spoken claims and including audio‑only controls. Evaluation of five open‑weight ALMs shows that high audio‑only accuracy often coexists with significant drops in performance under conflicting claims, revealing gaps in conflict robustness and the mixed effects of prompt interventions.
arXiv:2610.07338v1 Announce Type: cross Abstract: Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies. To close this gap, we intr...
AU-Harness is an open-source toolkit designed to streamline and standardize the evaluation of Audio Language Models (LALMs). It addresses three key limitations of existing frameworks: slow processing pipelines, lack of multi-turn dialogue support, and absence of a scalable, unified evaluation system. The toolkit achieves a 77% reduction in evaluation time, enabling large-scale studies and providing standardized protocols for fair model comparison and in-depth analysis of audio reasoning capabilities.
arXiv:2608.22236v2 Announce Type: replace-cross Abstract: Large audio-language models (LALMs) have shown promising progress in understanding speech, music, and general sound events, yet their ability...
arXiv:2607. 13408v1 Announce Type: cross Abstract: Recent text-to-audio models generate high-quality audio, but often fail to follow instructions involving multiple sound events and temporal order.