arXiv AI
Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 18
Investigating Faithfulness in Large Audio Language Models
arXiv:2509. 22363v4 Announce Type: replace Abstract: Large Audio Language Models (LALMs) integrate audio encoders with pretrained Large Language Models to perform complex multimodal reasoning tasks.
arXiv AI
Oct 26
AU-Harness: An Open-Source Toolkit for Efficient and Unified Evaluation of AUdio-LLMs
AU-Harness is an open-source toolkit designed to streamline and standardize the evaluation of Audio Language Models (LALMs). It addresses three key limitations of existing frameworks: slow processing pipelines, lack of multi-turn dialogue support, and absence of a scalable, unified evaluation system. The toolkit achieves a 77% reduction in evaluation time, enabling large-scale studies and providing standardized protocols for fair model comparison and in-depth analysis of audio reasoning capabilities.
arXiv Machine Learning
Oct 7
AdaLoop: Adaptive-Depth Latent Reasoning for Audio Language Models
AdaLoop is a lightweight recurrent module that adaptively determines how many latent refinement steps are needed for audio–question pairs, allowing deeper reasoning only when necessary. It shares a transformer block that iterates over the audio representation guided by the question, with a learned halting mechanism that exits the loop once the representation is ready. Adding fewer than 3 % of the base model’s parameters, AdaLoop improves average accuracy by 2.9 to 3.8 points across three distinct models, especially on perception-heavy subtasks.
arXiv AI
Oct 1
UniAE-MoE: A Unified Audio Encoder via Mixture of Experts
UniAE-MoE is a unified audio encoder that uses a Mixture-of-Experts architecture to model cross‑domain audio representations. It integrates encoder components from Qwen2‑Audio and Audio‑Flamingo 3, enhances them with SwiGLU and shared experts, and applies a two‑stage instruction‑tuning strategy along with task‑specific data scaling. The model achieves state‑of‑the‑art results on the XARES‑LLM benchmark (0.802) and tops the Interspeech 2026 Audio Encoder Capability Challenge, demonstrating strong generalization across speech, music, and general audio tasks.
arXiv Computation and Language
Oct 23
TORUS: A Unified Closed-Loop Benchmark for Unified Audio Models
The paper introduces TORUS, a closed‑loop benchmark designed to evaluate unified audio models on their ability to understand the audio they generate or edit. TORUS contains 1,053 questions across 21 tasks and 8 audio domain settings, covering all three audio types. The authors evaluate both unified models and cascades of specialized models, finding that the best unified models answer only about 52.4% of questions about their own outputs, while GPT‑Audio achieves 53.6%.
arXiv AI
Sep 23
Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
arXiv:2609.23589v1 Announce Type: cross Abstract: Large audio-language models (LALMs) are increasingly used for a broader range of audio reasoning tasks. These models typically incorporate audio repr...