EvoAudio: Recursive Self-Improvement for Audio Understanding
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The paper introduces TORUS, a closed‑loop benchmark designed to evaluate unified audio models on their ability to understand the audio they generate or edit. TORUS contains 1,053 questions across 21 tasks and 8 audio domain settings, covering all three audio types. The authors evaluate both unified models and cascades of specialized models, finding that the best unified models answer only about 52.4% of questions about their own outputs, while GPT‑Audio achieves 53.6%.
Audio-R1 is a reinforcement learning post‑training framework that leverages audio self‑supervised learning tasks to provide verifiable rewards for large audio‑language models. By automatically determining answers during task construction, Audio‑R1 verifies model responses and computes rewards, leading to consistent performance gains across multiple models and audio benchmarks. Ablation studies show each self‑supervised task contributes to the improvement, and joint training yields additional benefits, especially on downstream tasks distinct from the training tasks.
arXiv:2603. 09714v2 Announce Type: replace-cross Abstract: While multi-audio understanding is critical for large audio-language models (LALMs), it remains underexplored.
AdaLoop is a lightweight recurrent module that adaptively determines how many latent refinement steps are needed for audio–question pairs, allowing deeper reasoning only when necessary. It shares a transformer block that iterates over the audio representation guided by the question, with a learned halting mechanism that exits the loop once the representation is ready. Adding fewer than 3 % of the base model’s parameters, AdaLoop improves average accuracy by 2.9 to 3.8 points across three distinct models, especially on perception-heavy subtasks.
The paper introduces a symbiotic architecture that equips large language models with audio‑understanding abilities without fine‑tuning their weights. It uses an injector module to write audio‑conditioned vectors into the LLM’s key‑value cache, allowing the model to act as an audio language model while keeping the backbone unchanged. The approach improves scalability—since injection cost depends on the injector width—and preserves the LLM’s original text performance, outperforming conventional frozen‑LLM methods and approaching fine‑tuned ALM results on audio tasks.
arXiv:2606. 15141v1 Announce Type: cross Abstract: While LALMs show promise on audio question answering, they fail to focus on question-relevant segments of audio and provide a clear, checkable reasoning process when dealing with complex audio reasoning.