arXiv AI
Thinking in Depth, Speaking Directly: Recurrent Latent Reasoning for Paralinguistically Grounded Spoken Dialogue
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 28
When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue
The paper introduces ContraTalk, a benchmark that tests whether dialogue models truly use acoustic cues or rely on transcript shortcuts. It formalizes cross‑modal disagreement, creates conflict and consistent QA examples, and proposes an Audio Twin representation to expose acoustic evidence to models. Experiments show that while text‑only LLMs perform well on consistent cases, they falter on conflict cases, and AudioLLMs only partially mitigate this issue.
arXiv Computation and Language
Sep 11
RetroThinker: Enabling Retrospective Thinking in Speech LLMs
RetroThinker is a multi-stage post‑training framework that enhances SpeechLLMs by enabling them to self‑verify and forward‑correct Chain‑of‑Thought reasoning steps during inference. It combines supervised fine‑tuning on curated retrospective thinking data with length‑based direct preference optimization to improve reasoning while the user speaks. On the GSM8K benchmark, RetroThinker achieves an 11% absolute accuracy gain over non‑retrospective baselines while maintaining comparable latency.
arXiv Computation and Language
Sep 1
Learning to Reason and Use Tools through Unsupervised Fine-Tuning in Task-Oriented Dialog Systems
arXiv:2608.30426v1 Announce Type: new Abstract: Current dialogue systems struggle with dynamic information retrieval, often leading to hallucinations and lower response accuracy. We address this by a...
arXiv AI
Sep 23
Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
arXiv:2609.23589v1 Announce Type: cross Abstract: Large audio-language models (LALMs) are increasingly used for a broader range of audio reasoning tasks. These models typically incorporate audio repr...
arXiv Machine Learning
Jul 24
X$^3$-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
arXiv:2607. 21550v1 Announce Type: new Abstract: While large audio-language models have achieved remarkable progress in auditory perception, they still lag behind text-based large language models in deep logical reasoning, primarily due to the scarcity of high-quality audio reasoning data.
arXiv Computation and Language
Sep 18
LaSR: Context-Aware Speech Recognition via Latent Reasoning
LaSR (Latent Speech Reasoning) is a new training paradigm for context‑aware speech recognition that uses a latent reasoning trajectory instead of explicit intermediate tokens. It aligns chain‑of‑thought supervision around the acoustic region of target words and introduces latent reasoning periods for grounding context and guiding transcription transitions. Experiments on Fun‑Audio‑Chat show that LaSR improves terminology recognition without added latency and outperforms standard fine‑tuning baselines, demonstrating the promise of latent reasoning for efficient, context‑aware speech assistants.