arXiv:2609.26488v1 Announce Type: new
Abstract: While Chain-of-Thought (CoT) reasoning has improved the capability of language models, directly applying it to Spoken Language Models (SLMs) may introd...
By Junyi Ao, Kainan Peng, Mingbo Ma, Shun Zhang, Zhenyu Tang, Xutai Ma, Xiang Li, Yinghao Li, Yuancheng Wang, Zhizheng Wu, Haizhou Li, Qing He, Xubo Liu
arXiv:2609.17010v1 Announce Type: new
Abstract: Lifelong conversational agents rely on memory systems to maintain deep, context-aware interactions with users. However, existing explicit textual memor...
By Cai Ke, Xin Liu, Han Zhang, Jiangyue Yan, Zike Yuan, Ling Deng, Yue Yu, Hui Wang, Ruifeng Xu
arXiv:2510. 05150v3 Announce Type: replace-cross Abstract: Recent advances in spoken dialogue language models (SDLMs) reflect growing interest in shifting from turn-based to full-duplex systems, where the models continuously perceive user speech streams while generating responses.
By Donghang Wu, Haoyang Zhang, Chen Chen, Tianyu Zhang, Fei Tian, Xuerui Yang, Gang Yu, Hexin Liu, Nana Hou, Yuchen Hu, Eng Siong Chng
RetroThinker is a multi-stage post‑training framework that enhances SpeechLLMs by enabling them to self‑verify and forward‑correct Chain‑of‑Thought reasoning steps during inference. It combines supervised fine‑tuning on curated retrospective thinking data with length‑based direct preference optimization to improve reasoning while the user speaks. On the GSM8K benchmark, RetroThinker achieves an 11% absolute accuracy gain over non‑retrospective baselines while maintaining comparable latency.
By Yi-Jen Shih, Puyuan Peng, Abdelrahman Mohamed, David Harwath
SKILL.state is a new runtime architecture for large language model agents that replaces the traditional append‑only conversational history with an explicit, mutable execution state. At each step the model receives only the immutable skill specification, the current structured state, and the latest observation, discarding intermediate reasoning after validating state updates. Experiments across datasets, models, and environments show that SKILL.state improves task accuracy and significantly reduces cumulative token consumption, proving that explicit execution state is a scalable, architecture‑agnostic abstraction for long‑horizon agent skills.
By Sanket Badhe, Priyanka Tiwari, Jonghyun Chung
arXiv:2609.17088v1 Announce Type: new
Abstract: Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these...
By Cai Ke, Jiangyue Yan, Han Zhang, Xin Liu, Zike Yuan, Yue Yu, Hui Wang, Ruifeng Xu