arXiv Computation and Language By Mengting Li, Xilong Cheng, Zhihao Xiao, Zhenhua Xu, Jingyuan Zhou, Linfeng Li, Long Zhang, Borui Cai, Yunxiao Qin

MemRole: From Memories to Decisions for Long-Horizon Reasoning in Role-Playing Agents

Read the original on arXiv Computation and Language →

MemRole is a framework that explicitly models the memory-to-decision process for large language model (LLM) role‑playing agents, enabling them to make role‑consistent decisions over long narrative horizons. It introduces Long‑Horizon Memory Thinking (LHMT), a reasoning schema that decomposes hidden reasoning into context understanding, memory activation, and response strategy planning, and is trained on a novel dataset that limits each character’s memory pool to what it could plausibly know at the current narrative point. The framework also includes Self‑Refining On‑Policy Self‑Distillation (SR‑OPSD), where the model critiques its own rollouts and distills token‑level guidance back into the policy, resulting in a 15.2‑point improvement over its backbone and competitive performance with frontier LLMs such as GPT‑5.4.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Aug 12

MESA:Task-Adaptive Multi-Structure Evidence Selection for Long-Horizon Agent Memory

arXiv:2608. 10108v1 Announce Type: new Abstract: Long-horizon agents accumulate trajectories spanning hundreds of interleaved reasoning, action, and observation steps, where answering a query may depend on evidence buried far back in the history.

By Beidi Zhao, Yaoqi Chen, Yuru Feng, Menghao Li, Qianxi Zhang, Baotong Lu, Jianan Lu, Zhirui Wang, Xinjiang Wang, Shusen Xu, Zengzhong Li, Xiaoxiao Li, Qi Chen
arXiv AI
Oct 21

M-Plan: Comprehensive Planning For LLM Agents with Memory Arrangement

M-Plan is a closed‑loop multi‑agent system that combines long‑term and short‑term memory to improve large language model agents on long‑horizon, multi‑turn tasks. It uses task‑specific milestones and local hints to generate global‑local guidance, forming short‑term memory during execution, and then optimizes and stores relevant information in long‑term memory for future use. Experiments on ALFWorld, Webshop, and PDDL show that M‑Plan outperforms baseline methods in both accuracy and efficiency.

By Ziyang Liu, Jiakang Yuan, Jiayuan Fan, Tao Chen
arXiv AI
Jul 3

Procedural Memory Distillation: Online Reflection for Self-Improving Language Models

arXiv:2607. 01480v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR), along with recent selfdistillation variants such as SDPO, evaluates each rollout against a verifier and updates the policy from that episode-level signal.

By Ye Liu, Srijan Bansal, Bo Pang, Yang Li, Zeyu Leo Liu, Yifei Ming, Zixuan Ke, Shafiq Joty, Semih Yavuz