arXiv AI

Adversarial Closed-Loop Curriculum for Evolving Role-Playing Agents

The paper introduces AdvRole, an adversarial closed‑loop curriculum for training role‑playing agents with large language models. It alternates between an Actor that learns to role‑play and a Rewriter that edits character profiles and dialogue contexts into hard scenarios, using a performance‑gap reward to target the Actor’s weaknesses. Experiments on English, Chinese, and a new multilingual benchmark demonstrate that AdvRole consistently outperforms baseline methods.

arXiv Computation and Language
Sep 15

Learning to Coach for Experiential Learning

arXiv:2609.15851v1 Announce Type: new Abstract: Language models can learn from experience, but raw solution trajectories are often too long and noisy to provide effective guidance. In this work, we p...

By Guanheng Chen, Tianzhu Ye, Li Dong, Xun Wu, Shaohan Huang, Furu Wei
arXiv AI
Sep 2

WorldBench: Culturally Grounded Benchmark for Multilingual Agents

WorldBench is a new multilingual benchmark that tests large language model agents on culturally grounded everyday workflows, offering 1,600 tasks in seven languages and eight cultures. The benchmark evaluates agents through structured sandbox actions and introduces Constrained Task Success (CTS), a metric that assesses task completion, minimal modification, and other complementary aspects via deterministic and LLM-as-a-Judge evaluations. Experiments show that even leading models achieve only 49.2% CTS, revealing significant gaps in correctness and state preservation across languages and cultures.

By Leonardo Ranaldi, Sherrie Shen, Jushi Kai, Alexandra Birch
arXiv Computation and Language
Aug 31

ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL

ContextPilot is a proactive context‑management framework designed to improve long‑horizon agentic reasoning with large language models. It expands the toolset to include planning, long‑term memory, and soft context offloading, and introduces a reinforcement‑learning strategy that focuses on critical editing decisions and assigns action‑level advantages. Experiments on long‑context QA and deep search tasks demonstrate that ContextPilot achieves stronger performance with a more compact working context, outperforming existing baselines across various base models and benchmarks.

By Zhuoshi Pan, Qizhi Pei, Junru Lu, Honglin Lin, H. Vicky Zhao, Di Yin, Xing Sun