arXiv AI

MEAL: A Benchmark for Continual Multi-Agent Reinforcement Learning

arXiv:2506. 14990v3 Announce Type: replace Abstract: Benchmarks play a central role in reinforcement learning (RL) research, yet their computational constraints often shape what is studied.

arXiv AI

Jun 2

Task diversity produces systematic transfer but inhibits continual reinforcement learning

arXiv:2606. 00880v1 Announce Type: cross Abstract: Continual reinforcement learning aims to produce agents that learn not only to improve at their current tasks but also to adapt as task distributions change.

By Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho

agents reinforcement-learning benchmarks

arXiv AI

Aug 11

The Cell Must Go On: Agar.io for Continual Reinforcement Learning

arXiv:2505. 18347v3 Announce Type: replace-cross Abstract: Continual reinforcement learning (RL) concerns agents that are expected to learn continually, rather than converge to a policy that is then fixed for evaluation.

By Mohamed A. Mohamed, Kateryna Nekhomiazh, Vedant Vyas, Marcos M. Jose, Andrew Patterson, Marlos C. Machado

agents reinforcement-learning benchmarks

arXiv AI

Sep 3

MASkills: Continual Skills Optimization for Multi-Agent LLM Systems

MASkills is a continual learning framework designed to enhance multi‑agent large language model (LLM) systems by optimizing their agent skills. It introduces a new agent‑optimization pipeline that combines skill‑conditioned credit assignment, hierarchical credit aggregation, and momentum‑smoothed optimization, allowing skill libraries to evolve through refinement, induction, consolidation, and pruning. Experiments on HotpotQA, LoCoMo, and GAIA demonstrate its effectiveness across multiple agentic tasks.

By Huaiyuan Yao, Xiaoou Liu, Charles Fleming, Tianlong Chen, Hua Wei

llms agents efficiency

arXiv AI

Jun 8

Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates

arXiv:2601. 18510v2 Announce Type: replace-cross Abstract: While Large Language Model (LLM) agents excel at general tasks, they inherently struggle with continual adaptation due to the frozen weights after deployment.

By Yibo Li, Zijie Lin, Ailin Deng, Xuan Zhang, Yufei He, Shuo Ji, Tri Cao, Bryan Hooi

llms agents reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Jul 7

RL Forgets! Towards Continual Policy Optimization

arXiv:2607. 04364v1 Announce Type: new Abstract: Continual post-training is becoming a central paradigm for adapting vision-language models to evolving tasks.

By Mao-Lin Luo, Zhe-Xu Wang, Zi-Hao Zhou, Bo Ye, Jian Zhao, Min-Ling Zhang, Tong Wei

llms reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

4d ago

KV-streams for Efficient Compaction in Agentic Reinforcement Learning

arXiv:2609.35750v2 Announce Type: replace-cross Abstract: Scaling the horizon of agentic LLMs is bottlenecked by the need to fit ever longer context traces in GPU memory. Context compaction has been...

By Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda, Roger Creus Castanyer, Siddarth Venkatraman, Abhay Puri, Jonathan Light, Matthew James Sargent, Augustine N. Mavor-Parker, Massimo Caccia, Lucas Caccia, Glen Berseth, Esmeralda S. Whitammer, Alessandro Sordoni, Minseon Kim, Marc-Alexandre C\^ot\'e, Laurent Charlin, Guillaume Lajoie

llms agents reinforcement-learning efficiency

arXiv AI

Jun 4

Position: Deployed Reinforcement Learning should be Continual

arXiv:2606. 04029v1 Announce Type: cross Abstract: Reinforcement Learning (RL) has received increasing attention and adoption in real-world use cases.

By Parnian Behdin, Kevin Roice, Golnaz Mesbahi

agents reinforcement-learning

arXiv AI

Jun 8

Robust Instruction Compliance in Cooperative Multi-Agent Reinforcement Learning

arXiv:2605. 12655v2 Announce Type: replace Abstract: Multi-agent reinforcement learning (MARL) in real-world use cases may need to adapt to external natural language instructions that interrupt ongoing behavior and conflict with long-horizon objectives.

By Wo Wei Lin, Ethan Rathbun, Enrico Marchesini, Xiang Zhi Tan

agents reinforcement-learning

arXiv Machine Learning

Sep 22

Streaming Deep Reinforcement Learning Finally Works

arXiv:2410.14606v3 Announce Type: replace Abstract: Learning from a stream of experience as it arrives, also known as streaming learning, is a core part of natural learning. However, reliable streami...

By Mohamed Elsayed, Elena Sorina Lupu, Gautham Vasan, A. Rupam Mahmood

reinforcement-learning robotics benchmarks

arXiv Machine Learning

Jun 5

CLaaS: Continual learning as a service for sample efficient online learning

arXiv:2606. 05559v1 Announce Type: new Abstract: Deployed large language model agents must adapt to distribution shift in dynamic environments.

By Kion Fallah, Silen Naihin, Barak Widawsky, Qingqing Mao

llms agents safety

arXiv AI

Jun 6

Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environments

arXiv:2606. 05661v1 Announce Type: new Abstract: Continual learning, the ability of AI systems to improve through sequential experience, has attracted substantial interest, but no high-quality benchmark exists to evaluate it.

By Parth Asawa, Christopher M. Glaze, Gabriel Orlanski, Ramya Ramakrishnan, Benji Xu, Asim Biswal, Vincent Sunn Chen, Frederic Sala, Matei Zaharia, Joseph E. Gonzalez

llms agents benchmarks

Related stories