arXiv AI

From Delegation to Coordination: Learning Efficient Multi-Agent Deep Research

The paper introduces LEAD-RL, a joint training framework for multi‑agent deep research systems that assigns credit to subagents based on their contribution to the main agent’s research utility. By evaluating each subagent’s report during training and gating the inherited team advantage, LEAD‑RL avoids rewarding misleading subagent outputs and focuses on final‑answer correctness. Experiments on five benchmarks and two model families show that LEAD‑RL improves answer quality, achieving a 2.49‑point accuracy gain on BrowseComp and a 24.5% reduction in critical‑path cost compared to shared‑credit joint training.

Hugging Face Trending Papers
5d ago

From Delegation to Coordination: Learning Efficient Multi-Agent Deep Research

The paper introduces LEAD‑RL, a joint training framework for multi‑agent deep research that uses contribution‑aware credit assignment to improve coordination between a main agent and its subagents. By evaluating each subagent’s report for research utility and gating its team advantage, the method avoids rewarding misleading subagent outputs and focuses on final answer correctness. Experiments on five benchmarks show that LEAD‑RL boosts answer quality, achieving a 2.49‑point accuracy gain on BrowseComp and a 24.5% reduction in critical‑path cost compared to shared‑credit joint training.

arXiv AI
Jun 9

Counterfactual Credit Policy Optimization for Multi-Agent Collaboration

arXiv:2603. 21563v4 Announce Type: replace Abstract: Collaborative multi-agent large language models (LLMs) can solve complex reasoning tasks by decomposing roles, but reinforcement learning for such systems is limited by credit assignment: shared terminal rewards obscure individual contributions and can encourage free-riding.

By Zhongyi Li, Wan Tian, Yikun Ban, Jinju Chen, Huiming Zhang, Yang Liu, Fuzhen Zhuang
arXiv Computation and Language
Oct 19

MultiAgent-OPD: End-to-End Training of Hierarchical Multi-Agent Systems with On-Policy Distillation

arXiv:2610.23234v1 Announce Type: new Abstract: In a hierarchical multi-agent system, a Leader assigns tasks and subagents carry them out. Jointly training the Leader and the subagents is difficult b...

By Yuhan Sun, Jiaxin Zhao, Yongdong Luo, Yibo Hu, Meiguang Jin, Junfeng Ma, Weixun Wang, Weihang Pan, Zhongan Bi
arXiv AI
Jun 9

SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research

arXiv:2606. 09730v1 Announce Type: new Abstract: Large language models are increasingly expected to handle complex, long-horizon real-world tasks whose context demands can grow without bound, yet model context windows remain inherently finite.

By Pu Ning, Quan Chen, Kun Tao, Xinyu Tang, Tianshu Wang, Qianggang Cao, Xinyu Kong, Zujie Wen, Zhiqiang Zhang, Jun Zhou
arXiv Machine Learning
Oct 19

RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards

RubricEM is a unified reinforcement learning framework designed for deep research agents that plan, search, evaluate evidence, and synthesize long‑form reports. It introduces rubric‑guided policy decomposition, combining supervised fine‑tuning to scaffold agents with rubrics, stage‑structured GRPO for fine‑grained credit assignment, and a reflection meta‑policy for experience reuse. The resulting RubricEM‑8B model outperforms larger open models on four long‑form research benchmarks and approaches the performance of proprietary deep‑research systems.

By Gaotang Li, Bhavana Dalvi Mishra, Zifeng Wang, Jun Yan, Yanfei Chen, Chun-Liang Li, Long T. Le, Rujun Han, George Lee, Hanghang Tong, Chen-Yu Lee, Tomas Pfister
arXiv Machine Learning
Oct 8

Cross-Agent Learning Signals Enable Coordinated Role-Decomposed LLM Training

The paper introduces DAC (Divide and Cooperate), a role‑decomposed training framework that separates evidence acquisition (searcher) and response generation (generator) in agentic search systems. DAC uses task‑specific external verification signals to provide cross‑verification rewards, allowing the generator to abstain when evidence is insufficient and to assign credit appropriately to each role. Experiments on seven QA benchmarks and two model backbones show that DAC consistently outperforms single‑agent and multi‑agent baselines, with gains attributed to coordinated improvements in both search and generation.

By Jaewan Park, Solbee Cho, Jay-Yoon Lee
arXiv Machine Learning
Jul 30

SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution

arXiv:2607. 26784v1 Announce Type: new Abstract: Large language model agents often encounter related yet distinct tasks that share reusable solution patterns.

By Zhiyuan Yao, Yuxin Chen, Zhengxi Lu, Zishan Xu, Yueqing Sun, Yifu Guo, Yuquan Lu, Zhengzhou Cai, Kangning Zhang, Zhuowen Han, Zi-Han Wang, Ziang Ye, Qi Gu, Xunliang Cai, Weiwen Liu, Yongliang Shen
Hugging Face Trending Papers
Sep 28

Dr.Credit: Rubric-Grounded Process Credit Assignment for Deep Research Agents

Dr.Credit introduces a rubric‑grounded credit assignment method that evaluates intermediate tool turns in deep research agents by comparing the information returned to the history of accepted support for each rubric. Unlike traditional approaches that rely on ground‑truth answers, Dr.Credit uses task requirements as a shared reference, distinguishing new support from previously seen evidence and recognizing partial rubric fulfillment. Experiments on four benchmarks show that Dr.Credit outperforms open deep research baselines across all primary metrics, achieving performance competitive with proprietary models while enabling more efficient evidence acquisition and higher‑quality reports under limited turn budgets.

arXiv AI
Jul 24

AREX: Towards a Recursively Self-Improving Agent for Deep Research

arXiv:2607. 21461v1 Announce Type: new Abstract: Deep research requires agents to find answers that jointly satisfy multiple constraints.

By Shuqi Lu, Chaofan Li, Kun Luo, Zhang Zhang, Hui Wang, Hongwang Xiao, Zheng Liu, Lei Xiong, Jiahao Wang, Sen Wang, Xiyan Jiang, Wanli Li, Yuyang Hu, Hongjin Qian, Bingyu Yan, Ziyi Xia, Yingxia Shao, Kang Liu, Zhicheng Dou, Di He, Chaozhuo Li, Qiwei Ye, Zhongyuan Wang, Zheng Liu
arXiv AI
Jul 10

WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search

arXiv:2607. 08662v1 Announce Type: cross Abstract: Large language model (LLM)-based web search agents are transforming information seeking from simple factoid question answering into complex, deep-and-wide search and research-oriented tasks.

By Xiaoshuai Song, Liancheng Zhang, Kangzhi Zhao, Yutao Zhu, Zhongyuan Wang, Guanting Dong, Jinghan Yang, Han Li, Kun Gai, Ji-Rong Wen, Zhicheng Dou