arXiv AI
FALCA: Falsification-Aware Reinforcement Learning with Hierarchical Credit Assignment for Long-Horizon Deep Search Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 24
AREX: Towards a Recursively Self-Improving Agent for Deep Research
arXiv:2607. 21461v1 Announce Type: new Abstract: Deep research requires agents to find answers that jointly satisfy multiple constraints.
arXiv Machine Learning
Aug 12
SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task
arXiv:2607. 24850v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have enabled search agents to autonomously tackle complex tasks across extended search and reasoning horizons.
arXiv Machine Learning
4d ago
RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards
RubricEM is a unified reinforcement learning framework designed for deep research agents that plan, search, evaluate evidence, and synthesize long‑form reports. It introduces rubric‑guided policy decomposition, combining supervised fine‑tuning to scaffold agents with rubrics, stage‑structured GRPO for fine‑grained credit assignment, and a reflection meta‑policy for experience reuse. The resulting RubricEM‑8B model outperforms larger open models on four long‑form research benchmarks and approaches the performance of proprietary deep‑research systems.
arXiv AI
Jun 16
S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents
arXiv:2606. 15367v1 Announce Type: new Abstract: Deep research agents aim to solve complex knowledge-intensive tasks through long-horizon planning, evidence gathering, reasoning, and report generation.
Hugging Face Trending Papers
Sep 28
Dr.Credit: Rubric-Grounded Process Credit Assignment for Deep Research Agents
Dr.Credit introduces a rubric‑grounded credit assignment method that evaluates intermediate tool turns in deep research agents by comparing the information returned to the history of accepted support for each rubric. Unlike traditional approaches that rely on ground‑truth answers, Dr.Credit uses task requirements as a shared reference, distinguishing new support from previously seen evidence and recognizing partial rubric fulfillment. Experiments on four benchmarks show that Dr.Credit outperforms open deep research baselines across all primary metrics, achieving performance competitive with proprietary models while enabling more efficient evidence acquisition and higher‑quality reports under limited turn budgets.
arXiv AI
Oct 5
Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents
The paper introduces MIRA, a hierarchical architecture that separates meta-reasoning from execution for long-horizon research agents. An outer-loop meta-reasoner selects the next investigation based on a persistent research record, while an inner-loop executor carries out the chosen work order. The authors demonstrate that MIRA improves inference and compute allocation in theorem proving and neural-architecture research, and that a generative actor-critic variant (MIRA-AC) can be trained efficiently without directly optimizing long execution traces.