arXiv AI
Aug 5
Training Documents Reranker with Search Rubrics for Deep Research Agent
arXiv:2608. 03527v1 Announce Type: cross Abstract: Retrieval systems help deep research agents generate high-quality answers by providing relevant documents.
Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation
The paper introduces a method for creating query‑specific rubrics for DeepResearch‑style long‑form report generation by training rubric generators with reinforcement learning. It builds a dataset of queries annotated with human preferences, then uses a hybrid reward that includes preference consistency, format validity, and LLM‑based rubric evaluation. The learned rubrics outperform generic or manually constructed alternatives in distinguishing preferred reports and, when used as rewards, improve performance of both single‑agent and multi‑agent DeepResearch systems.
Related stories
Hugging Face Trending Papers
Jun 3
Self-Evolving Deep Research via Joint Generation and Evaluation
Large Language Models (LLMs) have become increasingly adopted in daily applications, with deep research standing out as a particularly important capability. Unlike traditional question-answering (QA) tasks, deep research report generation lacks definitive ground-truth, making reward design inherently unverifiable and limiting effective reinforcement learning.
arXiv Computation and Language
Sep 18
F$^{2}$DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows
The paper introduces F$^{2}$DR, a fine‑grained reward framework designed to evaluate end‑to‑end DeepSearch workflows, which involve planning, reflection, retrieval, and answer generation. F$^{2}$DR assesses workflows along three dimensions—Content, Trajectory, and Answer—to provide a comprehensive process‑level evaluation. The authors also present DeepSearch RM‑Bench, a benchmark that tests reward models in DeepSearch scenarios and shows strong discriminative power over existing open‑source models.
arXiv AI
Jun 4
Self-Evolving Deep Research via Joint Generation and Evaluation
arXiv:2606. 04507v1 Announce Type: cross Abstract: Large Language Models (LLMs) have become increasingly adopted in daily applications, with deep research standing out as a particularly important capability.
arXiv AI
2d ago
MatrixReward: Reward from Rubric Matrix for Open-Ended Generation
arXiv:2610.00389v1 Announce Type: cross Abstract: Open-ended query generation lacks standard answers, thus necessitating an effective reward mechanism. Pointwise scoring rubrics provide limited infor...
arXiv Machine Learning
Aug 12
SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task
arXiv:2607. 24850v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have enabled search agents to autonomously tackle complex tasks across extended search and reasoning horizons.
Hugging Face Trending Papers
Aug 3
CRISP: Critical Step Perception for Training Efficient Deep Search Agents
Large language models (LLMs) are increasingly extended into deep search agents that solve complex questions through multi-step interaction with external search and browsing tools. However, existing agents often incur substantial computational and interaction costs, generating lengthy trajectories that contain redundant queries, inefficient exploration, and irrelevant observations.
arXiv Machine Learning
Jun 10
$S^3$-R1: Learning to Retrieve and Answer Step-by-Step with Synthetic Data
arXiv:2605. 01248v3 Announce Type: replace Abstract: Reinforcement learning (RL) post-training has enabled newer capabilities in models, such as agentic tool-use for search.
arXiv Machine Learning
Jun 26
Designing Reward Signals for Portable Query Generation: A Case Study in Industrial Semantic Job Search
arXiv:2606. 27291v1 Announce Type: new Abstract: Job-search platforms rely on low-bandwidth query interfaces that often fail to capture the high-dimensional complexity of candidate profiles.
arXiv Computation and Language
Sep 1
GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation
arXiv:2608.29856v1 Announce Type: new Abstract: Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during...
arXiv AI
Jun 12
DailyReport: An Open-ended Benchmark for Evaluating Search Agents on Daily Search Tasks
arXiv:2606. 12871v1 Announce Type: new Abstract: Search Agents (SAs) typically leverage large language models (LLMs) to support complex information-seeking tasks by autonomously exploring web sources and synthesizing information into comprehensive responses.
arXiv AI
Jul 22
Dr. Zero: Self-Evolving Search Agents without Training Data
arXiv:2601. 07055v2 Announce Type: replace Abstract: As high-quality data becomes increasingly difficult to obtain, self-evolution without curated training data has emerged as a promising paradigm.