arXiv AI

Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding

The paper introduces Retrieval-Grounded Voting (RGV), a new test-time scaling method for multi-turn search agents that retrieves and conditions on external documents. It identifies that confidence-based voting fails in this setting due to copy inflation, where tokens copied from retrieved documents inflate log probabilities and flatten confidence scores. RGV scores each rollout by lexical overlap between the final answer and retrieved documents, avoiding contaminated context and additional LLM calls, and achieves consistent accuracy gains across multiple benchmarks and models.

arXiv AI
Sep 15

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

The paper introduces Continual Search, an iterative framework that guides large language models to persistently search for diagnostic evidence in long AI agent execution logs, addressing the limitations of one-shot judgments. Evaluated on four existing RCA benchmarks and a new large-scale dataset called MegaRCA-Mix, Continual Search consistently boosts attribution performance, achieving a 40% F1 improvement for GPT‑5.5 on MegaRCA‑Mix. The results show that effective search can outweigh raw model scale, enabling lower-tier models to outperform higher-tier ones in root‑cause attribution tasks.

By Harsh Raj, David Lee, Anas Mahmoud, Renxiong Wang, Razvan-Gabriel Dumitru, Chenguang Wang, Tong Zhao, Yunzhong He, Darvin Yi, Vipul Gupta
arXiv AI
Oct 1

TRACE: Trajectory Selection for Parallel Scaling of Search Agents

TRACE is a lightweight learned selector that ranks completed search trajectories by aggregating cross‑rollout evidence, preserving individual query and evidence occurrences while propagating information across shared content or document identity. Trained with answer‑level supervision over frozen text embeddings, TRACE selects an existing answer without additional search or autoregressive aggregation, and a single selector generalizes across rollout policies and agent backbones. Across six WebQA policies, six long‑horizon dataset‑backbone combinations, and multiple WebQA benchmarks, TRACE outperforms majority voting and generative aggregators, achieving higher accuracy and at least tenfold higher processing throughput.

By Qisheng Zhou, Zhen Xiong, Qiaoyu Tan
arXiv AI
Sep 2

DualStake: Dual-Path Confidence Calibration in Deep Research Agents

DualStake introduces a dual-path confidence calibration for deep research agents, adding step confidence elicitation after each retrieval step. The method shows that evidence confidence (E-Conf) after the final retrieval provides a stronger uncertainty signal than answer confidence (A-Conf), and that A-Conf is largely influenced by E-Conf. By applying margin‑clipped, confidence‑dependent stake rewards, DualStake aligns both E-Conf and A-Conf with answer correctness, improving calibration across multiple QA benchmarks without harming accuracy.

By Yinuo Xu, Yuwei Liang, Jianjie Cheng, Meng Wang, Yongcan Yu, Shuo Lu, Jian Liang
arXiv AI
Aug 18

Agentic Test-Time Scaling for WebAgents

arXiv:2602. 12276v2 Announce Type: replace Abstract: Test-time scaling has become a standard way to improve performance and boost reliability of neural network models.

By Nicholas Lee, Lutfi Eren Erdogan, Chris Joseph John, Surya Krishnapillai, Michael W. Mahoney, Kurt Keutzer, Amir Gholami