arXiv AI By Hyunho Kook, Junhyuk So, Tianyu Fu, Haizhong Zheng, Beidi Chen

Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding

Read the original on arXiv AI →

The paper introduces Retrieval-Grounded Voting (RGV), a new test-time scaling method for multi-turn search agents that retrieves and conditions on external documents. It identifies that confidence-based voting fails in this setting due to copy inflation, where tokens copied from retrieved documents inflate log probabilities and flatten confidence scores. RGV scores each rollout by lexical overlap between the final answer and retrieved documents, avoiding contaminated context and additional LLM calls, and achieves consistent accuracy gains across multiple benchmarks and models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
2d ago

DualStake: Dual-Path Confidence Calibration in Deep Research Agents

DualStake introduces a dual-path confidence calibration for deep research agents, adding step confidence elicitation after each retrieval step. The method shows that evidence confidence (E-Conf) after the final retrieval provides a stronger uncertainty signal than answer confidence (A-Conf), and that A-Conf is largely influenced by E-Conf. By applying margin‑clipped, confidence‑dependent stake rewards, DualStake aligns both E-Conf and A-Conf with answer correctness, improving calibration across multiple QA benchmarks without harming accuracy.

By Yinuo Xu, Yuwei Liang, Jianjie Cheng, Meng Wang, Yongcan Yu, Shuo Lu, Jian Liang