arXiv Computation and Language

Lazy Grounding: Attacking Search Agents with Factual Evidence

arXiv AI
Aug 6

Breadcrumbing Search Agents

arXiv:2608. 04565v1 Announce Type: cross Abstract: LLM-based search agents are widely used for information-seeking tasks, but their reliance on external tool returns introduces a critical security risk: web content retrieved during execution is untrusted, exposing agents to prompt injection and goal hijacking.

By Xuebin Li, Hanqing Zhao, Siyuan Liang, Kejiang Chen, Weiming Zhang, Dacheng Tao, Nenghai Yu
arXiv AI
Aug 26

Beyond Confidence: Test-Time Scaling for Multi-Turn Search Agents via Retrieval Grounding

The paper introduces Retrieval-Grounded Voting (RGV), a new test-time scaling method for multi-turn search agents that retrieves and conditions on external documents. It identifies that confidence-based voting fails in this setting due to copy inflation, where tokens copied from retrieved documents inflate log probabilities and flatten confidence scores. RGV scores each rollout by lexical overlap between the final answer and retrieved documents, avoiding contaminated context and additional LLM calls, and achieves consistent accuracy gains across multiple benchmarks and models.

By Hyunho Kook, Junhyuk So, Tianyu Fu, Haizhong Zheng, Beidi Chen