arXiv AI
Benchmarking and Training Reward Models for Cross-Source Evidence Grounding in Search Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 11
Search-G1: Grounded Search Agents via Representation-Based Intrinsic Rewards
arXiv:2608. 07531v1 Announce Type: cross Abstract: Search-augmented language agents should retrieve external information only when necessary and ground their answers in retrieved evidence.
arXiv AI
Aug 6
ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment
arXiv:2608. 05102v1 Announce Type: new Abstract: Long-horizon search agents must make multiple sequential actions (steps) to search, retrieve, verify, and integrate evidence to reach a final answer.
arXiv AI
Jul 1
SAGE: A Search-AuGmented Evaluation of Large Language Models on Free-Form QA
arXiv:2504. 07385v3 Announce Type: replace-cross Abstract: As Large Language Models (LLMs) become increasingly used for question-answering (QA), relying on static, pre-annotated references for evaluation poses significant challenges in cost, scalability, and completeness.
arXiv Machine Learning
Aug 12
SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task
arXiv:2607. 24850v2 Announce Type: replace-cross Abstract: Recent advances in large language models (LLMs) have enabled search agents to autonomously tackle complex tasks across extended search and reasoning horizons.
arXiv AI
3d ago
CARA: Causally Guided Retrieval Agent for Question Answering
CARA is a training‑free, causally guided retrieval agent designed for question answering over text‑rich knowledge graphs. It evaluates retrieved evidence using two causal criteria—consequentiality and essentiality—alongside path consistency, and aggregates results from multiple agents via reciprocal rank fusion. Experiments on three STaRK datasets show that CARA outperforms existing retrievers, improving answer quality and faithfulness while examining fewer graph nodes and requiring fewer retrieval operations.
arXiv Computation and Language
Oct 9
CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence
CiteVQA is a benchmark that evaluates multimodal large language models on both answering document questions and providing element‑level bounding‑box citations for the evidence used. It contains 1,897 questions across 711 PDFs in seven domains and two languages, with ground‑truth citations generated via an automated pipeline and strict quality control. The evaluation metric, Strict Attributed Accuracy (SAA), rewards a prediction only when both the answer and the cited region are correct, revealing widespread attribution hallucination in current models.