Search Shapes Conclusions: Auditing Evidence Selection Bias in Deep Research Agents
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
Automated biomedical evidence synthesis depends on retrieving published studies, but the biomedical literature is systematically skewed toward positive findings. Deeper retrieval can therefore make a...
arXiv:2609.24101v1 Announce Type: new Abstract: Automated biomedical evidence synthesis depends on retrieving published studies, but the biomedical literature is systematically skewed toward positive...
JevGPT is a dual‑system architecture for autonomous research that combines fast evidence processing (System One) with deliberative research planning (System Two). System One quickly locates and evaluates relevant passages, while System Two sets evidence objectives and integrates findings into subsequent research steps. Experiments on question answering and document ranking demonstrate that JevGPT outperforms comparable agents, achieving faster completion, lower cost, and broader source coverage.
The paper introduces a counterfactual evidence audit to assess how large language model agents respond to different sets of documents. By exposing agents to two mirrored sets of five documents and measuring changes in six downstream decisions, the authors predict how the agents will behave when presented with a full 45‑document context. Across multiple open‑weight model families and tasks, the five‑document audit accurately forecasts full‑context effects, reducing prediction error by 62% and correctly identifying the direction of most material effects.
arXiv:2509. 00761v4 Announce Type: replace Abstract: Large language models are increasingly deployed for legal question answering, where evaluations typically focus on multiple-choice accuracy.
Optimist Deep Research is an open‑source agent that conducts literature research as an iterative, state‑centric process. It breaks a research question into a tree of subquestions, uses search intents to query multiple scholarly databases, and merges results into a provenance‑preserving document registry. The agent iteratively expands the registry via citation snowballing, evaluates evidence, and refines the research plan through a critic that can add, split, rephrase, deprioritize, or close subquestions, ultimately producing a report with every citation linked to a retrieved document.