arXiv AI
ACED-Bench: Evaluating How LLM Agents Acquire and Act on Causal Evidence
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 7
CausalGame: Benchmarking Causal Thinking of LLM Agents in Games
arXiv:2607. 04293v1 Announce Type: cross Abstract: Building AI Scientist agents with Large Language Models (LLMs) has recently attracted growing attention.
arXiv AI
Jul 10
CausalDS: Benchmarking Causal Reasoning in Data-Science Agents
arXiv:2607. 08093v1 Announce Type: new Abstract: Large language models (LLMs) increasingly act as integrated data-science agents, combining abstract reasoning with advanced tool use.
Hugging Face Trending Papers
Jul 9
CausalDS: Benchmarking Causal Reasoning in Data-Science Agents
Large language models (LLMs) increasingly act as integrated data-science agents, combining abstract reasoning with advanced tool use. Yet the relevant benchmark landscape largely divides into symbolic causal reasoning benchmarks without realistic data analysis or data analysis benchmarks without a principled causal data-generating structure.
arXiv AI
3d ago
PANINI-DR: Controlled Deep Research through Generative Semantic Workspaces
arXiv:2610.15208v1 Announce Type: cross Abstract: Deep research requires connecting multiple steps of search, reasoning, and computation, with intermediate findings guiding what to investigate next....
arXiv AI
Jun 16
VeriGraph: Towards Verifiable Data-Analytic Agents
arXiv:2606. 16603v1 Announce Type: cross Abstract: LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit.
arXiv AI
2d ago
AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks
AlphaDiana is a measurement system designed to evaluate agents in verifiable reasoning tasks by providing modular interfaces for datasets, agents, environments, and scorers. It maintains harness-native control loops while separately managing file reuse and memory retention, enabling both macro-level analyses of entire agents and micro-level interventions on components such as tools, skills, and memory. Experiments on open-source models and harnesses across multiple benchmarks reveal that harnesses and component interventions do not consistently improve reasoning accuracy, and that token usage metrics must be interpreted alongside correctness.