arXiv AI
Autonomous Science Bench: Evaluating AI Agents for Autonomous Scientific Discovery
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
Hugging Face Trending Papers
Oct 13
Autonomous Science Bench: Evaluating AI Agents for Autonomous Scientific Discovery
The paper introduces Autonomous Science Bench, a benchmark for AI agents that must choose experiments under a limited budget. It features six real-world design-build-test-learn campaigns in biology, chemistry, and materials science, where agents select design batches, receive lab measurements, and iteratively refine a predictive model. Success is measured by two calibrated gates—discovery and learning—highlighting distinct agent weaknesses that overall success rates alone would mask.
arXiv AI
Jul 14
FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights
arXiv:2602. 02905v2 Announce Type: replace Abstract: Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge.
arXiv AI
Jul 7
Compressing the Validation Bottleneck: An Agentic Self-Driving Lab for Scientific Discovery
arXiv:2607. 04508v1 Announce Type: new Abstract: Agentic AI-for-Science can automate ideation, planning, and analysis, but final validation still depends on real experiments.
arXiv AI
Jun 12
EurekAgent: Agent Environment Engineering is All You Need For Autonomous Scientific Discovery
arXiv:2606. 13662v1 Announce Type: new Abstract: LLM-based agents have shown increasing potential in automating scientific discovery.
arXiv AI
Aug 5
Can LLM design high-quality experiments? A Comprehensive and Systematic Benchmark on Autonomous Experimental Design
arXiv:2608. 03501v1 Announce Type: new Abstract: AI for Research (AI4Research) leverages AI to automate and improve scientific workflows.
arXiv AI
Sep 18
ScientistTwo: Pioneering the Human Knowledge Frontier with Autonomous AI
The paper introduces ScientistTwo, a fully autonomous multi‑agent framework that takes a scientific problem, establishes baselines, generates hypotheses, and coordinates specialized agents to conduct an end‑to‑end discovery cycle without human intervention. It rigorously tests and refines its methods through automated experiments, ablation studies, and a closed‑loop peer‑review engine. Benchmarking against top conferences (ICLR, ICML, NeurIPS) shows that ScientistTwo produces expert‑level, publishable papers and codebases that outperform human state‑of‑the‑art models and receive higher review ratings under automated AI review.