arXiv AI
EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 12
TerraBench: Can Agents Reason Over Heterogeneous Earth-System Data?
arXiv:2606. 13148v1 Announce Type: new Abstract: Climate and environmental decision-making increasingly requires reasoning across heterogeneous inputs, including gridded physical data, satellite imagery, geospatial context, and simulator outputs.
arXiv Computation and Language
Sep 14
Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
arXiv:2609.12533v1 Announce Type: cross Abstract: Real-world Earth observation (EO) agents must translate high-level scientific questions into executable workflows to acquire observations, prepare da...
arXiv AI
Jun 12
Benchmarking AI Agents for Addressing Scientific Challenges Across Scales
arXiv:2606. 12736v1 Announce Type: new Abstract: AI agents are increasingly being developed to accelerate scientific discovery, yet their practical capabilities in real research settings remain poorly understood.
arXiv AI
Oct 5
HazardWeaver: Scientific Route Selection for Hazard Analysis Agents
HazardWeaver is an AI agent designed to select and execute appropriate scientific methods for hazard analysis by leveraging a Hazard Knowledge Compiler and a Hazard Capability Graph. It dynamically revises its route choices as new evidence and execution results emerge, ensuring that selected methods are both applicable and executable with available data and tools. The system is evaluated on the Hazard Weaver Benchmark, which includes 141 instances across multiple hazard domains, and demonstrates superior performance over existing agent systems, especially when multiple scientific routes are viable.
arXiv AI
Jul 14
FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights
arXiv:2602. 02905v2 Announce Type: replace Abstract: Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge.
arXiv AI
Oct 7
ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks
ST-Bench is a new benchmark that tests whether multi‑agent systems (MAS) outperform single agents on complex scientific data analysis tasks. It includes 100 Earth‑science data‑science tasks expanded into 2,067 queries, validated by domain experts. Evaluations show that most MAS configurations beat the cheapest single‑agent baseline, with the best reaching nearly three times its score, though at higher inference cost.