MIND is an LLM-driven framework that automates hypothesis validation in materials research by structuring the discovery process into hypothesis refinement, experimentation, and debate-based validation within a multi-agent pipeline. It incorporates Machine Learning Interatomic Potentials, notably SevenNet-Omni, to perform scalable in‑silico experiments and offers a web-based interface for automated hypothesis testing. The modular design allows integration of additional experimental modules, making the framework adaptable to broader scientific workflows.
arXiv:2603. 13191v2 Announce Type: replace-cross Abstract: While large language models (LLMs) have transformed AI agents into proficient executors of computational materials science, performing a hundred simulations does not make a researcher.
arXiv:2607. 16845v1 Announce Type: new Abstract: Scientists at European XFEL conduct experiments that generate very large and complex datasets.
The review traces the development of machine‑learning techniques for extracting materials data and knowledge from scientific literature, progressing from rule‑based pipelines to NLP models, transformer encoders, and finally large language models and agentic systems that handle text, tables, and figures. It highlights how these methods enable the creation of queryable materials databases, knowledge graphs, generic question answering, AI co‑scientists, chatbots, and closed‑loop discovery with autonomous labs. The paper critically evaluates datasets, extraction accuracy, computational costs, and offers practical guidelines, while outlining open challenges such as full tetrahedron extraction, benchmark scarcity, and terminology resolution.
The paper introduces AutoMat, a benchmark designed to test large language model (LLM) coding agents on their ability to reproduce claims from computational materials science. AutoMat presents three challenges: reconstructing underspecified procedures, navigating specialized toolchains, and assessing whether the evidence supports a claim. Experiments show that current LLM agents achieve low success rates, with the best setting reaching only 53%, and failures stem mainly from incomplete procedures, methodological deviations, and execution fragility.
arXiv:2603. 15952v2 Announce Type: replace Abstract: Large language models (LLMs) are capable of emulating reasoning and using tools, creating opportunities for autonomous agents that execute complex scientific tasks.
The Perspective reviews the rapid growth of agentic AI systems in computational chemistry, noting an increase from a handful in 2024 to about fifty by August 2026. These systems are evolving from assisting with specific tasks to autonomously designing, executing, and analyzing in‑silico experiments, even drafting manuscripts. While fully autonomous AI scientists are not yet realized and human oversight remains, the trend toward commoditized generalist agents suggests a future where specialized systems may become obsolete, prompting reflection on the field’s direction and priorities.
The article introduces AgentActionBench, a benchmark designed to evaluate agent-based experiment reproduction across machine learning and AI4Science papers. It employs an MCP-based Action Recorder to capture agents’ behavior during reproduction and assesses the resulting traces against paper-specific rubrics. The benchmark includes 150 papers, with a human-annotated subset and model-assisted augmentation expanding it to over 10,000 rubric items, revealing that current systems face execution bottlenecks but that model-generated rubrics correlate strongly with human judgments.
The article discusses how artificial intelligence is beginning to automate scientific discovery, specifically in the realm of cognitive science. It outlines four key challenges for developing an automated science of the mind: representing experiments, generating synthetic behavior, synthesizing models, and closing the loop to discover psychological theories. The authors argue that addressing these challenges will enable AI to systematically advance our understanding of the mind.
arXiv:2606. 31229v1 Announce Type: new Abstract: Ideation plays a pivotal role in scientific discovery.
PAPERBENCHX is a new benchmark that tests whether AI can reproduce scientific experiments across 12 disciplines, including electromagnetics, photonics, chemistry, materials science, biology, and robotics. It consists of 93 expert-constructed tasks, each providing a source paper, a public specification, and a domain-native scientific environment. The benchmark evaluates AI agents by having them reconstruct, execute, and diagnose key experiments, then replay submissions from scratch to score regenerated evidence against expert-validated criteria, revealing that current AI configurations fully reproduce only 14% of tasks.
arXiv:2606. 04751v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed as autonomous agents in scientific tasks.
arXiv:2506. 05616v3 Announce Type: replace Abstract: We aim at designing language agents with greater autonomy for crystal materials discovery.