arXiv AI By Donghyun Lee, Taehoon Lee, Geonhee Ahn, Jieun Kim, Jihyun Park, Suyeon Cho, Yoona Kim, Chaerim Shin, Hoi Ri Moon, Jonggeol Na, Sukho Hong, Jihwan Oh, Soo Kyung Kim

MOF-VERIFY: A Failure-Aware Agentic Harness for MOF Hypothesis Verification

Read the original on arXiv AI →

MOF-VERIFY is a failure-aware agentic harness designed to improve hypothesis verification for metal‑organic frameworks (MOFs). It introduces a diagnostic benchmark with four task families—structural grounding, synthesis‑condition verification, evidence‑sufficiency verification, and MLIP‑based computational verification—to pinpoint failures in knowledge access, evidence acquisition, and reasoning. Guided by these diagnostics, MOF‑Verify addresses structural, literature, evidence‑sufficiency, and computational bottlenecks, achieving significant performance gains over direct inference and retrieval‑based baselines across multiple large language models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 18

oMeBench: Towards Robust Benchmarking of LLMs in Organic Mechanism Elucidation and Reasoning

oMeBench is a large-scale, expert-curated benchmark designed to evaluate large language models (LLMs) on organic mechanism reasoning. It contains over 10,000 annotated mechanistic steps, including reaction type labels, intermediate structures, and difficulty ratings, and introduces the oMeS scoring framework to assess logical consistency and chemical structural similarity. Evaluation shows that while current LLMs display promising chemical intuition, they often fail to produce correct and consistent multi-step reasoning, though prompting and fine-tuning can bring smaller models up to the level of closed‑source frontier models.

By Ruiling Xu, Yifan Zhang
arXiv AI
Aug 24

An LLM agent for end-to-end computational materials discovery

MAESTRO is a large language model agent that automates the full screening pipeline for metal‑organic frameworks (MOFs). It parses extensive MOF literature, links publications to crystal structures, curates a computation‑ready database, and then applies a progressively more expensive computational strategy to identify promising candidates. The identified materials for wet flue gas separation come from unrelated studies, demonstrating the agent’s ability to uncover high‑performance materials across domains.

By Chen Yuntong, Huang Ju, Liu Yu, Zhao Dan, Sun Mingqi, Ju Chentian, Liu Yanbing, Huang Lijiang, Zhao Guobin