arXiv AI

LLM Agents Perform Controlled Experiments Using Simulation Models

The paper introduces a multi‑agent framework that lets large language models (LLMs) perform controlled experiments using scientific simulation models, specifically for pharmaceutical process design. Given a user query and baseline configuration, the system builds a structured task, designs and runs comparative simulations, interprets outcomes, and generates evidence‑based recommendations for optimizing process parameters. By integrating high‑fidelity simulations with LLMs, the approach yields more specific, actionable outputs and improves user‑rated correctness and helpfulness compared to language‑only reasoning.

arXiv AI
Jul 22

Agents in the Wild: Where Research Meets Deployment

arXiv:2607. 19336v1 Announce Type: new Abstract: Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery, and finance.

By Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz, Enrico Santus, Victor Dibia, Ioana Baldini
arXiv AI
6d ago

From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities

The paper introduces a new benchmark that evaluates large language models (LLMs) on their agentic mathematical reasoning rather than just final answers. It aligns problem‑solving behaviors with a taxonomy of reusable mathematical atomic capabilities and includes planning, action, and feedback tasks in both textual and multimodal settings. Experiments show that models with similar end‑to‑end accuracy can have very different agentic profiles, highlighting the importance of process‑level evaluation.

By Jiayi Kuang, Yinghui Li, Yunze Song, Keyu Chen, Zhifeng Shen, Yangning Li, Yidong Wang, Di Yin, Ruizhi Qiao, Xing Sun, Kai Jin, Ying Shen, Liang Lin, Philip S. Yu
arXiv AI
6d ago

AI Control Scientist: LLM-driven Agentic System for Automated Control Design

AI Control Scientist (AICS) is a large language model–driven agent that automatically generates optimized controllers from language design requirements. It comprises a Task Modeling Agent that translates user needs into engineering constraints, a Controller Design Agent that produces candidate controller structures and code, and a Parameter Tuning Agent that refines parameters to meet closed‑loop performance criteria. Experiments show AICS outperforms existing automated baselines in design success rate and optimization efficiency, enabling the creation of multiple representative control systems.

By Haiteng Wang, Weihao Li, Jing Zhang, Lei Ren
arXiv AI
Aug 14

MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination

arXiv:2608. 13476v1 Announce Type: new Abstract: We present Multi-Agent Reasoning and Coordination (MARC), an open-source framework that replaces monolithic LLM prompting with deterministic multi-agent orchestration for clinical reasoning.

By Saisha Shetty, Satvik Tripathi, Austin Lin, Colin Zhao, Theodore Kim, Don Enwerem, Jacinta Arnold, Shahriar Faghani, Tessa S Cook
arXiv AI
Jul 7

AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments

arXiv:2607. 05174v1 Announce Type: new Abstract: Language agents, i.

By Zhiheng Xi, Dingwen Yang, Jiaqi Liu, Jixuan Huang, Honglin Guo, Baodai Huang, Tinggang Chen, Qi Zhang, Zhonghang Lu, Chenyu Liu, Jiajun Sun, Jiazheng Zhang, Dingwei Zhu, Xin Guo, Junzhe Wang, Zhihao Zhang, Yuming Yang, Junjie Ye, Minghe Gao, Dongrui Liu, Jiaming Ji, Guohao Li, Tao Gui, Qi Zhang, Xuanjing Huang
Hugging Face Trending Papers
Aug 27

AI Control Scientist: LLM-driven Agentic System for Automated Control Design

The paper introduces AI Control Scientist (AICS), a large language model–driven agent that automatically generates optimized controllers from language design requirements. AICS consists of a Task Modeling Agent that translates user needs into engineering constraints, a Controller Design Agent that produces candidate controller structures and code, and a Parameter Tuning Agent that refines parameters to meet closed‑loop performance criteria. Experiments show that AICS outperforms existing automated baselines in design success rate and optimization efficiency, demonstrating its potential to shift control system design from human‑driven to agent‑driven approaches.