arXiv AI By Wenda Wei, Yingchen Zhang, Ruqing Zhang, Jiafeng Guo, Daiting Shi, Xueqi Cheng

Experimental Experience Modeling for Autonomous Research

Read the original on arXiv AI →

The paper introduces Experimental Experience Modeling (EEM), a framework that helps autonomous research agents decide which experiments to run by reusing and accumulating past experimental data. EEM extracts decision-relevant records from previous experiments, stores them in an experience library, and retrieves relevant information when making new experimental choices. If historical data is insufficient, EEM performs a low-cost pilot experiment to gather the needed experience before committing to a full-scale, resource-intensive study, thereby iteratively expanding the library and improving research efficiency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 19

AutoResearch: Insight In, Hallucination Out

AutoResearch is a two‑stage autonomous research system that links Idea Generation with Idea Execution. In the generation phase it blends new research signals with existing domain knowledge, identifies transferable mechanistic insights, and produces grounded, testable research plans through multi‑model generation and cross‑review. The execution phase then decomposes these plans into experiments, iteratively implements and diagnoses them, and uses independent evidence‑based review to accept or revise conclusions, thereby turning ideas into measurable progress while minimizing hallucinations.

By Yiming Ren, Xiang Liu, Qumeng Sun, Xiao Zhang, Jiahao Li, Haoyang Zhang, Junjie Wang
arXiv Computation and Language
Oct 9

Language Models as AI Research World Models

The paper proposes using language models as Research World Models (RWMs) to predict outcomes of experimental interventions across diverse research environments. By training on over 2,600 experimental records and 171,000 GPU‑hours, RWMs improve prediction accuracy within and across environments, reducing selection regret by up to 78% and boosting gains in multi‑round autoresearch. Ablation studies show that incorporating research knowledge yields greater benefits than merely changing the language model or increasing reasoning effort.

By Zijun Wang, Zewen Liu, Minhua Lin, Zhaotian Weng, Zhan Shi, Bing He, Yisi Sang, Dakuo Wang, Benoit Dumoulin, Wei Jin, Yuyin Zhou, Cihang Xie, Hanqing Lu
arXiv AI
2d ago

Evolver: Turning Agent Exploration into Evolving Capabilities

Evolver is an experience-driven framework that converts agent exploration into persistent, reusable capabilities without updating foundation model parameters. It uses structured Gene assets to acquire, retrieve, and evolve experience, enabling experience-conditioned execution across existing agent harnesses. In evaluations with Claude Code and Codex on several benchmarks, Evolver increased task success from 83.13% to 87.50% and reduced token consumption by up to 24.24%, showing both effectiveness and efficiency gains.

By Haoyang Zhang, Qumeng Sun, Xiao Zhang, Xiang Liu, Zhidong Fan, Junjie Wang
arXiv AI
Jun 30

Hierarchical Experimentalist Agents

arXiv:2606. 29315v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used to take actions in the real world and support human decision-making, yet most agents rely on parametric knowledge, fixed post-training data, retrieval, or search.

By Abhranil Chandra, Sankaran Vaidyanathan, Utsav Dhanuka, Varun Gandhi, Scott Niekum
arXiv Computation and Language
Sep 11

Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System

Auto-RecSys is an autonomous research system designed to scale long-horizon experimentation for industry‑scale recommendation models. It tackles long feedback loops and system complexity by enabling distributed asynchronous execution, centralized cross‑server memory, and a cognitive‑procedural separation that combines natural‑language skill files with deterministic scripts. The system incorporates a dual‑loop self‑evolving architecture—Execution Evolution and Idea Evolution loops—to refine operational playbooks and guide future experiments, thereby reducing human effort per cycle and improving reliability as playbooks mature.

By Ming Li, Dai Li, Xuying Ning, Bo Sun, Rui Li, Yi Zhang, Silvia Gong, Xuan Cao, Rui Li, Cornelia Carapcea, Qunshu Zhang, Zhigang Wang, Yinglong Xia, Andy Wang