arXiv AI

Stronger artificial intelligence breakthroughs hasten their own exhaustion

The paper argues that progress in AI is not simply a function of scale or the breadth of ideas, but depends on diverse attention, which can be depleted by collective focus on a single paradigm. Analyzing 36 years of computer‑science literature, the authors find that after the Transformer, the field’s attention narrowed sharply, with many researchers shifting into AI and reviewer confidence dropping. Each major breakthrough— from AlexNet to large language models—raises the field’s capacity for ideas but also accelerates the exhaustion of those ideas, a cycle mirrored in structural biology after cryo‑EM and AlphaFold. The study warns that policies like reciprocal reviewing may unintentionally concentrate attention on prolific authors, urging institutions to safeguard diverse attention rather than reward concentration on a single winning paradigm.

arXiv Computation and Language
2d ago

IdeaTaste: Do LLMs Share the Research Taste of Human Researchers?

IdeaTaste is a benchmark that evaluates large language models (LLMs) on their ability to generate research proposals that align with what human researchers actually publish. The study compares proposals generated by six contemporary LLMs against real papers from four research areas, finding that LLMs achieve only about 26% of the citation matching and 18% of the idea matching of human communities. Even larger LLM populations and richer field contexts do not close this gap, indicating that LLMs struggle more with translating research directions into concrete approaches than with selecting the right topics.

By Shanshan Zhong, Chen Xu, Jingjie Ning, Zhengzhong Liu, Aviral Kumar, Chenyan Xiong
arXiv AI
Sep 25

AI in Science: Early Insights

The paper "AI in Science: Early Insights" analyzes AI’s impact on scientific work using data from 15 million Gemini interactions, 2,600 specialized AI models, and a survey of 600 scientists. It finds widespread AI adoption, complementary use of large language models and specialized tools, significant productivity gains of about seven hours per week, and a shift in research bottlenecks toward hypothesis backlog and verification needs. The study suggests AI can boost scientific productivity but its full effect depends on addressing new downstream challenges.

By Mihai Codreanu, Alex Imas, Juan Mateos-Garcia, Joseph Emmens, Evalyne Muiruri, Arthur Turrell, Julian Jacobs, Atoosa Kasirzadeh, Ana Trisovic, Yiyuan Chen, Tanya Rodchenko, Catherine Pollard, Scott Strand, Daniel Rock, Zanna Iscenko, Fabien Curto Millet, Neil Thompson, James Manyika
arXiv Computation and Language
Oct 22

Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures

The paper proposes a framework for building autonomous AI research teams that can discover linear attention architectures. By assembling agents with diverse disciplinary expertise, private research histories, shared experimental evidence, and adaptive allocation of research opportunities, the team can balance exploration and exploitation under limited experimental budgets. Experiments show that this design outperforms GDN2 at 1.3B scale on language modeling, common‑sense reasoning, and retrieval tasks, and that removing any single component weakens discovery.

By Yujian Liu, Li An, Zelin He, Jacob Helwig, Jiabao Ji, Rohit Jain, Siyu Zhu, Shiyu Chang
arXiv AI
Sep 18

ScientistTwo: Pioneering the Human Knowledge Frontier with Autonomous AI

The paper introduces ScientistTwo, a fully autonomous multi‑agent framework that takes a scientific problem, establishes baselines, generates hypotheses, and coordinates specialized agents to conduct an end‑to‑end discovery cycle without human intervention. It rigorously tests and refines its methods through automated experiments, ablation studies, and a closed‑loop peer‑review engine. Benchmarking against top conferences (ICLR, ICML, NeurIPS) shows that ScientistTwo produces expert‑level, publishable papers and codebases that outperform human state‑of‑the‑art models and receive higher review ratings under automated AI review.

By Jaehyun Nam, Jinsung Yoon, Yanzhou Pan, Yubo Wang, Rui Meng, Parthasarathy Ranganathan, Tomas Pfister