Building AI Research Teams for Autonomous Discovery of Linear Attention Architectures

The paper proposes a framework for building autonomous AI research teams that can discover linear attention architectures. By assembling agents with diverse disciplinary expertise, private research histories, shared experimental evidence, and adaptive allocation of research opportunities, the team can balance exploration and exploitation under limited experimental budgets. Experiments show that this design outperforms GDN2 at 1.3B scale on language modeling, common‑sense reasoning, and retrieval tasks, and that removing any single component weakens discovery.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

• agents