arXiv AI

Another Blueprint In The Wall: How to Ask Frontier AI Like a Kid?

The paper reports experiments with six frontier AI models from OpenAI, Anthropic, xAI, and Google DeepMind, using ten independent sessions per model type and a three‑stage prompt sequence that shifts from architectural preference to a full ASCII backbone. Under a school‑audience framing, responses consistently converged on a shared architectural pattern featuring persistent latent state, adaptive computation, memory, specialist routing, verification, stopping control, and delayed decoding, while removing the framing led to more heterogeneous results. A notable observation is the close overlap between GPT‑5.6 Sol’s elaborate successor architecture and GPT‑6 Astra’s independently sketched design, raising questions about shared design priors or independent convergence.

arXiv AI
Aug 26

The Empire, Long Divided, Must Unite: Architectural Convergence in Three LLM Agent Harnesses

The paper examines three open-source agent harnesses—LangChain’s deepagents, Earendil’s pi, and DeepSeek’s dsh—each built from contrasting design philosophies. By analyzing their source code and commit histories, the authors find that the mature harnesses converge on five common architectural elements: a commoditized loop, an append‑only replayable session record, model quirks stored as data, progressive disclosure of context, and explicit extension seams. A fourth harness, used as a held‑out check, also displays all five elements and even reuses another’s implementation, indicating that convergence arises from parallel discovery, diffusion, and literal reuse rather than independent invention. The study notes a missing dimension—external verifiability via a tamper‑evident record—highlighting a future axis for provenance‑sensitive domains.

By Dai Jiahong
Hugging Face Trending Papers
Aug 3

Long-Horizon Autonomous Architecture Research with a Language-Model Agent: A Behavioural Case Study

We study what happens when a single general-purpose large language model acts as the sole researcher on a long-horizon neural architecture design problem. The agent receives a scientific question, an initial hypothesis and motivation, a compute budget, and research affordances (source and experiment management, experiment tracking, literature access, and persistent memory), then autonomously proposes, implements, evaluates, and records experiments over an extended period.

arXiv AI
Jun 4

The Biomimetic Architecture of Software 4.0

arXiv:2606. 04025v1 Announce Type: cross Abstract: Dominant programming paradigms inherit an execution model optimised for a bygone era of a single human mind instructing a local machine, leaving contemporary systems burdened with historical path dependencies.

By Philip Sheldrake, Dirk Scheffler
arXiv AI
Jul 8

From Application-Layer Simulation to Native Meta-Architecture: Structural Tension as an Endogenous Driver for Heterogeneous AI Evolution

arXiv:2607. 06269v1 Announce Type: new Abstract: Current large language models (LLMs) are fundamentally stateless: their behavior is fully determined by input at inference time, and any higher-order cognitive architecture must be simulated at the application layer through prompt engineering and context management.

By Heting Mao
arXiv AI
4d ago

Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning

The paper introduces agentic meta‑reasoning, a structured inference‑time framework that explicitly manages control decisions—such as selecting partial work, restarting, or stopping—during long‑horizon agentic tasks. By delegating task execution to workers and consolidating decisions through a lightweight controller that references persistent memory, the method reduces the need to replay full histories. Experiments on ProgramBench and other benchmarks show that meta‑reasoning improves performance over direct control baselines, especially as computation budgets increase, and reveals greater reuse of earlier work and higher solution coverage.

By Paras Dahal, Anton Bakhtin, Taco Cohen, Zhengxing Chen, Carole-Jean Wu, Rob Fergus, Scott Yih, Gabriel Synnaeve, Ruslan Salakhutdinov, Sanjeev Arora, Jason Weston, Anirudh Goyal
arXiv AI
Sep 7

Substrate-Aware AI Agents: Execution Context as a First-Class Input

The paper introduces the concept of substrate blindness, where AI agents lack execution context in their planning. By providing a 128 MB RAM and 10 s wall‑time contract to large language models, the authors show that agents generate code that uses less memory, runs faster, and incorporates structural changes such as bounded blocking and in‑place buffers. Across three leading models, contract disclosure improved resource usage and correctness, demonstrating that minimal execution contracts can guide agents to produce more efficient programs.

By Manu Agrawal