arXiv AI

When Reality Outpaces Cognition: A New Scaling Principle for Reliable Intelligence

The paper introduces the concept of the effective Speed of Coherent Cognition (S_C^{eff}) as a benchmark for how fast an AI system can adapt to changing reality while maintaining reliable behavior. It defines a challenge where systems must infer reliable actions for increasingly distant future states across a growing observation–reality gap, and tests this using reinforcement‑learning agents trained at a baseline speed of reality (S_R). The study compares Transformer and gated‑MLP baselines with a novel Co^4 architecture inspired by cellular mechanisms of conscious processing, finding that Co^4 achieves a substantially higher S_C^{eff} and thus supports the proposed scaling principle for reliable AI.

arXiv AI
Jul 7

Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning

arXiv:2607. 04681v1 Announce Type: cross Abstract: Embodied Chain-of-Thought has emerged as a promising mechanism to enhance robot decision-making and interpretability in black-box Vision-Language Action (VLA) models.

By Matthew Foutter, Matteo Cercola, Lena Wild, Yunshan Wang, Michelle Li, Daniele Gammelli, Marco Pavone
arXiv AI
Oct 2

Measuring the Stability Assumption Behind Action Chunking

The paper investigates how small action errors evolve when using action chunking in behavioural cloning. By injecting errors at each state and observing their growth under open‑loop (no replanning) and closed‑loop (replanning) regimes, the authors classify states as contracting, expanding, or unresolved. Across twelve manipulation tasks, they find that stable states are rare, error amplification is common, and that short‑horizon fitting can overestimate long‑horizon propagation. Predictors trained on camera and proprioceptive data can recover open‑loop stability but only partially capture closed‑loop dynamics, indicating that standard imitation learning does not reliably produce policies that contract errors when perturbed.

By Aryan Goyal
arXiv AI
Sep 2

Explore More, Drift Less: Outcome-Only Reinforcement Learning Can Suffice for Long-Horizon Interactive Agents

The paper proposes CANOPY, a minimalist reinforcement learning protocol that addresses two common pitfalls—signal starvation and policy drift—in outcome‑only RL for long‑horizon interactive tasks. By scaling same‑task exploration, keeping updates on‑policy, and anchoring updates with KL divergence, CANOPY enables a Qwen3‑14B agent to achieve top leaderboard results on the AppWorld coding benchmark without auxiliary supervision or elaborate scaffolding. The approach also improves performance on SWE‑bench for a Qwen3.5‑9B model.

By Liming Pu, Xiaoxia Li, Yifu Liu, Teng Cao, Bin Yang
arXiv AI
Sep 18

An Architecture for Long-Horizon Agents: Levels, Ticks and Cascaded Intelligence

The paper proposes a hierarchical architecture for long-horizon language‑model agents that must operate over days or weeks without forgetting. It introduces three key components: time‑scale levels that store bounded summaries, a clocked tick as the basic action unit, and cascaded intelligence that escalates tasks to more capable models only after review failures. A ten‑day experiment demonstrated that the agent maintained continuity across context resets, adapted its behavior based on early knowledge, and identified where learned components could be integrated.

By Erik Nijkamp, Anurag Koul, Egor Pakhomov, Bo Pang
arXiv Machine Learning
Oct 12

Dream to Remember: Continual Steering of Generalist Robot Policies with World Models

Dream to Remember (D2R) is a continual learning framework that steers a frozen generalist robot policy toward new tasks while preserving previously acquired skills. It uses a pretrained world model to rehearse past tasks through imagined rollouts, eliminating the need for replay buffers or new data. Experiments on CALVIN, LIBERO, and a real Franka robot show that D2R can learn multiple tasks sequentially—often entirely in imagination—without catastrophic forgetting, outperforming traditional fine‑tuning methods.

By Bahey Tharwat, Iman Nematollahi, Marvin Alles, Xingyuan Zhang, Akshay L Chandra, Abhinav Valada
arXiv AI
Jul 22

Intelligence from Learnable Novelty

arXiv:2607. 18433v1 Announce Type: cross Abstract: Intelligence appears under different names in different fields: as data compression in statistics and machine learning, as universal computation in dynamical systems, and as adaptive behavior in agents.

By Yanbo Zhang, Michael Levin