arXiv Machine Learning

Pathwise Information Certificates for Decentralized Adaptive Sensing

arXiv Machine Learning
Sep 16

Adapting to Decision-Relevant Non-Stationarity in Decentralized Heterogeneous Bandits

The paper introduces Decision‑Relevant Fresh Comparison (DRFC), a method for decentralized bandit systems with heterogeneous agents whose local reward changes may not affect the global best action. DRFC gathers balanced samples from all agents and only switches the common best arm when fresh global evidence indicates a change, yielding a dynamic regret bound that does not depend on the number of local changes. An anytime‑valid sliding‑window extension further handles gradual drift, and experiments on synthetic, semi‑real, and MovieLens‑1M data demonstrate that DRFC ignores decision‑irrelevant local changes while the extension avoids false switches.

By Zhaojun Peng
arXiv AI
Aug 25

Reinforcing the World's Edge: A Continual Learning Problem in the Multi-Agent-World Boundary

The paper studies a stationary decentralized Markov game where a focal agent experiences drifting rewards and dynamics due to learning peers, framing this as an agent‑centric continual reinforcement‑learning problem. It introduces the concept of an invariant core—maximal abstract patterns common to many successful trajectories—and proves a worst‑case conditioning theorem linking trajectory‑law drift to success coverage. The authors provide theoretical guarantees for survival horizon, first‑exit law, and regret, and validate their predictions with solvable models and empirical studies in continual control, cue‑MNIST, and Level‑Based Foraging.

By Dane Malenfant
arXiv AI
Oct 31

Network Topology Does Not Matter: The Breakdown of Classical Consensus in LLM Populations

The paper shows that classical consensus theory, which relies on network topology and convex update rules, fails for large language models (LLMs). By measuring token‑level updates across eight instruction‑tuned models and 73,080 exchanges, the authors find that LLMs violate convexity, exhibit negative weights, and are driven by internal update bias rather than network structure. Simulations with 10,000 agents confirm that algebraic connectivity explains almost none of the outcome variance, leading populations to converge on confidently false claims regardless of their network topology.

By Sahil Rajesh Dhayalkar
arXiv Machine Learning
Oct 7

Independent Multi-Agent Reinforcement Learning with Counterfactual Semantic-Social World Models

The paper introduces CASTLE, a framework for fully decentralized multi‑agent reinforcement learning that uses two offline‑trained world models to provide in‑context guidance to independent agents. A Local Dynamics World Model captures each agent’s trajectory dynamics, while a Semantic‑Social World Model predicts short‑horizon task and social outcomes for candidate actions based on counterfactual simulator rollouts. During online learning, these frozen models supply prediction logits to an independent PPO policy, enabling agents to compare potential actions prospectively rather than relying solely on scalar rewards. CASTLE outperforms existing baselines on several multi‑particle benchmark tasks, achieving the highest mean final scores across 30 seeds.

By Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen
arXiv AI
Oct 2

Nous: Learning and Certifying Memory Decisions Before Source Calibration

The paper introduces Nous, a framework that separates learning, calibration, and revision certification for belief‑based agent memory. It shows that learning and certifying useful memory decisions can require quadratically fewer records than source calibration, and provides finite‑sample certificates for policy improvement without needing to recover source reliability. Experiments on MiniGrid environments demonstrate that the new certificate reliably accepts improvements over incumbents, outperforming earlier methods.

By Pranav Singh