The paper introduces CASTLE, a framework for fully decentralized multi‑agent reinforcement learning that uses two offline‑trained world models to provide in‑context guidance to independent agents. A Local Dynamics World Model captures each agent’s trajectory dynamics, while a Semantic‑Social World Model predicts short‑horizon task and social outcomes for candidate actions based on counterfactual simulator rollouts. During online learning, these frozen models supply prediction logits to an independent PPO policy, enabling agents to compare potential actions prospectively rather than relying solely on scalar rewards. CASTLE outperforms existing baselines on several multi‑particle benchmark tasks, achieving the highest mean final scores across 30 seeds.
By Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen
The paper investigates how to infer agents’ underlying incentives in strategic multi‑agent settings, where traditional inverse reinforcement learning (IRL) may fail to produce rewards that guide optimal play. It introduces the concept of strategic identifiability and shows that learning from a fixed pair of policies can be insufficient regardless of sample size. To address this, the authors propose an active IRL algorithm for two‑player repeated Stackelberg games, combining maximum‑likelihood estimation with experimental design to achieve finite‑sample guarantees on sub‑optimality, and validate the approach in an anti‑poaching scenario.
By Antoine Bergerault, Cyrille Kone, Giorgia Ramponi
arXiv:2512. 13666v2 Announce Type: replace-cross Abstract: The security and decentralization of Proof-of-Work (PoW) have been well-tested in existing blockchain systems.
By Weihang Cao, Mustafa Doger, Sennur Ulukus
Incentive programs are central to user acquisition in decentralized finance, but many reward systems rely on raw volume, transaction count, and wallet count, making them vulnerable to bots and sybil operations. We present ZAPs, a reward attribution framework that combines economic contribution scoring with adversarial robustness.
The paper introduces Hierarchical Reinforcement and Collective Learning (HRCL), a framework that combines multi‑agent reinforcement learning (MARL) with decentralized coordination. HRCL uses MARL at a high level to generate strategic guidance that limits the decision space for low‑level agents, enabling efficient short‑term coordination while considering long‑term effects. Experiments on synthetic, energy‑management, and drone‑swarm scenarios demonstrate faster convergence and significant reductions in system‑wide and individual costs compared to standalone MARL.
By Chuhao Qin, Evangelos Pournaras
arXiv:2606. 18384v1 Announce Type: new Abstract: Hierarchical Federated Learning (HFL) enables scalable collaborative model training across distributed devices while preserving data privacy.
By Seyed Salar Ghazi, Kaiwen Zhang, Mehdi feizi, Hans-Arno Jacobsen