arXiv AI

Robust Multi-Agent Reinforcement Learning for Small UAS Separation Assurance under GPS Degradation and Spoofing

The paper presents a robust multi‑agent reinforcement learning framework for small unmanned aircraft systems (sUAS) to maintain separation assurance when GPS data is degraded or spoofed. By modeling state observation corruption as a zero‑sum game, the authors derive a closed‑form adversarial perturbation that eliminates iterative inner optimization and can be evaluated in linear time. Integrating this perturbation into a policy‑gradient MARL algorithm yields a counter‑policy that achieves near‑zero collision rates in high‑density simulations even with up to 35% observation corruption, outperforming non‑adversarial baselines.

arXiv Machine Learning
Oct 15

Adversarial Reinforcement Learning for Robust Planetary Landing

The paper presents a method for improving the robustness of deep reinforcement learning (DRL) policies used in planetary landing by employing adversarial reinforcement learning. A secondary agent generates physically constrained perturbations that challenge the landing controller, creating an asymmetric zero‑sum game. Training is conducted in three stages—baseline learning, stochastic robustness enhancement, and iterative adversarial optimization—showing that adversarial disturbances uncover vulnerabilities missed by conventional randomization and hint at better generalization to unseen perturbations.

By Miguel Leiva-V\'elez, Nicolas Gaston-Rozado, Andrea Scorsoglio, Hodei Urrutxua, V\'ictor Rodr\'iguez-Fern\'andez
arXiv Machine Learning
Sep 14

Curriculum-Based Adversarial Heterogeneous Agent Reinforcement Learning for Autonomous Quad-Copter Landing in Maritime Settings

The paper presents a curriculum‑based adversarial heterogeneous agent reinforcement learning (HARL‑AC) approach for autonomous quad‑copter landing on a ship deck in maritime settings. Using Heterogeneous‑Agent Proximal Policy Optimization (HAPPO) in NVIDIA Isaac Lab, the authors train a cooperative control policy that outperforms domain‑randomized baselines, achieving up to 97.5% success on in‑distribution sea states and higher median success and lower crash rates on out‑of‑distribution sea states. The adversarially trained policy also exhibits more cautious behavior, slightly increasing timeouts but improving safety in severe, unseen conditions.

By Allan Minh-Tam Nguyen, Sree Showrya Kotala, Stefan Banioi-Crijman, Kurt Driessens, Rico M\"ockel
arXiv Machine Learning
Oct 23

Bayesian Ambiguity Contraction-based Adaptive Robust Markov Decision Processes for Adversarial Surveillance Missions

The paper introduces an adaptive Robust Markov Decision Process framework for autonomous Intelligence, Surveillance, and Reconnaissance missions using Collaborative Combat Aircraft. It models adversarial uncertainty with finite threat prototypes and refines policies by eliminating inconsistent threat models, enabling a shift from worst‑case protection to more efficient mission strategies while preserving robustness. Experiments demonstrate higher mission rewards and fewer exposure events compared to nominal and static robust planners across various network topologies.

By Jimin Choi, Max Z. Li
arXiv AI
Oct 21

Vulnerability Analysis for Safe Multi-Agent Reinforcement

The paper examines inference‑time observation attacks on Safe Multi‑Agent Reinforcement Learning (SMARL), where an adversary perturbs observations of some agents to alter their actions. It introduces the MinMax Attack framework, which jointly selects adversarial target actions for compromised agents while considering the cooperative resistance of benign agents. The authors derive a bound on the induced safety cost and show through experiments that MinMax Attack causes higher safety costs than existing baselines while maintaining task reward, thus improving attack effectiveness and stealthiness.

By Taozheng Zhu, Shixiong Jiang, Fanxin Kong