arXiv Machine Learning

Securing Autonomous Vehicle Systems via Twin-Aware Federated Reinforcement Learning

arXiv:2607. 08137v1 Announce Type: cross Abstract: Federated reinforcement learning (FRL) is crucial for enabling collaborative learning across multiple agents without sharing raw data, thereby enhancing privacy and scalability in the decision-making process within dynamic vehicular environments.

arXiv AI
Aug 12

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.

By Xincong Hu (Nanjing University), Lei Ou (Nanjing University), Maosen Li (Yinwang Intelligent Technology Co., Ltd), Jingtao Zhang (Yinwang Intelligent Technology Co., Ltd), Liguo Hou (Yinwang Intelligent Technology Co., Ltd), Zongzhang Zhang (Nanjing University)
arXiv AI
Aug 25

Robust Multi-Agent Reinforcement Learning for Small UAS Separation Assurance under GPS Degradation and Spoofing

The paper presents a robust multi‑agent reinforcement learning framework for small unmanned aircraft systems (sUAS) to maintain separation assurance when GPS data is degraded or spoofed. By modeling state observation corruption as a zero‑sum game, the authors derive a closed‑form adversarial perturbation that eliminates iterative inner optimization and can be evaluated in linear time. Integrating this perturbation into a policy‑gradient MARL algorithm yields a counter‑policy that achieves near‑zero collision rates in high‑density simulations even with up to 35% observation corruption, outperforming non‑adversarial baselines.

By Alex Zongo, Filippos Fotiadis, Ufuk Topcu, Peng Wei
arXiv AI
Jun 10

Robust Deep Reinforcement Learning Through Adversarial Attacks and Training : A Survey

arXiv:2403. 00420v3 Announce Type: replace-cross Abstract: Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments.

By Lucas Schott, Josephine Delas, Hatem Hajri, Elies Gherbi, Reda Yaich, Nora Boulahia-Cuppens, Frederic Cuppens, Sylvain Lamprier
Hugging Face Trending Papers
Aug 4

Robust and Personalized Federated Learning for Aircraft-Engine Prognostics under Benign and Adversarial Client Heterogeneity

Federated learning (FL) enables aircraft fleet operators to jointly train remaining-useful-life (RUL) models from engine sensor telemetry without sharing raw data. This study examines two complementary challenges: benign heterogeneity, where honest operators observe different operating conditions and fault modes, and adversarial heterogeneity, where compromised operators submit poisoned updates.

arXiv Machine Learning
Sep 25

Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities

The paper reviews the state of robustness in Federated Learning (FL), highlighting its vulnerability to performance degradation, data theft, and aggregation attacks. It presents a comprehensive framework that includes a threat-centric view of attack surfaces, a taxonomy of robust aggregation methods (distinguishing outcome‑centric from security‑centric approaches), and a layered taxonomy of defensive strategies. The authors also scrutinize current evaluation practices and outline key applications and open research challenges to steer future work.

By Pravija Raj P V, Ashish Gupta, Andrea Augello, Sajal K. Das
arXiv AI
Sep 4

Temperature Scaling Attack Disrupting Model Confidence in Federated Learning

The paper introduces the Temperature Scaling Attack (TSA), a training‑time method that degrades model confidence calibration while keeping predictive accuracy largely intact. TSA injects temperature scaling with a learning‑rate coupling during local federated training, shifting confidence scores and causing significant calibration errors (e.g., a 145% increase on CIFAR‑100) with less than a 2% drop in accuracy. The authors provide a convergence analysis for non‑IID settings and demonstrate TSA’s effectiveness across three benchmarks, robust aggregation, and post‑hoc calibration defenses, highlighting its impact on mission‑critical systems such as healthcare verification and autonomous driving.

By Kichang Lee, Jaeho Jin, JaeYeon Park, Songkuk Kim, JeongGil Ko