arXiv Machine Learning

Integrated Noise and Safety Management in UAM via A Unified Reinforcement Learning Framework

arXiv:2508. 16440v2 Announce Type: replace-cross Abstract: Urban Air Mobility (UAM) envisions the widespread use of small aerial vehicles to transform transportation in dense urban environments.

arXiv AI
Jul 3

Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation

arXiv:2607. 01794v1 Announce Type: cross Abstract: With the rapid development of autonomous aerial systems, Unmanned Aerial Vehicles (UAVs) are increasingly deployed in applications such as inspection, environmental monitoring, and rescue, creating growing demand for reliable autonomous navigation.

By Shenghui Zhang, YuXuan Gao, Songwei Zhao, Jifeng Hu, Zijing Zhang, Hechang Chen
arXiv AI
Sep 18

Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

The paper introduces a hierarchical hybrid architecture combining large language models (LLMs) and multi-agent reinforcement learning (MARL) to manage heterogeneous unmanned aerial systems in low‑altitude wireless networks (LAWNs). An outer LLM‑driven loop interprets service requirements and operator intent to reconfigure objectives and resource priorities, while an inner MARL loop executes decentralized policies under the updated game. A logistics‑monitoring case study demonstrates the framework’s ability to coordinate diverse services and adapt to changing conditions without retraining the MARL policies.

By Nguyen Duc Minh Quang, Chang Liu, Shuangyang Li, Derrick Wing Kwan Ng
arXiv Machine Learning
Aug 27

AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication

AERIS is an offline policy improvement framework for multi-UAV integrated sensing and communication (ISAC) that learns from fixed flight logs using centralized training and decentralized execution. It introduces STAR-CRDT, an offline multi-agent RL algorithm that rectifies local actions and distills trusted improvements into decentralized actors, providing an offline-support policy improvement guarantee. Experiments demonstrate that STAR-CRDT boosts the main ISAC objective return by 29.3% and improves communication sum rate, sensing pass rate, and sensing margin while reducing collision-risk events by 54.2%.

By Ziyuan Wang (Steven), Yifan Sui (Steven), Wei Wei (Steven), Wenjie Xin (Steven), Zekai Zhang (Steven), Xiangwang Hou (Steven), Xiao-Ping (Steven), Zhang
arXiv AI
Aug 19

Diffusion Models for Smarter UAVs: Decision-Making and Modeling

The paper discusses how Diffusion Models (DMs) can improve decision-making and digital modeling for Uncrewed Aerial Vehicles (UAVs). It highlights the limitations of Reinforcement Learning (RL) and Digital Twin (DT) approaches, noting that DMs learn underlying probability distributions and generate realistic patterns, thereby addressing data scarcity and enhancing modeling accuracy. Simulation results demonstrate DMs’ effectiveness in estimating neighbor velocities for a four‑UAV swarm coordination task using Deep Reinforcement Learning.

By Yousef Emami, Hao Zhou, Luis Almeida, Kai Li
arXiv AI
Aug 28

Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

The paper presents a modeling and simulation framework to study reinforcement learning (RL) control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. Using SUMO and agent-based modeling, it evaluates Deep Q-Network (DQN), Double DQN (DDQN), and Proximal Policy Optimization (PPO) algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collision rate by incorporating risk penalties. The study also shows a trade‑off between safety, joining effectiveness, and decision efficiency, and demonstrates that an external safety controller can prevent collisions but may reduce joining efficiency.

By Biao Yin, Abderrahmane Kasmi, Nadir Farhi
arXiv Machine Learning
Jul 21

Hierarchical Reinforcement Learning for Air Combat at DARPA's AlphaDogfight Trials

arXiv:2105. 00990v3 Announce Type: replace Abstract: Autonomous control in high-dimensional, continuous state spaces is a persistent and important challenge in the fields of robotics and artificial intelligence.

By Adrian P. Pope, Jaime S. Ide, Daria Micovic, Henry Diaz, David Rosenbluth, Lee Ritholtz, Jason C. Twedt, Thayne T. Walker, Kevin Alcedo, Daniel Javorsek