arXiv AI

Diffusion Models for Smarter UAVs: Decision-Making and Modeling

The paper discusses how Diffusion Models (DMs) can improve decision-making and digital modeling for Uncrewed Aerial Vehicles (UAVs). It highlights the limitations of Reinforcement Learning (RL) and Digital Twin (DT) approaches, noting that DMs learn underlying probability distributions and generate realistic patterns, thereby addressing data scarcity and enhancing modeling accuracy. Simulation results demonstrate DMs’ effectiveness in estimating neighbor velocities for a four‑UAV swarm coordination task using Deep Reinforcement Learning.

arXiv AI
Sep 11

Decision Transformer for UAV-Mounted RIS-Assisted Dynamic D2D Communications

The paper investigates UAV‑mounted reconfigurable intelligent surface (RIS) assisted device‑to‑device (D2D) communication with stochastic link activation. It models UAV motion, attitude, time‑varying Rician angles, and angle‑dependent RIS reflection, and formulates a joint optimization of UAV trajectory, attitude, and RIS phases to maximize average sum rate under mobility, energy, and hardware constraints. The authors employ deep reinforcement learning and a Decision Transformer trained on expert trajectories from multiple scenarios, showing that zero‑shot transfer outperforms direct DRL transfer and that online fine‑tuning achieves competitive performance with fewer interactions.

By Yaxuan Liu
arXiv AI
Jun 2

Digital Twin-Assisted Adaptive Multi-Agent DRL for Intelligent Spectrum and Resource Management in Open-RAN UAV-Enabled 6G Networks

arXiv:2606. 01324v1 Announce Type: cross Abstract: The evolution toward 6G wireless networks envisions a seamlessly intelligent, Open-RAN-enabled architecture where unmanned aerial vehicles (UAVs) play a pivotal role in extending coverage, enhancing resilience, and ensuring reliable connectivity for ground users deployment.

By Marwan Dhuheir, Thang X. Vu, Symeon Chatzinotas
arXiv AI
Sep 18

Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

The paper introduces a hierarchical hybrid architecture combining large language models (LLMs) and multi-agent reinforcement learning (MARL) to manage heterogeneous unmanned aerial systems in low‑altitude wireless networks (LAWNs). An outer LLM‑driven loop interprets service requirements and operator intent to reconfigure objectives and resource priorities, while an inner MARL loop executes decentralized policies under the updated game. A logistics‑monitoring case study demonstrates the framework’s ability to coordinate diverse services and adapt to changing conditions without retraining the MARL policies.

By Nguyen Duc Minh Quang, Chang Liu, Shuangyang Li, Derrick Wing Kwan Ng
arXiv Machine Learning
Aug 27

AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication

AERIS is an offline policy improvement framework for multi-UAV integrated sensing and communication (ISAC) that learns from fixed flight logs using centralized training and decentralized execution. It introduces STAR-CRDT, an offline multi-agent RL algorithm that rectifies local actions and distills trusted improvements into decentralized actors, providing an offline-support policy improvement guarantee. Experiments demonstrate that STAR-CRDT boosts the main ISAC objective return by 29.3% and improves communication sum rate, sensing pass rate, and sensing margin while reducing collision-risk events by 54.2%.

By Ziyuan Wang (Steven), Yifan Sui (Steven), Wei Wei (Steven), Wenjie Xin (Steven), Zekai Zhang (Steven), Xiangwang Hou (Steven), Xiao-Ping (Steven), Zhang
arXiv AI
Aug 28

Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

The paper presents a modeling and simulation framework to study reinforcement learning (RL) control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. Using SUMO and agent-based modeling, it evaluates Deep Q-Network (DQN), Double DQN (DDQN), and Proximal Policy Optimization (PPO) algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collision rate by incorporating risk penalties. The study also shows a trade‑off between safety, joining effectiveness, and decision efficiency, and demonstrates that an external safety controller can prevent collisions but may reduce joining efficiency.

By Biao Yin, Abderrahmane Kasmi, Nadir Farhi