arXiv Machine Learning

Fairness-Guided DQN-Based TXOP Control for NR-U/Wi-Fi Coexistence

The paper proposes a fairness‑guided deep Q‑network (DQN) to control the transmission opportunity (TXOP) of NR‑U in unlicensed spectrum, aiming to balance coexistence with Wi‑Fi. Two reward designs, Q1 and Q2, target different fairness regimes: Q1 enforces strict per‑node throughput balance, while Q2 allows a broader fairness band and rewards throughput gains within it. The DQN policies are benchmarked against 3GPP LBT, a multi‑armed‑bandit approach, utility‑fairness tabular Q‑learning, and a fixed‑TXOP baseline, with experiments across four priority classes and asymmetric populations measuring aggregate throughput, Jain fairness, and concave throughput utility.

arXiv Machine Learning
Jun 19

Utility-Aware DRL-Based TXOP Adaptation for NR-U and Wi-Fi Coexistence Networks

arXiv:2605. 00457v4 Announce Type: replace-cross Abstract: The coexistence of NR-U and Wi-Fi in the unlicensed spectrum introduces a challenging resource management problem, where heterogeneous channel access mechanisms can lead to unbalanced spectrum utilization and severe Wi-Fi performance degradation.

By Po-Heng Chou, Yi-Fang Yu, Shou-Yu Chen, Chiapin Wang
arXiv AI
Jun 4

Generalizable Multi-Task Learning for Wireless Networks Using Prompt Decision Transformers

arXiv:2606. 04328v1 Announce Type: cross Abstract: Future wireless networks demand rapid adaptation to highly heterogeneous environments and dynamic task configurations, necessitating a shift from conventional rule-based and optimization-driven radio resource management (RRM) toward artificial intelligence (AI)-driven RRM.

By Fatih Temiz, Shavbo Salehi, Melike Erol-Kantarci
arXiv Machine Learning
Oct 5

Energy Saving in 5G and Beyond Networks: A Quantum Reinforcement Learning Approach

The article proposes a Quantum Reinforcement Learning (QRL) algorithm to reduce energy consumption in 5G and beyond networks by optimizing base station (BS) operations while maintaining quality of service. QRL uses quantum principles such as superposition and entanglement via parameterized quantum circuits, achieving faster convergence than traditional Deep Reinforcement Learning (DRL) and Q‑Learning. Simulations show that QRL can significantly lower energy usage even with highly dynamic user equipment (UE) associations.

By Muhammad Usman, Nguyen Van Huynh, Marianna Lezzi, Mariangela Lazoi
arXiv Machine Learning
Aug 4

Heterogeneous Multi-Agent Reinforcement Learning for Radio Resource Management under Coupled Finite-Horizon Constraints

arXiv:2608. 01745v1 Announce Type: new Abstract: Maximizing throughput under proportional fairness in dense wireless networks requires jointly managing user association, scheduling, base station (BS) activation, and handover control under hard finite-horizon energy and handover budgets, which induces a fundamental tension between BS-side energy management and user-side handover regulation.

By Yeonseo Jeong, Wonhyeok Ko, Sungweon Hong, Songnam Hong
arXiv Machine Learning
Aug 27

FedQoS: Federated QoS-Risk Learning for Heterogeneous Indoor-Outdoor Access Selection

FedQoS is a federated learning framework that predicts future QoS failure probabilities for candidate access links in dynamic indoor‑outdoor environments, enabling reliable access‑node selection without centralizing user data. Each access node trains locally on its network logs, while a global QoS‑risk predictor is built through federated aggregation. Simulations using physics‑based synthetic datasets show that FedQoS reduces QoS‑failure rates compared to signal‑based and historical‑QoS heuristics, achieving near‑centralized performance even under non‑IID data conditions.

By Nguyen Van Thieu, Ti Ti Nguyen, Ons Aouedi, Zerihun Huruy, Vu Nguyen Ha, Symeon Chatzinotas
arXiv Machine Learning
Sep 30

Restless Bandits with Individual Penalty Constraints: Near-Optimal Indices and Deep Reinforcement Learning

This paper studies Restless Multi‑Armed Bandits with individual penalty constraints for dynamic wireless networks, allowing each arm to have distinct performance limits such as energy, activation, or age of information. It introduces the Penalty‑Optimal Whittle (POW) index, which depends only on an arm’s transition kernel and its constraints, making it computable offline and independent of system‑wide parameters. The authors prove the POW index policy is asymptotically optimal, present a deep reinforcement learning method to learn the index online, and show through simulations that it outperforms existing policies.

By Nida Zamir, I-Hong Hou
arXiv AI
Oct 7

Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization

The paper introduces a foundation model–aided actor‑critic algorithm to boost multi‑agent reinforcement learning (MARL) for optimizing random access (RA) wireless networks. By embedding a foundation model into a consensus‑based decentralized MARL framework, the authors provide convergence analysis that matches conventional MARL under local reward exchanges and nonlinear value function approximations. Numerical experiments demonstrate that this FM‑based approach markedly accelerates MARL training for RA network optimization.

By Myeung Suk Oh, Zhiyao Zhang, Alvaro Velasquez, Nathaniel D. Bastian, Jia Liu
arXiv Machine Learning
Aug 20

Multi-Agent Off-Policy Deep Reinforcement Learning for Smart Campus Coverage

The paper studies optimal placement of millimeter-wave base stations in a realistic, non-convex campus layout using deep reinforcement learning. It compares four DRL methods—single-agent DQN, multi-agent partitioned DQN, single-agent DDPG, and multi-agent partitioned DDPG—and finds that the multi-agent DDPG approach achieves full coverage, a Jain's fairness index of 0.94, and superior performance in dense scenarios with 400 users. The multi-agent DDPG also converges more efficiently than single-agent methods.

By Omar Rady, Mohamed Ayman, Ali Arafa, Mohamed Shalma