arXiv Machine Learning

A Lyapunov Drift-Plus-Penalty Method Tailored for Reinforcement Learning with Queue Stability

arXiv:2506. 04291v2 Announce Type: replace Abstract: With the proliferation of Internet of Things (IoT) devices, the demand for addressing complex optimization challenges has intensified.

arXiv Machine Learning
Aug 24

BIPPO: Budget-Aware Independent PPO for Energy-Efficient Federated Learning Services

BIPPO (Budget-aware Independent Proximal Policy Optimization) is a multi‑agent reinforcement learning framework designed for energy‑efficient client selection in federated learning (FL) over IoT systems. It addresses infrastructure constraints such as limited resources and device churn, which traditional FL and RL approaches overlook. Evaluated on two image‑classification tasks with non‑IID data, BIPPO improves mean accuracy over non‑RL methods, standard PPO, and IPPO while consuming only a negligible portion of the budget, even as client numbers grow.

By Anna Lackinger, Andrea Morichetta, Pantelis A. Frangoudis, Schahram Dustdar
arXiv AI
Aug 20

Performance Drift Detection in Machine Learning as a Service (MLaaS) for IoT Environments

The paper introduces a framework for detecting performance drift in Machine Learning as a Service (MLaaS) tailored to Internet of Things (IoT) settings. It first builds an extraction model that learns the service’s behavior from input‑output pairs, then uses this to jointly monitor changes in data and service behavior. An adaptive temporal mechanism adjusts monitoring frequency, and experiments on real datasets show significant accuracy gains and reduced miss‑detection rates compared to baseline methods.

By Deepak Kanneganti, Sajib Mistry, Sheik Mohammad Mostakim Fattah, Erik Elmroth, Aneesh Krishna, Monowar Bhuyan
arXiv AI
Jun 17

Enhanced Evolutionary Multi-Objective Deep Reinforcement Learning for Reliable and Efficient Wireless Rechargeable Sensor Networks

arXiv:2510. 21127v2 Announce Type: replace-cross Abstract: Despite rapid advancements in sensor networks, conventional battery-powered sensor networks suffer from limited operational lifespans and frequent maintenance requirements that severely constrain their deployment in remote and inaccessible environments.

By Bowei Tong, Hui Kang, Jiahui Li, Geng Sun, Jiacheng Wang, Yaoqi Yang, Bo Xu, Dusit Niyato