arXiv Machine Learning By Farnaz Niknia, Ping Wang

Fast-Convergent Meta-RL via Gradient-Clustered BS Sampling for Edge Caching

Read the original on arXiv Machine Learning →

The paper introduces a meta‑reinforcement learning framework for wireless edge caching that uses a shared initialization to adapt quickly to each base station (BS). Each BS runs a local PPO agent modeled as a Semi‑Markov Decision Process, while a shared meta‑policy is trained via a MAML‑style loop. To reduce the high variance of the meta‑gradient estimator caused by uniform random sampling of BSs, the authors propose gradient‑based clustering, grouping BSs by local gradient similarity and sampling proportionally from each cluster, proving that this yields a lower‑variance estimator under BS heterogeneity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 22

Personalized Federated Reinforcement Learning via Model-Agnostic Meta-Learning: Convergence of Exact and Hessian-Free Meta-Policy Gradients

arXiv:2609. 22833v1 Announce Type: new Abstract: We study personalized federated reinforcement learning, in which $n$ agents, each acting in its own Markov decision process, collaborate through a server to learn a shared MAML-style policy initialization that becomes effective for an individual agent once that agent adapts it with a single local policy-gradient step.

By Ali Beikmohammadi, Sarit Khirirat, Sindri Magn\'usson