arXiv Machine Learning By Dang-Dung Vu

Sense Once, Serve Many: Common-Trace Factorized Constrained PPO for Online Sensing-Session Consolidation in Multi-Tenant ISAC Networks

Read the original on arXiv Machine Learning →

The paper introduces Common-Trace Factorized Constrained Proximal Policy Optimization (CT‑PPO) for optimizing online sensing‑session consolidation in multi‑tenant integrated sensing and communication (ISAC) networks. By formulating the problem as a constrained Markov decision process, CT‑PPO shares workload traces across stochastic policy replicas and uses leave‑one‑out discounted Monte Carlo returns to credit applicable actor factors, achieving higher macro returns and lower sensing‑resource costs than baseline methods. Ablation studies show that the common‑trace reward credit is the key contributor to performance gains, and the algorithm retains advantages across varying arrival loads without increasing deployment latency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 2

VERA: Verifiable Feasibility Representations with Counterfactual Credit for Constrained Multi-Agent Control

VERA is a centralized‑training, decentralized‑execution framework for constrained multi‑agent control that separates feasibility estimation from credit assignment. Each actor predicts a five‑dimensional verifiable feasibility representation (VFR), which is supervised by exact action‑conditioned margins during training and ranked by a counterfactual group‑relative advantage (CGRA). In a dynamic space‑air‑ground integrated network, VERA achieves over 55% success with minimal coverage violation, outperforming baselines by up to 8.74 percentage points and reducing violations by more than 50%.

By Bo Yin, Dongbo Li, Hongkai Chen, Jie Liu, Guoliang Xing
arXiv Machine Learning
Aug 11

CODS: Iterative Bellman-Residual Data Selection for Reusable Offline Reinforcement Learning

arXiv:2608. 07719v1 Announce Type: new Abstract: Offline reinforcement learning repeatedly trains policies from a fixed transition pool, making redundant data costly across seeds and hyperparameters, while naive subsampling can remove rare transitions needed for long-horizon credit assignment.

By Ibne Farabi Shihab, Sanjeda Akter, Abu Sa-Adat Mohamed Moon-Im Al Ahsan, Md Najmus Swaqeeb, Anuj Sharma