arXiv AI By Justin M. Cheney, Clement N. Nyirenda

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

Read the original on arXiv AI →

The study evaluates six deep reinforcement learning (DRL) approaches for high‑performance computing (HPC) job scheduling, comparing Proximal Policy Optimization (PPO), Advantage Actor‑Critic (A2C), and Deep Q‑Network (DQN) with and without action masking. Across two real Slurm workload traces—one homogeneous and one heterogeneous—masked DRL treatments complete evaluation, while unmasked ones are truncated. On the heterogeneous trace, MaskablePPO outperforms baseline heuristics in all three metrics, achieving waiting times within 10% of the best heuristics and a 22% lower maximum bounded slowdown than Last‑Come, First‑Served (LCFS).

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 11

When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control

arXiv:2605. 26418v2 Announce Type: replace-cross Abstract: A properly calibrated rule-based autoscaler can beat every one of six mainstream deep reinforcement learning (DRL) algorithms on cost across every workload we test - so when, if ever, does DRL actually help?

By Guilin Zhang, Chuanyi Sun, Kai Zhao, Shahryar Sarkani, John Fossaceca
arXiv AI
Jun 11

Generalizing Beyond Suboptimality: Offline Reinforcement Learning Learns Effective Scheduling through Random Solutions

arXiv:2509. 10303v2 Announce Type: replace-cross Abstract: Online reinforcement learning (RL) approaches have demonstrated strong performance on Job Shop Scheduling (JSP) and Flexible JSP (FJSP) problems by learning scheduling policies through direct interaction with simulated environments.

By Jesse van Remmerden, Zaharah Bukhsh, Yingqian Zhang
arXiv AI
Oct 9

On the Clock: Towards Punctual and Productive Time-Budgeted AI Agents

The paper investigates whether small large language model agents can operate within explicit wall‑clock time budgets while using the allotted time productively. Experiments with Qwen3.6‑27B on MLE‑Bench Lite and Qwen3‑4B on Zork I show that agents fail to translate budget statements into controlled time use, largely due to lack of timing feedback and poor anticipation of action durations. Interventions such as harness‑based timing exposure, enforcement hooks, and reinforcement learning with budget‑aware rewards improve budget adherence but do not lead to better task performance, revealing a persistent gap between respecting time limits and effectively allocating extra time.

By Aaron Wang, Neelabh Madan, Vlad Sobal, Matthew Trager, Michael Kleinman, Elman Mansimov, Wei Xia, Stefano Soatto