arXiv AI
Oct 16

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

The study evaluates six deep reinforcement learning (DRL) approaches for high‑performance computing (HPC) job scheduling, comparing Proximal Policy Optimization (PPO), Advantage Actor‑Critic (A2C), and Deep Q‑Network (DQN) with and without action masking. Across two real Slurm workload traces—one homogeneous and one heterogeneous—masked DRL treatments complete evaluation, while unmasked ones are truncated. On the heterogeneous trace, MaskablePPO outperforms baseline heuristics in all three metrics, achieving waiting times within 10% of the best heuristics and a 22% lower maximum bounded slowdown than Last‑Come, First‑Served (LCFS).

By Justin M. Cheney, Clement N. Nyirenda
arXiv AI
Oct 9

StoreBench: A Live-Commerce Environment for Evaluating and Training Autonomous Operator Agents

StoreBench is a live‑commerce environment where an autonomous agent runs a mid‑size online apparel store on a production‑grade backend, facing continuous customer orders, supplier price changes, and market shocks. The agent uses the same 29 merchant tools as a human operator, with a windowed operation budget that ties simulated time to actions, ensuring that model latency does not affect the simulation. Seven large language models were evaluated across 11 scenarios of 30–45 days and a full simulated year, but none matched the scripted smart‑triage policy, and human experts outperformed all models.

By Daksh Raghuvanshi, Ved Vedere, Yifan Wang
arXiv AI
Oct 9

Learning How to Search for Plans with Exponentially Less Space

The paper introduces a method for learning search control policies that dramatically reduce the space required for heuristic plan search. By using an indexical policy with registers and a special choose rule, the approach ensures that every execution is bounded polynomially in the number of objects, allowing a depth‑first procedure to find plans in polynomial space. The learned policies, obtained via a language‑model guided counterexample loop, successfully solve 1,709 of 1,890 IPC 2023 Learning Track tasks and the Autoscale Agile suite, outperforming state‑of‑the‑art planners such as LAMA, BFWS, and Levitron.

By Dominik Drexler, Simon St{\aa}hlberg, Markus Fritzsche, Blai Bonet