arXiv AI

Time-Lag-Aware Deep Reinforcement Learning for Flexible Job-Shop Scheduling in PPVC Module Factories

arXiv:2607. 11725v1 Announce Type: cross Abstract: Prefabricated prefinished volumetric construction moves most building work into module factories, whose production floor operates as a flexible job shop.

arXiv AI
Oct 16

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

The study evaluates six deep reinforcement learning (DRL) approaches for high‑performance computing (HPC) job scheduling, comparing Proximal Policy Optimization (PPO), Advantage Actor‑Critic (A2C), and Deep Q‑Network (DQN) with and without action masking. Across two real Slurm workload traces—one homogeneous and one heterogeneous—masked DRL treatments complete evaluation, while unmasked ones are truncated. On the heterogeneous trace, MaskablePPO outperforms baseline heuristics in all three metrics, achieving waiting times within 10% of the best heuristics and a 22% lower maximum bounded slowdown than Last‑Come, First‑Served (LCFS).

By Justin M. Cheney, Clement N. Nyirenda
arXiv AI
Jun 18

Breaking the Solver Bottleneck: Training Task Generators at the Learnable Frontier

arXiv:2606. 18284v1 Announce Type: cross Abstract: The limiting resource for training agents via reinforcement learning (RL) is increasingly frontier task supply: valid, solvable tasks just difficult enough to train the current model.

By Lorenz Wolf, Connor Watts, Roger Creus Castanyer, Geoffrey Bradway, Maxwill Lin, Augustine N. Mavor-Parker, Matthew Daborn-Sargent
arXiv AI
Jun 16

A Learning Method with Gap-Aware Generation for Heterogeneous DAG Scheduling

arXiv:2603. 23249v2 Announce Type: replace-cross Abstract: Efficient scheduling of directed acyclic graphs (DAGs) is a core problem in large-scale data-intensive computing systems, where query plans, data-processing workloads, and computation graphs consist of dependent tasks competing for limited heterogeneous resource pools.

By Ruisong Zhou, Haijun Zou, Li Zhou, Chumin Sun, Zaiwen Wen
arXiv AI
Oct 9

StoreBench: A Live-Commerce Environment for Evaluating and Training Autonomous Operator Agents

StoreBench is a live‑commerce environment where an autonomous agent runs a mid‑size online apparel store on a production‑grade backend, facing continuous customer orders, supplier price changes, and market shocks. The agent uses the same 29 merchant tools as a human operator, with a windowed operation budget that ties simulated time to actions, ensuring that model latency does not affect the simulation. Seven large language models were evaluated across 11 scenarios of 30–45 days and a full simulated year, but none matched the scripted smart‑triage policy, and human experts outperformed all models.

By Daksh Raghuvanshi, Ved Vedere, Yifan Wang
arXiv Machine Learning
Sep 23

Deep Reinforcement Learning on Item-Compatibility Graphs for One-Dimensional Bin Packing

The paper introduces a novel end‑to‑end, size‑agnostic graph reinforcement learning framework for the one‑dimensional bin packing problem (1D‑BPP). It models packing as a Markov decision process on an item‑compatibility graph, where a graph neural network actor‑critic policy learns to merge compatible partial bins. Empirical results on the BPPLIB benchmark show that the learned policy reduces the mean optimality gap of a constructive heuristic from 2.66 % to 2.31 %, performs competitively against other learned methods, and outperforms a state‑of‑the‑art learned solver on the hardest benchmark family.

By M. Asl{\i} Ayd{\i}n
arXiv AI
Aug 25

iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems

iScheduler is a reinforcement‑learning‑driven framework that tackles large‑scale Resource Investment Problems (RIP) by modeling them as a Markov decision process over decomposed subproblems and building schedules through sequential process selection. The approach speeds up optimization and allows efficient reconfiguration by reusing unchanged process schedules and only rescheduling affected processes. Using the new L‑RIPLIB benchmark, iScheduler achieves competitive resource costs while cutting time to feasibility by up to 43× compared to leading solver‑backed baselines.

By Yi-Xiang Hu, Yuke Wang, Feng Wu, Zirui Huang, Shuli Zeng, Xiang-Yang Li