arXiv Machine Learning

Rule-based and reinforcement-learning policies for resource allocation in a pediatric echo lab: a simulation study

The study evaluates scheduling strategies for echocardiographic exams in a pediatric echo lab, comparing on-the-fly allocation with reservation-based approaches using real operational data from Stanford’s Lucile Packard Children’s Hospital. On-the-fly allocation consistently reduces patient waiting times across all tested reservation configurations. A reinforcement‑learning model (Dueling Double DQN) was trained to approximate an optimal on-the-fly policy but did not outperform the best rule‑based on-the-fly strategy.

arXiv AI
Jul 1

Qualified Educational Capacity Planning under Heterogeneous Student Support Needs: A Synthetic Benchmark and Decision-Support Framework

arXiv:2606. 30650v1 Announce Type: cross Abstract: Educational support services often face a qualified-capacity problem: staff time is scarce, qualifications decay, new support needs can appear before anyone is prepared for them, and training consumes the same hours needed by current students.

By Carlos Eduardo Sanoja, Oscar Enrique Moreno Mayz
arXiv Machine Learning
1d ago

Do Machine Learning-Guided Proactive Full Capacity Protocols Mitigate Emergency Department Overcrowding? A Simulation-Based Evaluation

The study evaluates whether machine learning-guided proactive activation of Full Capacity Protocols (FCPs) can better control emergency department (ED) overcrowding compared to conventional reactive activation. Using a validated machine learning and discrete-event simulation framework, the authors predicted hourly waiting-room crowding six hours ahead and triggered proactive FCPs. Across a 365‑day simulation with 10 replications, proactive deployment significantly reduced the percentage of time above the crowding threshold and average protocol duration, lowered crowding variability and extreme congestion events, and produced smoother ED operations, though improvements in length of stay and wait time were not statistically significant.

By Khalid Aram, Orhun Vural, Bunyamin Ozaydin, James Booth, Abdulaziz Ahmed
arXiv AI
Oct 16

Deep Reinforcement Learning for HPC Job Scheduling: A Statistical Evaluation

The study evaluates six deep reinforcement learning (DRL) approaches for high‑performance computing (HPC) job scheduling, comparing Proximal Policy Optimization (PPO), Advantage Actor‑Critic (A2C), and Deep Q‑Network (DQN) with and without action masking. Across two real Slurm workload traces—one homogeneous and one heterogeneous—masked DRL treatments complete evaluation, while unmasked ones are truncated. On the heterogeneous trace, MaskablePPO outperforms baseline heuristics in all three metrics, achieving waiting times within 10% of the best heuristics and a 22% lower maximum bounded slowdown than Last‑Come, First‑Served (LCFS).

By Justin M. Cheney, Clement N. Nyirenda
arXiv AI
Sep 30

Physics-Informed Multi-Agent Coordination for Hospital Patient Flow Optimization

The paper introduces a Physics‑Informed Multi‑Agent Coordination framework that embeds calibrated BCMP queueing topologies into a decentralized multi‑agent reinforcement learning system for hospital patient flow. It formulates the problem as a Decentralized Partially Observable Markov Decision Process with coupled resource constraints, enabling departmental agents to negotiate patient routing and service scaling while exchanging localized action fingerprints to handle non‑stationarity. Empirical tests on MIMIC‑IV data show the approach reduces cumulative system delay compared to static Markovian models, heuristic dispatching, and independent multi‑agent baselines, all while preserving clinical safety constraints.

By Guoqing Zhang, Rafik Hadfi, Takayuki Ito
Hugging Face Trending Papers
Jul 6

Adaptive Inference Batching using Policy Gradients

Inference serving systems must balance throughput and latency under bursty, heterogeneous workloads, yet the industry standard remains static batching policies that require manual tuning and cannot adapt to shifting traffic. We investigate whether reinforcement learning (RL) can learn adaptive batching and routing policies that outperform these heuristics, training REINFORCE and PPO agents on a discrete-event simulator validated against queuing theory and production traces (Azure Functions, BurstGPT).

arXiv AI
Aug 10

ResidencyRL: Reinforcement Learning in Simulated Clinical Environments

arXiv:2608. 07418v1 Announce Type: new Abstract: In medical education, physicians convert academic knowledge into clinical expertise through residency: years of training across thousands of encounters, with diverse sources of feedback and progressively greater autonomy.

By Valentin Li\'{e}vin, Samuel Schmidgall, Tim Strother, Alex Bijamov, Akshay Goel, Anil Palepu, Chunjong Park, Vahid Balazadeh, Min Woo Sun, Marius Guerard, Justin Chen, Dave Steiner, Vikram Dhillon, Ibrahim Azar, Akhil Mehta, Nicholas Spetsieris, Shilpan Shah, Maen Abdelrahim, Amit Dahiya, Yun Liu, Katherine Chou, Yossi Matias, Avinatan Hassidim, Dale R. Webster, Quoc V. Le, Raia Hadsell, Joelle Barral, Carey Radebaugh, Aleksandra Faust, Shekoofeh Azizi, Mike Schaekermann, Po-Hsuan Cameron Chen, Tao Tu, David Racz, Lin Yang
arXiv Machine Learning
Jun 8

DOPPLER: Dual-Policy Learning for Device Assignment in Asynchronous Dataflow Graphs

arXiv:2505. 23131v2 Announce Type: replace Abstract: We study the problem of assigning operations in a dataflow graph to devices to minimize execution time in a work-conserving system, with emphasis on complex machine learning workloads.

By Xinyu Yao, Daniel Bourgeois, Abhinav Jain, Yuxin Tang, Jiawen Yao, Zhimin Ding, Arlei Silva, Chris Jermaine