arXiv AI

Reinforcement Learning-Based Production Scheduling in an Industry-Based Coating Scenario Using the Digital Model Playground

arXiv:2608. 14122v1 Announce Type: new Abstract: Production scheduling in complex manufacturing environments is challenging when sequence-dependent setup times, stochastic disturbances, and due-date constraints must be addressed simultaneously.

arXiv AI
5d ago

PORL: Pretrained Offline Reinforcement Learning for the Job Shop Scheduling Problem

The paper introduces PORL, a hybrid method that first trains a general scheduling policy through online reinforcement learning in simulation, then fine‑tunes it offline on production data using a KL‑divergence constraint to limit policy drift. PORL is evaluated on Job Shop Scheduling Problem instances with distribution shifts and various data sources, consistently outperforming standalone offline RL and other baselines, especially when offline data quality is low. The results suggest that offline adaptation of pretrained policies can improve industrial scheduling when direct online exploration is impractical.

By Mateo Toro Diz, Jonathan Hoss, Noah Klarmann
arXiv AI
Jul 7

A Sliding-Window-Based Reinforcement Learning for Dynamic Assembly Flow Shop Scheduling with Multi-Product Delivery

arXiv:2607. 02941v1 Announce Type: new Abstract: Multi-product kitting delivery imposes significant challenges for real-time scheduling in hybrid manufacturing systems that integrate processing and assembly, as dynamic order arrivals simultaneously alter supply dependencies and the set of feasible job-machine assignments.

By Junhao Qiu, Jianjun Liu, Ting Liu, Rongjie Liao, Zhantao Li, Qingfu Zhang
arXiv Machine Learning
Sep 11

Distributed Optimization of Modular Production Systems using Model-based Reinforcement Learning with Inverse Models

The paper introduces a data‑driven self‑learning control method for highly flexible, modular manufacturing systems. It uses a model‑based reinforcement learning framework that incorporates approximate inverse process models, separating actuation dynamics from state‑space dynamics so that training occurs only in task space. A lightweight feedforward architecture for these inverse models is integrated into standard RL policy networks and tested on a laboratory modular production testbed, showing improved performance and faster training, especially for off‑policy algorithms.

By Andreas Schwung, Steve Yuwono, Sofiene Lassoued, Dorothea Schwung
arXiv AI
Sep 17

Variational Approach for Job Shop Scheduling

The paper introduces Variational Graph-to-Scheduler (VG2S), a framework that applies variational inference to the Job Shop Scheduling Problem (JSSP). By decoupling representation learning from policy optimization using a variational graph encoder and an ELBO-based objective, VG2S improves training stability and robustness to hyperparameter changes. Experiments show that VG2S outperforms state‑of‑the‑art deep reinforcement learning baselines and traditional dispatching rules, especially on large‑scale benchmark instances such as DMU and SWV.

By Seung Heon Oh, Jiwon Baek, Hyunjin Oh, Kiyoung Cho, Heechang Yoon, Jong Hun Woo
arXiv Machine Learning
Sep 22

Autonomous Model Lifecycle Management for Digital Twin-Based Manufacturing Control

The paper introduces a closed‑loop cyber‑physical system for autonomous model lifecycle management in automotive manufacturing, deployed since 2023. It manages paired physics and reinforcement‑learning models, selecting the best candidate through competitive retraining cycles and a Conductor orchestrator that handles plant‑wide inventories and fallback controls. The system incorporates an operator‑trust gate that rejects 23% of policies that deviate from established practice, achieving 28‑45% process stability improvements with no safety incidents.

By Zhengyang (Cissy), Gu, Thomas Cook, Fredaljohn Rohrbaugh, Joseph E. Hernandez, Chris Couch
arXiv AI
Jun 11

Generalizing Beyond Suboptimality: Offline Reinforcement Learning Learns Effective Scheduling through Random Solutions

arXiv:2509. 10303v2 Announce Type: replace-cross Abstract: Online reinforcement learning (RL) approaches have demonstrated strong performance on Job Shop Scheduling (JSP) and Flexible JSP (FJSP) problems by learning scheduling policies through direct interaction with simulated environments.

By Jesse van Remmerden, Zaharah Bukhsh, Yingqian Zhang
arXiv Machine Learning
Sep 22

Augmenting PID Control with Deep Reinforcement Learning: A Hybrid Approach to the Industrial Benchmark

The paper proposes a hybrid PID–Deep Reinforcement Learning (DRL) controller for industrial processes, addressing the limitations of traditional PID controllers in complex, non‑linear, multi‑input environments. Using the Industrial Benchmark (IB) to test DRL, the authors develop a multi‑objective reward function and employ a TD3 agent to discover optimal settings for the IB’s ‘Gain’ and ‘Shift’ parameters. These parameters are then fed into a tuned PID controller, yielding a system that combines the optimal performance and efficiency of DRL with the reliability of classical control.

By Zhengyang (Cissy), Gu, Joseph E. Hernandez, John Burtenshaw, Sean Scott, Thomas Cook, Chris Couch