Distributional Reinforcement Learning for Scheduling of (Bio)chemical Production Processes

03/01/2022
by   Max Mowbray, et al.
12

Reinforcement Learning (RL) has recently received significant attention from the process systems engineering and control communities. Recent works have investigated the application of RL to identify optimal scheduling decision in the presence of uncertainty. In this work, we present a RL methodology to address precedence and disjunctive constraints as commonly imposed on production scheduling problems. This work naturally enables the optimization of risk-sensitive formulations such as the conditional value-at-risk (CVaR), which are essential in realistic scheduling processes. The proposed strategy is investigated thoroughly in a single-stage, parallel batch production environment, and benchmarked against mixed integer linear programming (MILP) strategies. We show that the policy identified by our approach is able to account for plant uncertainties in online decision-making, with expected performance comparable to existing MILP methods. Additionally, the framework gains the benefits of optimizing for risk-sensitive measures, and identifies decisions orders of magnitude faster than the most efficient optimization approaches. This promises to mitigate practical issues and ease in handling realizations of process uncertainty in the paradigm of online production scheduling.

READ FULL TEXT

page 17

page 20

research
12/30/2022

Risk-Sensitive Policy with Distributional Reinforcement Learning

Classical reinforcement learning (RL) techniques are generally concerned...
research
02/01/2017

Robust Order Scheduling in the Fashion Industry: A Multi-Objective Optimization Approach

In the fashion industry, order scheduling focuses on the assignment of p...
research
07/02/2019

Dynamic Face Video Segmentation via Reinforcement Learning

For real-time semantic video segmentation, most recent works utilise a d...
research
11/30/2022

One Risk to Rule Them All: A Risk-Sensitive Perspective on Model-Based Offline Reinforcement Learning

Offline reinforcement learning (RL) is suitable for safety-critical doma...
research
03/10/2021

A Two-stage Framework and Reinforcement Learning-based Optimization Algorithms for Complex Scheduling Problems

There hardly exists a general solver that is efficient for scheduling pr...
research
04/16/2021

Towards Standardizing Reinforcement Learning Approaches for Stochastic Production Scheduling

Recent years have seen a rise in interest in terms of using machine lear...
research
07/22/2018

Accelerated Structure-Aware Reinforcement Learning for Delay-Sensitive Energy Harvesting Wireless Sensors

We investigate an energy-harvesting wireless sensor transmitting latency...

Please sign up or login with your details

Forgot password? Click here to reset