SMPL: Simulated Industrial Manufacturing and Process Control Learning Environments

06/17/2022
by   Mohan Zhang, et al.
0

Traditional biological and pharmaceutical manufacturing plants are controlled by human workers or pre-defined thresholds. Modernized factories have advanced process control algorithms such as model predictive control (MPC). However, there is little exploration of applying deep reinforcement learning to control manufacturing plants. One of the reasons is the lack of high fidelity simulations and standard APIs for benchmarking. To bridge this gap, we develop an easy-to-use library that includes five high-fidelity simulation environments: BeerFMTEnv, ReactorEnv, AtropineEnv, PenSimEnv and mAbEnv, which cover a wide range of manufacturing processes. We build these environments on published dynamics models. Furthermore, we benchmark online and offline, model-based and model-free reinforcement learning algorithms for comparisons of follow-up research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/18/2018

Model-Free Adaptive Optimal Control of Sequential Manufacturing Processes using Reinforcement Learning

A self-learning optimal control algorithm for sequential manufacturing p...
research
09/17/2023

MFRL-BI: Design of a Model-free Reinforcement Learning Process Control Scheme by Using Bayesian Inference

Design of process control scheme is critical for quality assurance to re...
research
08/18/2023

Reduced Order Modeling of a MOOSE-based Advanced Manufacturing Model with Operator Learning

Advanced Manufacturing (AM) has gained significant interest in the nucle...
research
06/09/2023

Data-Link: High Fidelity Manufacturing Datasets for Model2Real Transfer under Industrial Settings

High-fidelity datasets play a pivotal role in imbuing simulators with re...
research
02/27/2020

Reinforcement Learning Based Compensation Methods for Robot Manipulators

Smart robotics will be a core feature while migrating from Industry 3.0 ...
research
07/04/2023

Capturing Local Temperature Evolution during Additive Manufacturing through Fourier Neural Operators

High-fidelity, data-driven models that can quickly simulate thermal beha...
research
07/03/2019

Benchmarking Model-Based Reinforcement Learning

Model-based reinforcement learning (MBRL) is widely seen as having the p...

Please sign up or login with your details

Forgot password? Click here to reset