An Architecture for Deploying Reinforcement Learning in Industrial Environments

06/02/2023

∙

Industry 4.0 is driven by demands like shorter time-to-market, mass customization of products, and batch size one production. Reinforcement Learning (RL), a machine learning paradigm shown to possess a great potential in improving and surpassing human level performance in numerous complex tasks, allows coping with the mentioned demands. In this paper, we present an OPC UA based Operational Technology (OT)-aware RL architecture, which extends the standard RL setting, combining it with the setting of digital twins. Moreover, we define an OPC UA information model allowing for a generalized plug-and-play like approach for exchanging the RL agent used. In conclusion, we demonstrate and evaluate the architecture, by creating a proof of concept. By means of solving a toy example, we show that this architecture can be used to determine the optimal policy using a real control system.

READ FULL TEXT

An Architecture for Deploying Reinforcement Learning in Industrial Environments

A Modular Test Bed for Reinforcement Learning Incorporation into Industrial Applications

Value Driven Representation for Human-in-the-Loop Reinforcement Learning

A Reinforcement Learning-based Volt-VAR Control Dataset and Testing Environment

Reinforcement Learning for UAV control with Policy and Reward Shaping

Semi-analytical Industrial Cooling System Model for Reinforcement Learning

Applications of Reinforcement Learning in Deregulated Power Market: A Comprehensive Review

Concept and the implementation of a tool to convert industry 4.0 environments modeled as FSM to an OpenAI Gym wrapper

An Architecture for Deploying Reinforcement Learning in Industrial Environments

Related Research

A Modular Test Bed for Reinforcement Learning Incorporation into Industrial Applications

Value Driven Representation for Human-in-the-Loop Reinforcement Learning

A Reinforcement Learning-based Volt-VAR Control Dataset and Testing Environment

Reinforcement Learning for UAV control with Policy and Reward Shaping

Semi-analytical Industrial Cooling System Model for Reinforcement Learning

Applications of Reinforcement Learning in Deregulated Power Market: A Comprehensive Review

Concept and the implementation of a tool to convert industry 4.0 environments modeled as FSM to an OpenAI Gym wrapper