Concept and the implementation of a tool to convert industry 4.0 environments modeled as FSM to an OpenAI Gym wrapper

06/29/2020
by   Kallil M. C. Zielinski, et al.
0

Industry 4.0 systems have a high demand for optimization in their tasks, whether to minimize cost, maximize production, or even synchronize their actuators to finish or speed up the manufacture of a product. Those challenges make industrial environments a suitable scenario to apply all modern reinforcement learning (RL) concepts. The main difficulty, however, is the lack of that industrial environments. In this way, this work presents the concept and the implementation of a tool that allows us to convert any dynamic system modeled as an FSM to the open-source Gym wrapper. After that, it is possible to employ any RL methods to optimize any desired task. In the first tests of the proposed tool, we show traditional Q-learning and Deep Q-learning methods running over two simple environments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2019

Industrial DevOps

The visions and ideas of Industry 4.0 require a profound interconnection...
research
04/14/2020

Reinforcement Learning Approach to Vibration Compensation for Dynamic Feed Drive Systems

Vibration compensation is important for many domains. For the machine to...
research
08/14/2020

OR-Gym: A Reinforcement Learning Library for Operations Research Problem

Reinforcement learning (RL) has been widely applied to game-playing and ...
research
12/05/2021

Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learning

Reinforcement Learning (RL) based solutions are being adopted in a varie...
research
11/09/2020

Challenges of Applying Deep Reinforcement Learning in Dynamic Dispatching

Dynamic dispatching aims to smartly allocate the right resources to the ...
research
06/02/2023

An Architecture for Deploying Reinforcement Learning in Industrial Environments

Industry 4.0 is driven by demands like shorter time-to-market, mass cust...
research
05/29/2019

Advantage Amplification in Slowly Evolving Latent-State Environments

Latent-state environments with long horizons, such as those faced by rec...

Please sign up or login with your details

Forgot password? Click here to reset