Deep Reinforcement Learning for a Two-Echelon Supply Chain with Seasonal Demand

04/20/2022
by   Francesco Stranieri, et al.
0

This paper leverages recent developments in reinforcement learning and deep learning to solve the supply chain inventory management problem, a complex sequential decision-making problem consisting of determining the optimal quantity of products to produce and ship to different warehouses over a given time horizon. A mathematical formulation of the stochastic two-echelon supply chain environment is given, which allows an arbitrary number of warehouses and product types to be managed. Additionally, an open-source library that interfaces with deep reinforcement learning algorithms is developed and made publicly available for solving the inventory management problem. Performances achieved by state-of-the-art deep reinforcement learning algorithms are compared through a rich set of numerical experiments on synthetically generated data. The experimental plan is designed and performed, including different structures, topologies, demands, capacities, and costs of the supply chain. Results show that the PPO algorithm adapts very well to different characteristics of the environment. The VPG algorithm almost always converges to a local maximum, even if it typically achieves an acceptable performance level. Finally, A3C is the fastest algorithm, but just like the VPG, it never achieves the best performance when compared to PPO. In conclusion, numerical experiments show that deep reinforcement learning performs consistently better than standard inventory management strategies, such as the static (s, Q)-policy. Thus, it can be considered a practical and effective option for solving real-world instances of the stochastic two-echelon supply chain problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/03/2023

MARLIM: Multi-Agent Reinforcement Learning for Inventory Management

Maintaining a balance between the supply and demand of products by optim...
research
06/07/2020

Reinforcement Learning for Multi-Product Multi-Node Inventory Management in Supply Chains

This paper describes the application of reinforcement learning (RL) to m...
research
04/28/2022

Learning General Inventory Management Policy for Large Supply Chain Network

Inventory management in warehouses directly affects profits made by manu...
research
03/18/2023

Interpretable Reinforcement Learning via Neural Additive Models for Inventory Management

The COVID-19 pandemic has highlighted the importance of supply chains an...
research
12/04/2021

Math Programming based Reinforcement Learning for Multi-Echelon Inventory Management

Reinforcement learning has lead to considerable break-throughs in divers...
research
01/12/2022

Multi-echelon Supply Chains with Uncertain Seasonal Demands and Lead Times Using Deep Reinforcement Learning

We address the problem of production planning and distribution in multi-...
research
04/27/2021

Implementing Reinforcement Learning Algorithms in Retail Supply Chains with OpenAI Gym Toolkit

From cutting costs to improving customer experience, forecasting is the ...

Please sign up or login with your details

Forgot password? Click here to reset