Reinforcement Learning Based Gasoline Blending Optimization: Achieving More Efficient Nonlinear Online Blending of Fuels

09/06/2023
by   Muyi Huang, et al.
0

The online optimization of gasoline blending benefits refinery economies. However, the nonlinear blending mechanism, the oil property fluctuations, and the blending model mismatch bring difficulties to the optimization. To solve the above issues, this paper proposes a novel online optimization method based on deep reinforcement learning algorithm (DRL). The Markov decision process (MDP) expression are given considering a practical gasoline blending system. Then, the environment simulator of gasoline blending process is established based on the MDP expression and the one-year measurement data of a real-world refinery. The soft actor-critic (SAC) DRL algorithm is applied to improve the DRL agent policy by using the data obtained from the interaction between DRL agent and environment simulator. Compared with a traditional method, the proposed method has better economic performance. Meanwhile, it is more robust under property fluctuations and component oil switching. Furthermore, the proposed method maintains performance by automatically adapting to system drift.

READ FULL TEXT

page 20

page 24

research
03/30/2022

One-Step Two-Critic Deep Reinforcement Learning for Inverter-based Volt-Var Control in Active Distribution Networks

A one-step two-critic deep reinforcement learning (OSTC-DRL) approach fo...
research
04/05/2018

A Human Mixed Strategy Approach to Deep Reinforcement Learning

In 2015, Google's DeepMind announced an advancement in creating an auton...
research
04/09/2020

Deep Reinforcement Learning (DRL): Another Perspective for Unsupervised Wireless Localization

Location is key to spatialize internet-of-things (IoT) data. However, it...
research
11/05/2018

Managing engineering systems with large state and action spaces through deep reinforcement learning

Decision-making for engineering systems can be efficiently formulated as...
research
08/11/2020

An Intelligent Control Strategy for buck DC-DC Converter via Deep Reinforcement Learning

As a typical switching power supply, the DC-DC converter has been widely...
research
07/27/2022

SAC-AP: Soft Actor Critic based Deep Reinforcement Learning for Alert Prioritization

Intrusion detection systems (IDS) generate a large number of false alert...
research
12/14/2020

A Reinforcement Learning Formulation of the Lyapunov Optimization: Application to Edge Computing Systems with Queue Stability

In this paper, a deep reinforcement learning (DRL)-based approach to the...

Please sign up or login with your details

Forgot password? Click here to reset