Applications of Reinforcement Learning in Deregulated Power Market: A Comprehensive Review

05/07/2022
by   Ziqing Zhu, et al.
0

The increasing penetration of renewable generations, along with the deregulation and marketization of power industry, promotes the transformation of power market operation paradigms. The optimal bidding strategy and dispatching methodology under these new paradigms are prioritized concerns for both market participants and power system operators, with obstacles of uncertain characteristics, computational efficiency, as well as requirements of hyperopic decision-making. To tackle these problems, the Reinforcement Learning (RL), as an emerging machine learning technique with advantages compared with conventional optimization tools, is playing an increasingly significant role in both academia and industry. This paper presents a comprehensive review of RL applications in deregulated power market operation including bidding and dispatching strategy optimization, based on more than 150 carefully selected literatures. For each application, apart from a paradigmatic summary of generalized methodology, in-depth discussions of applicability and obstacles while deploying RL techniques are also provided. Finally, some RL techniques that have great potentiality to be deployed in bidding and dispatching problems are recommended and discussed.

READ FULL TEXT
research
01/27/2021

Reinforcement Learning for Decision-Making and Control in Power Systems: Tutorial, Review, and Vision

With large-scale integration of renewable generation and ubiquitous dist...
research
05/04/2023

How to Use Reinforcement Learning to Facilitate Future Electricity Market Design? Part 1: A Paradigmatic Theory

In face of the pressing need of decarbonization in the power sector, the...
research
09/28/2021

Reinforcement Learning for Quantitative Trading

Quantitative trading (QT), which refers to the usage of mathematical mod...
research
05/04/2023

How to Use Reinforcement Learning to Facilitate Future Electricity Market Design? Part 2: Method and Applications

This two-part paper develops a paradigmatic theory and detailed methods ...
research
02/28/2023

Parameter Optimization of LLC-Converter with multiple operation points using Reinforcement Learning

The optimization of electrical circuits is a difficult and time-consumin...
research
05/22/2022

Power and accountability in reinforcement learning applications to environmental policy

Machine learning (ML) methods already permeate environmental decision-ma...
research
06/02/2023

An Architecture for Deploying Reinforcement Learning in Industrial Environments

Industry 4.0 is driven by demands like shorter time-to-market, mass cust...

Please sign up or login with your details

Forgot password? Click here to reset