Collective Large-scale Wind Farm Multivariate Power Output Control Based on Hierarchical Communication Multi-Agent Proximal Policy Optimization

05/17/2023
by   Yubao Zhang, et al.
0

Wind power is becoming an increasingly important source of renewable energy worldwide. However, wind farm power control faces significant challenges due to the high system complexity inherent in these farms. A novel communication-based multi-agent deep reinforcement learning large-scale wind farm multivariate control is proposed to handle this challenge and maximize power output. A wind farm multivariate power model is proposed to study the influence of wind turbines (WTs) wake on power. The multivariate model includes axial induction factor, yaw angle, and tilt angle controllable variables. The hierarchical communication multi-agent proximal policy optimization (HCMAPPO) algorithm is proposed to coordinate the multivariate large-scale wind farm continuous controls. The large-scale wind farm is divided into multiple wind turbine aggregators (WTAs), and neighboring WTAs can exchange information through hierarchical communication to maximize the wind farm power output. Simulation results demonstrate that the proposed multivariate HCMAPPO can significantly increase wind farm power output compared to the traditional PID control, coordinated model-based predictive control, and multi-agent deep deterministic policy gradient algorithm. Particularly, the HCMAPPO algorithm can be trained with the environment based on the thirteen-turbine wind farm and effectively applied to larger wind farms. At the same time, there is no significant increase in the fatigue damage of the wind turbine blade from the wake control as the wind farm scale increases. The multivariate HCMAPPO control can realize the collective large-scale wind farm maximum power output.

READ FULL TEXT

page 13

page 16

page 19

page 26

research
05/02/2023

An Improved Yaw Control Algorithm for Wind Turbines via Reinforcement Learning

Yaw misalignment, measured as the difference between the wind direction ...
research
07/03/2022

NVIF: Neighboring Variational Information Flow for Large-Scale Cooperative Multi-Agent Scenarios

Communication-based multi-agent reinforcement learning (MARL) provides i...
research
01/19/2021

Scalable Optimization for Wind Farm Control using Coordination Graphs

Wind farms are a crucial driver toward the generation of ecological and ...
research
02/27/2023

Combating Uncertainties in Wind and Distributed PV Energy Sources Using Integrated Reinforcement Learning and Time-Series Forecasting

Renewable energy sources, such as wind and solar power, are increasingly...
research
11/30/2021

The Power of Communication in a Distributed Multi-Agent System

Single-Agent (SA) Reinforcement Learning systems have shown outstanding ...
research
03/27/2022

Optimizing Airborne Wind Energy with Reinforcement Learning

Airborne Wind Energy is a lightweight technology that allows power extra...
research
05/14/2020

Continuous Multiagent Control using Collective Behavior Entropy for Large-Scale Home Energy Management

With the increasing popularity of electric vehicles, distributed energy ...

Please sign up or login with your details

Forgot password? Click here to reset