Comparative analysis of machine learning methods for active flow control

02/23/2022
by   Fabio Pino, et al.
0

Machine learning frameworks such as Genetic Programming (GP) and Reinforcement Learning (RL) are gaining popularity in flow control. This work presents a comparative analysis of the two, bench-marking some of their most representative algorithms against global optimization techniques such as Bayesian Optimization (BO) and Lipschitz global optimization (LIPO). First, we review the general framework of the flow control problem, linking optimal control theory with model-free machine learning methods. Then, we test the control algorithms on three test cases. These are (1) the stabilization of a nonlinear dynamical system featuring frequency cross-talk, (2) the wave cancellation from a Burgers' flow and (3) the drag reduction in a cylinder wake flow. Although the control of these problems has been tackled in the recent literature with one method or the other, we present a comprehensive comparison to illustrate their differences in exploration versus exploitation and their balance between `model capacity' in the control law definition versus `required complexity'. We believe that such a comparison opens the path towards hybridization of the various methods, and we offer some perspective on their future development in the literature of flow control problems.

READ FULL TEXT

page 32

page 37

research
05/28/2019

A Control-Model-Based Approach for Reinforcement Learning

We consider a new form of model-based reinforcement learning methods tha...
research
03/06/2020

Reinforcement Learning for Active Flow Control in Experiments

We demonstrate experimentally the feasibility of applying reinforcement ...
research
11/11/2018

An Optimal Control View of Adversarial Machine Learning

I describe an optimal control view of adversarial machine learning, wher...
research
07/07/2022

Stochastic optimal well control in subsurface reservoirs using reinforcement learning

We present a case study of model-free reinforcement learning (RL) framew...
research
10/29/2019

Robust Model-free Reinforcement Learning with Multi-objective Bayesian Optimization

In reinforcement learning (RL), an autonomous agent learns to perform co...
research
03/13/2021

RL-Controller: a reinforcement learning framework for active structural control

To maintain structural integrity and functionality during the designed l...
research
11/01/2021

OPF-Learn: An Open-Source Framework for Creating Representative AC Optimal Power Flow Datasets

Increasing levels of renewable generation motivate a growing interest in...

Please sign up or login with your details

Forgot password? Click here to reset