Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

07/22/2023
by   Kamyar Dobakhti, et al.
0

The real power of artificial intelligence appears in reinforcement learning, which is computationally and physically more sophisticated due to its dynamic nature. Rotation and injection have been a proven way of active flow control to reduce the drag force exerted on blunt bodies. Rotation will be added to the cylinder alongside the deep reinforcement learning (DRL) algorithm, which uses multiple controlled jets to reach maximum possible drag suppression. Characteristics of the DRL code, including controlling parameters, their limitations, and optimization of the DRL network for use with rotation will be presented. This work will focus on optimizing the number and positions of the jets, sensors location, and maximum allowed flow rate to jets in the form of maximum allowed flow rate of each actuation and the total number of them per episode. It is found that combining the rotation with the DRL tools is promising, since it suppresses the vortex shedding, stabilizes the Karman vortex street, and reduces the drag coefficient by up to 49.75 be showed that having more sensors at more locations is not always a good choice and the sensor number and location should be determined based on the need of the user and corresponding configuration. Also, allowing the agent to have access to higher flow rates, mostly reduces the performance, except when the cylinder rotates. In all cases, the agent can keep the lift coefficient at a value near zero, or stabilize it at a smaller number.

READ FULL TEXT

page 12

page 15

page 16

research
07/05/2023

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

This study proposes a self-learning algorithm for closed-loop cylinder w...
research
04/23/2023

How to Control Hydrodynamic Force on Fluidic Pinball via Deep Reinforcement Learning

Deep reinforcement learning (DRL) for fluidic pinball, three individuall...
research
09/04/2023

Active flow control for three-dimensional cylinders through deep reinforcement learning

This paper presents for the first time successful results of active flow...
research
06/29/2019

On Training Flexible Robots using Deep Reinforcement Learning

The use of robotics in controlled environments has flourished over the l...
research
05/30/2021

Reducing the Deployment-Time Inference Control Costs of Deep Reinforcement Learning Agents via an Asymmetric Architecture

Deep reinforcement learning (DRL) has been demonstrated to provide promi...
research
04/05/2023

Effective control of two-dimensional Rayleigh–Bénard convection: invariant multi-agent reinforcement learning is all you need

Rayleigh-Bénard convection (RBC) is a recurrent phenomenon in several in...
research
07/15/2021

Deep Reinforcement Learning based Dynamic Optimization of Bus Timetable

Bus timetable optimization is a key issue to reduce operational cost of ...

Please sign up or login with your details

Forgot password? Click here to reset