How to Control Hydrodynamic Force on Fluidic Pinball via Deep Reinforcement Learning

by   Haodong Feng, et al.

Deep reinforcement learning (DRL) for fluidic pinball, three individually rotating cylinders in the uniform flow arranged in an equilaterally triangular configuration, can learn the efficient flow control strategies due to the validity of self-learning and data-driven state estimation for complex fluid dynamic problems. In this work, we present a DRL-based real-time feedback strategy to control the hydrodynamic force on fluidic pinball, i.e., force extremum and tracking, from cylinders' rotation. By adequately designing reward functions and encoding historical observations, and after automatic learning of thousands of iterations, the DRL-based control was shown to make reasonable and valid control decisions in nonparametric control parameter space, which is comparable to and even better than the optimal policy found through lengthy brute-force searching. Subsequently, one of these results was analyzed by a machine learning model that enabled us to shed light on the basis of decision-making and physical mechanisms of the force tracking process. The finding from this work can control hydrodynamic force on the operation of fluidic pinball system and potentially pave the way for exploring efficient active flow control strategies in other complex fluid dynamic problems.


Real-Time Model-Free Deep Reinforcement Learning for Force Control of a Series Elastic Actuator

Many state-of-the art robotic applications utilize series elastic actuat...

Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

The real power of artificial intelligence appears in reinforcement learn...

Reinforcement Learning for Active Flow Control in Experiments

We demonstrate experimentally the feasibility of applying reinforcement ...

Dynamic Feature-based Deep Reinforcement Learning for Flow Control of Circular Cylinder with Sparse Surface Pressure Sensing

This study proposes a self-learning algorithm for closed-loop cylinder w...

Optimization and passive flow control using single-step deep reinforcement learning

This research gauges the ability of deep reinforcement learning (DRL) te...

Control of a fly-mimicking flyer in complex flow using deep reinforcement learning

An integrated framework of computational fluid-structural dynamics (CFD-...

Chemotaxis of sea urchin sperm cells through deep reinforcement learning

By imitating biological microswimmers, microrobots can be designed to ac...

Please sign up or login with your details

Forgot password? Click here to reset