Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number

06/16/2021
by   Francesco Borra, et al.
0

Aquatic organisms can use hydrodynamic cues to navigate, find their preys and escape from predators. We consider a model of two competing microswimmers engaged in a pursue-evasion task while immersed in a low-Reynolds-number environment. The players have limited abilities: they can only sense hydrodynamic disturbances, which provide some cue about the opponent's position, and perform simple manoeuvres. The goal of the pursuer is to capturethe evader in the shortest possible time. Conversely the evader aims at deferring capture as much as possible. We show that by means of Reinforcement Learning the players find efficient and physically explainable strategies which non-trivially exploit the hydrodynamic environment. This Letter offers a proof-of-concept for the use of Reinforcement Learning to discover prey-predator strategies in aquatic environments, with potential applications to underwater robotics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2022

Finding the optimal human strategy for Wordle using maximum correct letter probabilities and reinforcement learning

Wordle is an online word puzzle game that gained viral popularity in Jan...
research
08/05/2021

Memory-two strategies forming symmetric mutual reinforcement learning equilibrium in repeated prisoner's dilemma game

We investigate symmetric equilibria of mutual reinforcement learning whe...
research
09/29/2021

Untangling Braids with Multi-agent Q-Learning

We use reinforcement learning to tackle the problem of untangling braids...
research
01/28/2021

Symmetric equilibrium of multi-agent reinforcement learning in repeated prisoner's dilemma

We investigate the repeated prisoner's dilemma game where both players a...
research
09/26/2018

3D Pursuit-Evasion for AUVs

In this paper, we consider the problem of pursuit-evasion using multiple...
research
11/24/2020

A reinforcement learning control approach for underwater manipulation under position and torque constraints

In marine operations underwater manipulators play a primordial role. How...

Please sign up or login with your details

Forgot password? Click here to reset