Robot motor learning shows emergence of frequency-modulated, robust swimming with an invariant Strouhal-number

07/17/2023
by   Hankun Deng, et al.
0

Fish locomotion emerges from a diversity of interactions among deformable structures, surrounding fluids and neuromuscular activations, i.e., fluid-structure interactions (FSI) controlled by fish's motor systems. Previous studies suggested that such motor-controlled FSI may possess embodied traits. However, their implications in motor learning, neuromuscular control, gait generation, and swimming performance remain to be uncovered. Using robot models, we studied how swimming behaviours emerged from the FSI and the embodied traits. We developed modular robots with various designs and used Central Pattern Generators (CPGs) to control the torque acting on robot body. We used reinforcement learning to learn CPG parameters to maximize the swimming speed. The results showed that motor frequency converged faster than other parameters, and the emergent swimming gaits were robust against disruptions applied to motor control. For all robots and frequencies tested, swimming speed was proportional to the mean undulation velocity of body and caudal-fin combined, yielding an invariant, undulation-based Strouhal number. The Strouhal number also revealed two fundamental classes of undulatory swimming in both biological and robotic fishes. The robot actuators also demonstrated diverse functions as motors, virtual springs, and virtual masses. These results provide novel insights into the embodied traits of motor-controlled FSI for fish-inspired locomotion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2022

Learning Modular Robot Visual-motor Locomotion Policies

Control policy learning for modular robot locomotion has previously been...
research
02/24/2022

Alternative Metrics to Select Motors for Quasi-Direct Drive Actuators

Robotic systems for legged locomotion – including legged robots, exoskel...
research
11/10/2021

Effects of Design and Hydrodynamic Parameters on Optimized Swimming for Simulated, Fish-inspired Robots

In this work we developed a mathematical model and a simulation platform...
research
05/18/2023

From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning

In motor neuroscience, artificial recurrent neural networks models often...
research
02/02/2012

The implications of embodiment for behavior and cognition: animal and robotic case studies

In this paper, we will argue that if we want to understand the function ...
research
11/23/2020

The Dynamic of Body and Brain Co-Evolution

We introduce a method that permits to co-evolve the body and the control...
research
08/15/2023

Hierarchical generative modelling for autonomous robots

Humans can produce complex whole-body motions when interacting with thei...

Please sign up or login with your details

Forgot password? Click here to reset