An Energy-Saving Snake Locomotion Gait Policy Using Deep Reinforcement Learning

03/08/2021
by   Yilang Liu, et al.
0

Snake robots, comprised of sequentially connected joint actuators, have recently gained increasing attention in the industrial field, like life detection in narrow space. Such robot can navigate through the complex environment via the cooperation of multiple motors located on the backbone. However, controlling the robots under unknown environment is challenging, and conventional control strategies can be energy inefficient or even fail to navigate to the destination. In this work, a snake locomotion gait policy is developed via deep reinforcement learning (DRL) for energy-efficient control. We apply proximal policy optimization (PPO) to each joint motor parameterized by angular velocity and the DRL agent learns the standard serpenoid curve at each timestep. The robot simulator and task environment are built upon PyBullet. Comparing to conventional control strategies, the snake robots controlled by the trained PPO agent can achieve faster movement and more energy-efficient locomotion gait. This work demonstrates that DRL provides an energy-efficient solution for robot control.

READ FULL TEXT
research
04/16/2019

Energy-Efficient Slithering Gait Exploration for a Snake-like Robot based on Reinforcement Learning

Similar to their counterparts in nature, the flexible bodies of snake-li...
research
06/01/2021

DeepWalk: Omnidirectional Bipedal Gait by Deep Reinforcement Learning

Bipedal walking is one of the most difficult but exciting challenges in ...
research
11/01/2020

Bound Controller for a Quadruped Robot using Pre-Fitting Deep Reinforcement Learning

The bound gait is an important gait in quadruped robot locomotion. It ca...
research
09/09/2021

Learning Vision-Guided Dynamic Locomotion Over Challenging Terrains

Legged robots are becoming increasingly powerful and popular in recent y...
research
03/02/2022

Imitation and Adaptation Based on Consistency: A Quadruped Robot Imitates Animals from Videos Using Deep Reinforcement Learning

The essence of quadrupeds' movements is the movement of the center of gr...
research
09/22/2022

Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learning

Deep Reinforcement Learning (DRL) is employed to develop autonomously op...
research
04/30/2019

Synthesis of Biologically Realistic Human Motion Using Joint Torque Actuation

Using joint actuators to drive the skeletal movements is a common practi...

Please sign up or login with your details

Forgot password? Click here to reset