DeepAI AI Chat
Log In Sign Up

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

by   Yandong Ji, et al.

We address the problem of enabling quadrupedal robots to perform precise shooting skills in the real world using reinforcement learning. Developing algorithms to enable a legged robot to shoot a soccer ball to a given target is a challenging problem that combines robot motion control and planning into one task. To solve this problem, we need to consider the dynamics limitation and motion stability during the control of a dynamic legged robot. Moreover, we need to consider motion planning to shoot the hard-to-model deformable ball rolling on the ground with uncertain friction to a desired location. In this paper, we propose a hierarchical framework that leverages deep reinforcement learning to train (a) a robust motion control policy that can track arbitrary motions and (b) a planning policy to decide the desired kicking motion to shoot a soccer ball to a target. We deploy the proposed framework on an A1 quadrupedal robot and enable it to accurately shoot the ball to random targets in the real world.


page 1

page 7


Creating a Dynamic Quadrupedal Robotic Goalkeeper with Reinforcement Learning

We present a reinforcement learning (RL) framework that enables quadrupe...

A Policy Adaptation Method for Implicit Multitask Reinforcement Learning Problems

In dynamic motion generation tasks, including contact and collisions, sm...

Motion Perception in Reinforcement Learning with Dynamic Objects

In dynamic environments, learned controllers are supposed to take motion...

Learning Hybrid Models to Control a Ball in a Circular Maze

This paper presents a problem of model learning to navigate a ball to a ...

Semiparametrical Gaussian Processes Learning of Forward Dynamical Models for Navigating in a Circular Maze

This paper presents a problem of model learning for the purpose of learn...

Developing a Simple Model for Sand-Tool Interaction and Autonomously Shaping Sand

Autonomy for robots interacting with sand will enable a wide range of be...

Learning to Design and Construct Bridge without Blueprint

Autonomous assembly has been a desired functionality of many intelligent...