Semiparametrical Gaussian Processes Learning of Forward Dynamical Models for Navigating in a Circular Maze

by   Diego Romeres, et al.

This paper presents a problem of model learning for the purpose of learning how to navigate a ball to a goal state in a circular maze environment with two degrees of freedom. The motion of the ball in the maze environment is influenced by several non-linear effects such as dry friction and contacts, which are difficult to model physically. We propose a semiparametric model to estimate the motion dynamics of the ball based on Gaussian Process Regression equipped with basis functions obtained from physics first principles. The accuracy of this semiparametric model is shown not only in estimation but also in prediction at n-steps ahead and its compared with standard algorithms for model learning. The learned model is then used in a trajectory optimization algorithm to compute ball trajectories. We propose the system presented in the paper as a benchmark problem for reinforcement and robot learning, for its interesting and challenging dynamics and its relative ease of reproducibility.


page 1

page 2


Learning Hybrid Models to Control a Ball in a Circular Maze

This paper presents a problem of model learning to navigate a ball to a ...

Contact simulation of a 2D Bipedal Robot kicking a ball

This report describes an approach for simulating multi-body contacts of ...

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

We address the problem of enabling quadrupedal robots to perform precise...

Vid2Param: Online system identification from video for robotics applications

Robots performing tasks in dynamic environments would benefit greatly fr...

Learning to reason about and to act on physical cascading events

Reasoning and interacting with dynamic environments is a fundamental pro...

Catch the Ball: Accurate High-Speed Motions for Mobile Manipulators via Inverse Dynamics Learning

Mobile manipulators consist of a mobile platform equipped with one or mo...

STReSSD: Sim-To-Real from Sound for Stochastic Dynamics

Sound is an information-rich medium that captures dynamic physical event...