Learning Hybrid Models to Control a Ball in a Circular Maze

09/13/2018
by   Diego Romeres, et al.
0

This paper presents a problem of model learning to navigate a ball to a goal state in a circular maze environment with two degrees of freedom. Motion of the ball in the maze environment is influenced by several non-linear effects such as friction and contacts, which are difficult to model. We propose a hybrid model to estimate the dynamics of the ball in the maze based on Gaussian Process Regression equipped with basis functions obtained from physic first principles. The accuracy of the hybrid model is compared with standard algorithms for model learning to highlight its efficacy. The learned model is then used to design trajectories for the ball using a trajectory optimization algorithm. We also hope that the system presented in the paper can be used as a benchmark problem for reinforcement and robot learning for its interesting and challenging dynamics and its ease of reproducibility.

READ FULL TEXT
research
09/13/2018

Semiparametrical Gaussian Processes Learning of Forward Dynamical Models for Navigating in a Circular Maze

This paper presents a problem of model learning for the purpose of learn...
research
12/15/2021

Contact simulation of a 2D Bipedal Robot kicking a ball

This report describes an approach for simulating multi-body contacts of ...
research
08/01/2022

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

We address the problem of enabling quadrupedal robots to perform precise...
research
08/28/2023

Data-Efficient Online Learning of Ball Placement in Robot Table Tennis

We present an implementation of an online optimization algorithm for hit...
research
08/31/2023

A Policy Adaptation Method for Implicit Multitask Reinforcement Learning Problems

In dynamic motion generation tasks, including contact and collisions, sm...
research
07/02/2021

Targeted Muscle Effort Distribution with Exercise Robots: Trajectory and Resistance Effects

The objective of this work is to relate muscle effort distributions to t...
research
07/19/2020

Learning to Play Cup-and-Ball with Noisy Camera Observations

Playing the cup-and-ball game is an intriguing task for robotics researc...

Please sign up or login with your details

Forgot password? Click here to reset