DeepAI
Log In Sign Up

A Framework for Studying Reinforcement Learning and Sim-to-Real in Robot Soccer

08/18/2020
by   Hansenclever F. Bassani, et al.
0

This article introduces an open framework, called VSSS-RL, for studying Reinforcement Learning (RL) and sim-to-real in robot soccer, focusing on the IEEE Very Small Size Soccer (VSSS) league. We propose a simulated environment in which continuous or discrete control policies can be trained to control the complete behavior of soccer agents and a sim-to-real method based on domain adaptation to adapt the obtained policies to real robots. Our results show that the trained policies learned a broad repertoire of behaviors that are difficult to implement with handcrafted control policies. With VSSS-RL, we were able to beat human-designed policies in the 2019 Latin American Robotics Competition (LARC), achieving 4th place out of 21 teams, being the first to apply Reinforcement Learning (RL) successfully in this competition. Both environment and hardware specifications are available open-source to allow reproducibility of our results and further studies.

READ FULL TEXT
03/24/2020

Learning to Play Soccer by Reinforcement and Applying Sim-to-Real to Compete in the Real World

This work presents an application of Reinforcement Learning (RL) for the...
11/20/2020

MRAC-RL: A Framework for On-Line Policy Adaptation Under Parametric Model Uncertainty

Reinforcement learning (RL) algorithms have been successfully used to de...
06/15/2021

rSoccer: A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer

Reinforcement learning is an active research area with a vast number of ...
11/23/2020

An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer

The IEEE Very Small Size Soccer (VSSS) is a robot soccer competition in ...
08/11/2020

Hardware as Policy: Mechanical and Computational Co-Optimization using Deep Reinforcement Learning

Deep Reinforcement Learning (RL) has shown great success in learning com...
03/29/2021

pH-RL: A personalization architecture to bring reinforcement learning to health practice

While reinforcement learning (RL) has proven to be the approach of choic...
10/11/2021

Learning a subspace of policies for online adaptation in Reinforcement Learning

Deep Reinforcement Learning (RL) is mainly studied in a setting where th...