DeepAI AI Chat
Log In Sign Up

Learning to Play Soccer by Reinforcement and Applying Sim-to-Real to Compete in the Real World

by   Hansenclever F. Bassani, et al.

This work presents an application of Reinforcement Learning (RL) for the complete control of real soccer robots of the IEEE Very Small Size Soccer (VSSS), a traditional league in the Latin American Robotics Competition (LARC). In the VSSS league, two teams of three small robots play against each other. We propose a simulated environment in which continuous or discrete control policies can be trained, and a Sim-to-Real method to allow using the obtained policies to control a robot in the real world. The results show that the learned policies display a broad repertoire of behaviors that are difficult to specify by hand. This approach, called VSSS-RL, was able to beat the human-designed policy for the striker of the team ranked 3rd place in the 2018 LARC, in 1-vs-1 matches.


A Framework for Studying Reinforcement Learning and Sim-to-Real in Robot Soccer

This article introduces an open framework, called VSSS-RL, for studying ...

An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer

The IEEE Very Small Size Soccer (VSSS) is a robot soccer competition in ...

Learning Real-World Robot Policies by Dreaming

Learning to control robots directly based on images is a primary challen...

Improving Assistive Robotics with Deep Reinforcement Learning

Assistive Robotics is a class of robotics concerned with aiding humans i...

A framework for reinforcement learning with autocorrelated actions

The subject of this paper is reinforcement learning. Policies are consid...

Improving the Robustness of Reinforcement Learning Policies with ℒ_1 Adaptive Control

A reinforcement learning (RL) control policy trained in a nominal enviro...

Bi-Manual Manipulation and Attachment via Sim-to-Real Reinforcement Learning

Most successes in robotic manipulation have been restricted to single-ar...