TiKick: Toward Playing Multi-agent Football Full Games from Single-agent Demonstrations

10/09/2021
by   Shiyu Huang, et al.
0

Deep reinforcement learning (DRL) has achieved super-human performance on complex video games (e.g., StarCraft II and Dota II). However, current DRL systems still suffer from challenges of multi-agent coordination, sparse rewards, stochastic environments, etc. In seeking to address these challenges, we employ a football video game, e.g., Google Research Football (GRF), as our testbed and develop an end-to-end learning-based AI system (denoted as TiKick) to complete this challenging task. In this work, we first generated a large replay dataset from the self-playing of single-agent experts, which are obtained from league training. We then developed a distributed learning system and new offline algorithms to learn a powerful multi-agent AI from the fixed single-agent dataset. To the best of our knowledge, Tikick is the first learning-based AI system that can take over the multi-agent Google Research Football full game, while previous work could either control a single agent or experiment on toy academic scenarios. Extensive experiments further show that our pre-trained model can accelerate the training process of the modern multi-agent algorithm and our method achieves state-of-the-art performances on various academic scenarios.

READ FULL TEXT
research
12/23/2019

A Survey of Deep Reinforcement Learning in Video Games

Deep reinforcement learning (DRL) has made great achievements since prop...
research
02/15/2023

TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play

Multi-agent football poses an unsolved challenge in AI research. Existin...
research
06/28/2023

Diversity is Strength: Mastering Football Full Game with Interactive Reinforcement Learning of Multiple AIs

Training AI with strong and rich strategies in multi-agent environments ...
research
05/16/2023

An Empirical Study on Google Research Football Multi-agent Scenarios

Few multi-agent reinforcement learning (MARL) research on Google Researc...
research
10/15/2018

Hedging Algorithms and Repeated Matrix Games

Playing repeated matrix games (RMG) while maximizing the cumulative retu...
research
04/20/2016

Procedural urban environments for FPS games

This paper presents a novel approach to procedural generation of urban m...

Please sign up or login with your details

Forgot password? Click here to reset