Real-time eSports Match Result Prediction

12/10/2016 ∙ by Yifan Yang, et al. ∙ Carnegie Mellon University 0

In this paper, we try to predict the winning team of a match in the multiplayer eSports game Dota 2. To address the weaknesses of previous work, we consider more aspects of prior (pre-match) features from individual players' match history, as well as real-time (during-match) features at each minute as the match progresses. We use logistic regression, the proposed Attribute Sequence Model, and their combinations as the prediction models. In a dataset of 78362 matches where 20631 matches contain replay data, our experiments show that adding more aspects of prior features improves accuracy from 58.69 71.49 predicting at the 40th minute.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Predicting match results in sports games has always been a popular research topic in machine learning. Indeed, sports analytics has been an emerging field in many professional sports games to help decision making

111http://www.forbes.com/sites/leighsteinberg/2015/08/18/changing-the-game-the-rise-of-sports-analytics/. In recent years, electronic sports (a.k.a. eSports), a form of competitions on multiplayer video games, have also been recognized as legitimate sports. For example, Dota 2, a multiplayer online battle arena game, is one of the most active games in the eSports industry, with over one million concurrent players on the Steam gaming platform. The prize of professional Dota 2 tournaments has already passed $65 million by June 2016.222https://techvibes.com/2016/06/21/how-videogames-became-a-sport-and-why-theyre-here-to-stay-hint-money Just as sports analytics has been used in decision making of professional sports, it is foreseeable that “eSports analytics” will also be useful for players in professional eSports competitions, live streaming media that cover these competitions, or eSports game developers.

In this paper, we try to predict the winning team of a match in the multiplayer eSports game Dota 2, in which a match consists of two teams named “Radiant” and “Dire”, and each team consists of five players. Before a match begins, each player selects a unique “hero” character to be controlled in the match. As the match progresses, the hero can farm gold or obtain experience to level up via combats against rival heroes. The winning criteria for a team is to destroy the opponent team.

Our goal to predict the winning team of Dota 2 has two stages. In our first stage, we predict the result before a match begins. Because previous work [12, 8] used very limited aspects of features, we extract more aspects of features from the available game data. In addition, previous work only consider pre-match information, while the most useful information is typically generated during the game. This motivates our second stage to further introduce real-time gameplay data to predict during a match. Therefore, the contributions of this paper are:

  1. Consider more aspects of prior features (before a match begins) from individual players’ match history instead of only hero features to improve prediction accuracy.

  2. Consider real-time gameplay features (during a match) to predict the winning team as the match progresses (e.g. predicting at each 1-minute interval).

In this paper, the information before a match begins is referred to as prior information, and the information during a match is referred to as real-time information. Figure 1

illustrates an example Dota 2 match predicted by our system. The winning probabilities of both teams are estimated at each minute as the match progresses. At the 0th minute when only prior information is available, our system predicts that the Radiant team has an advantage. However, starting from the 5th minute when real-time information gains more influence, it predicts that the Dire team will reverse the match.

Figure 1: The winning probability of Radiant team in an example Dota 2 match at each minute predicted by our system. In the beginning of the match, prior information (history data) predicts that the Radiant team has an advantage. However, starting from the 5th minute, real-time information (gameplay data) gains more influence and predicts that the Dire team will reverse the match. In this example, our system is able to achieve nearly 100% confidence at as early as the 7th minute, long before the match ends.

2 Related Work

There have been numerous efforts on predicting the winning team of a match in different kinds of sports. [3] proposed a novel probabilistic framework using context information to predict tennis and StarCraft II match results. [5]

used a Bayesian network with subjective variables on football games.

[7] used the ELO rating system to derive covariates for prediction models. [2] used collaborative filtering to predict cases without enough history data.

As for eSports matches, [6] used zone changes, distribution of team members, and time series clustering to investigate spatio-temporal behavior. [9]

focused on classifying hero positional role and hero identifier based on play style and performance.

[13] worked on discovering patterns in combat tactics of Dota 2. [1]

trained a neural network to find optimal jungling routes in Dota 2.

Some previous work also tried to predict eSports match results. [10] clustered player behavior and learned the optimal team composition. Then it used team composition-based features to predict the outcome of the game League of Legends. [11] predicted the outcome of Dota 2 with topological measures, which are the areas of polygons described by the players, inertia, diameter, distance to the base. [4] used logistic regression and k-nearest neighbors to recommend hero selections that would maximize team winning probability against the opponent team. [12, 8]

used logistic regression or random forests to predict the winning team of Dota 2. However, the features used in previous work are only hero selection and/or hero winning rates, which are from very limited aspects of the available game data. In addition, the information from the real-time gameplay is entirely ignored. Therefore, an important part of this paper is to expand the feature set that will address these weaknesses.

3 Dataset

For prior information, we use Dota 2 API333dota2api: wrapper and parser, https://github.com/joshuaduffy/dota2api to crawl 78362 matches participated by 19790 players with ‘very high’ skill level444Matches with very high skill level result in fewer random factors and more resemble professional matches.

. Mean and standard deviation of match duration are 37.75 minutes and 10.42 minutes respectively, which are consistent with real Dota 2 scenario. It is worth noting that the match data in previous work

[12, 4, 8] had much shorter duration (mean is ranged between 23 and 30 minutes) and would lead to more biased prediction results.

Each match contains the winning team, players’ account IDs and corresponding hero IDs. In addition, we use other 3rd party APIs to collect statistics of heroes and players. Heroes’ data can be obtained from HeroStats API555HeroStats API, http://herostats.io/. It contains numerous statistics associated with each hero’s abilities such as strength, agility, and intelligence.

Player’s ability (i.e. match history) plays a major role to the outcome of prediction. Opendota API666OpenDota API, http://docs.opendota.com/ provides a player’s statistics, which can be treated as prior knowledge of the player’s skill level before a match begins. For example, Dota 2 uses Matchmaking Rating (MMR)777How Dota 2 MMR Works – A Detail Guide, http://www.dotainternational.com/how-dota-2-mmr-works as the official ranking score, which estimates the skill level of a player. We could also access a player’s match history. Through the past match records, we can know the skill level of a player when they choose a particular hero.

For real-time information, we use Opendota API to collect match replay data such as gold, experience and deaths for all players at each minute. Since not all matches have replays available online, only 20631 out of 78362 matches contain gameplay information in our dataset.

4 Features

4.1 Prior Features

Feature engineering plays a major role in this paper. Domain knowledge is leveraged to extract useful features from the data. Using the collected data, we categorize the extracted features of the prior knowledge into three types: hero, player, and hero-player combined features. For each match, we obtain features from 10 players in the two opponent teams (Radiant and Dire), and combine them into a single feature vector with Radiant team’s feature values in the front half. Sometimes, a player’s statistics can not be accessed if they set their account profile private. In this case, we replace missing feature values with corresponding mean values. Furthermore, we filter matches to guarantee that there are at most two missing players in each match.

Hero Feature. Hero feature

contains three parts: hero selection, hero attributes, and hero winning rate. Hero selection is binary one-hot encoding indicating which heroes are selected for each team in a match. At the time of writing, there are 113 heroes in the Dota 2. We define the hero selection part as a 113 heroes

2 teams = 226-dimensional vector. Hero selection is the only feature implemented in two previous works [12, 4].

Hero attributes are 26 manually chosen statistics associated with each hero’s abilities such as strength, agility, and intelligence. We use a 260-dimensional vector to represent the 10 selected heroes’ 26 attributes.

Moreover, we calculate the radiant winning rate of a hero against another hero in all history matches. So for each match, there will be 5 Radiant heroes 5 Dire heroes = 25 rival hero combinations.

Finally, we concatenate the three parts into a 226 + 260 + 25 = 511-dimensional hero feature vector . Note that all parts of the hero feature are based on global statistics from all players, independent of the current players’ match history.

Player Feature. Player feature contains the skills and ranking information about the 10 players. We define player feature as a 20-dimensional vector to represent the current 10 players by their MMR scores and MMR percentiles888For a visualization of the MMR distribution and percentiles among more than one million players, see https://www.opendota.com/distributions.

Hero-player Combined Feature. Hero-player combined feature contains 8 statistics about the 10 players when they choose the current heroes. The statistics include the winning rate when using this hero, mean experience, mean gold gained per minute, and mean number of deaths per minute. We define hero-play combined feature as a 80-dimensional vector to represent 10 players’ 8 statistics when choosing the respective heroes for each match. Figure 3

shows the winning rates of two example players when choosing different heroes. We can see that player A and player B are good at different heroes with a large variance in winning rates. Such property cannot be captured by hero feature alone since it is averaged over all levels of players. Similarly, player feature alone is not enough since it doesn’t distinguish player’s performance over different heroes.

Figure 2: Winning rates of two example players when choosing different heroes.
Figure 3: Gold and experience difference between the two teams (Radiant minus Dire) at each minute of one particular match.

4.2 Real-time Features

Each team’s real-time information can be represented by averaging the five players’ gold, experience and deaths at each minute. Then we take the difference between the two teams (Radiant minus Dire) as our feature. Figure 3 illustrates the gold and experience features of one particular match. If a match has minutes, then the real-time feature for this match will have dimensions.

5 Models

The goal of this paper is to predict the winning team before a match begins (using prior information) and during a match (using real-time information). We refer to these two parts as prior modeling and real-time modeling. In this section, we first introduce how we separately model the prior part and the real-time part. Then we propose two methods to combine prior modeling and real-time modeling.

5.1 Prior Modeling

For predicting match results before a match begins, we explore the effectiveness of two classifiers: logistic regression (LR) and neural network. Input to the classifiers are the three categories of prior features explained in Section 4.1: hero feature, player feature, and hero-player combined feature.

5.2 Real-time Modeling

As game progresses, we are able to observe more data related to the performance of each team. In this section, we proposed two methods to model the three time series data (Section 4.2) obtained during the match.

One intuitive method is to slice time-series data by sliding window and train a LR. For example, we can slice time-series data by 5-minute windows. The LR is trained using all matches’ 5-minute-window time series data (convoluted in time domain). When making a prediction at time , we feed time-series data at time as features into the LR.

As the second method, we build a generative model called Attribute Sequence Model (ASM). This model aims to capture the trend of time-series data by explicitly modeling its transition probability in a discrete state space. See Figure 5 for its plate notation.

Here denotes which team wins the game. if Radiant wins and otherwise. are the three time-series data, with represents respectively the deaths, gold and experience at time . Note that here we construct the value of as the difference of two teams. For example if at time Radiant team has mean experience 2000 and Dire team has mean experience 1000, then . Further, we discretize into bins and assign a discrete bin number to rather than the real value. For example, experience 1000 falls into the bin thus we set . In practice, we divide deaths, gold and experience into 24 bins. Therefore can have integer values 0-23.

The generative process of ASM is as follows: First is sampled to determine which team is going to win. Then at each time , are sampled independently based on their previous value and . The training process of ASM involves learning transition probability , and , which are estimated by Maximum Likelihood Estimation.

Figure 4: Plate notation of the Attribute Sequence Model (ASM).
Figure 5: Learned transition probability for the gold time-series data.

Figure 5 is the visualization of the learned transition probability for gold time-series data. X-axis and Y-axis are bin numbers. The larger the bin number is, the larger the value it represents. Light color represents larger probability. Transition probability can be interpreted as the trend of time-series data under different conditions. For instance, when which means Radiant is going to win the game, (Radiant’s gold minus Dire’s gold) is more likely to transit from a smaller value to a larger value. When , it is the opposite.

The prediction process of the ASM model is as follows: if we want to make prediction at time , we use the previous 5 minutes’ data , ,

and calculate the posterior probability

, on which our prediction is based.

5.3 Prior and Real-time Combined Modeling

To build an accurate prediction model, we need to take into account both prior information and real-time information. In this section we propose two methods to combined prior modeling and real-time modeling together.

In method 1, we concatenate the 5-minutes-window time-series features with prior features and train a LR. In method 2 we train a new LR on top of the output of prior LR () and the output of the real-time ASM model ().

6 Experiments

We split matches into training and testing dataset with ratio of 9:1. All feature values are normalized to zero mean and unit variance. When obtaining statistics from match history, we exclude matches in the test dataset. Hyper-parameters for LR and neural network are searched via 10-fold cross-validation on training data set. Table 1

is the cross-validation result on selecting hidden size and activation for two-layer neural network. In the end, we using LR with L2 regularization of 1e-6 and two-layer neural network with hidden size of 64 and sigmoid activation. Both classifiers were implemented with Keras

999

Keras: Deep Learning library for TensorFlow and Theano,

https://github.com/fchollet/keras
library.

32 64 128
Sigmoid 70.48% 70.79% 70.68%
Relu 69.06% 69.08% 68.65%
Tanh 69.39% 70.04% 69.39%
Table 1: Cross-validation accuracy on two-layer neural network for hidden size and activation

6.1 Prediction Using Only Prior Information

We compare prediction accuracy with different prior feature combinations by various methods, including two previous works, our logistic regression and neural network. [4] trained logistic regression based on only hero selection. [8] further added hero against hero winning rate and trained with random forest. We train their features using LR on our dataset.

As can be seen from Table 2, using all features (Hero + Player + Hero-player) achieves the highest prediction accuracy , which outperforms the two previous works by more than 10% because they used only subsets of our prior features. Although both previous works claimed to have achieved over 70% prediction accuracy, their data had much shorter average match duration (between 23 to 30 minutes) that does not reflect the real distribution in the Dota 2 game. Section 7.1 further discusses the effect of match duration on prior prediction.

Furthermore, hero-player combined feature is the single most informative feature, achieving prediction accuracy by itself. For example, it includes individual player’s performance over different heroes (Figure 3), which is proven to be a key factor in winning a match.

Hero Player Hero-Player Hero + Player + Hero-Player
Conley et al. [4] 58.79% N/A N/A N/A
Kinkade et al. [8] 58.69% N/A N/A N/A
Logistic Regression 60.07% 55.77% 69.90% 71.49%
Neural Network 59.53% 56.39% 69.71% 70.46%
Table 2: Prediction accuracy with different prior feature combinations by various methods.

6.2 Prediction Using Both Prior and Real-time Information

In Figure 6, we compare all the proposed methods in terms of their accuracy when we make prediction at every 5 minutes. The green horizontal line is training LR using only prior features, which serves the baseline of our real-time modeling. The red dashed line is training LR using only real-time features and red solid line is training LR using both prior and real-time features (Section 5.3 method 1). The blue dashed line is the real-time prediction made by ASM model, and the blue solid line is the combination of ASM model and LR (Section 5.3 method 2). Three observations can be drawn from these experiments.

Figure 6: Prediction accuracy plot using different models and features. The horizontal axis is the specific minute when prediction is made. Real-time predictions use previous 5 minutes of data.
  1. Sufficient real-time information greatly improves prediction accuracy over baseline (green line). In our experiments, all four real-time models (blue lines and red lines) achieve better accuracy when fed with real-time information longer than 15 minutes. When predicting at the 40th minutes, accuracy achieves as high as , in spark contrast to the 69% accuracy when we only use prior feature to predict at the 40th minute (Figure 8).

  2. Real-time features become more and more informative than prior features when make prediction at later stage of a match. Notice that the gap between blue solid line and blue dashed line is diminishing. The same happens to red solid line and red dashed line. This suggests that at later stage of a match teams’ real-time performance determine the winning side. Prior features lose prediction power as match lasts longer.

  3. The ASM approach (blue solid) performs better than LR (red solid) when using real-time features less than 20 minutes. This is probably because at the early stage of a match each team’s performance is similar. At this stage it’s more important to model the trend of performance rather its current value. ASM model explicitly models the transition probability of the three time-series data which encodes the trend of each team’s performance, therefore it outperforms LR at this period.

7 Discussion and Analysis

7.1 Effect of Match Duration on Prior Prediction

We conduct error analysis to examine the possible cause of wrong predictions when using only prior information (Section 6.1). Figure 8 shows the effect of different match duration on prediction accuracy. In general, as matches last longer, accuracy drops and the matches become more unpredictable. For matches longer than 55 minutes, only less than accuracy is achieved. This phenomenon is likely due to the fact that as the match progresses, prior information (such as hero selection) is of less importance in its contribution to the final match result. Instead, it is the real-time gameplay information (such as how quickly each hero gains experience) that will give more clues to the final match result. In fact, this hypothesis is also a motivation to introduce real-time gameplay features in our feature set.

Figure 7: Prediction accuracy using only prior information for different match duration.
Figure 8: Prediction accuracy plot for LR and Time-specific LR.

7.2 Time-specific Logistic Regression

In previous section, we train one LR with 5-minutes-window time-series features. In a match, the model will use multiple 5-minutes-window time-series features starting at different minute. Merging different windows together will lose time-specific information. For example, gaining 1000 gold from 35 minute to 40 minute have different effect comparing to that from 5 minute to 10 minute. Therefore, one way to improve the previous LR is that we train multiple LR. Each LR is trained by time-series features from the same 5-minutes-window. Figure 8 shows that this time-specific model (Blue solid line) outperforms previous LR (Red solid line) in most time.

7.3 Assumptions of ASM Model

Here we discuss certain assumptions made in building the ASM model that may be untrue. The ASM model assumes independence of the three time-series. However, we observe strong correlation between them. For example, gold and deaths are highly negatively correlated because in the settings of Dota 2, deaths lead to lost of gold. Also we assume bigram-like transition. These two assumptions are made primarily to reduce model parameters and make it more generalizable. If there are more training data, these two assumptions can be relaxed.

Another important assumption is that for every match, we assume its winning side remains unchanged throughout the match. In reality, however, it could be for example that Radiant team is about to win during the first half of the game but in the end Radiant loses because it makes an unforeseeable mistake during the second half. The problem is that in the training data we can only observe the final winning side but not the intermediate winning tendency. One possible workaround is to approximate the intermediate winning tendency by features, but we don’t explore it in this paper.

8 Conclusion and Future Work

In this paper, we predict the winning team of a match in the multiplayer eSports game Dota 2. To address the weaknesses of previous work, we construct a feature set which covers more aspects including hero, player, and hero-player combination as prior features (before a match begins), and the team differences of gold, experience, and deaths at each minute as real-time features (during a match). We explored the effectiveness of LR, the proposed Attribute Sequence Model and their combinations in such prediction problem. Experiment results show that prior features’ prediction power drops as the match lasts longer, which is successfully solved by modeling real-time time-series data. We also show that training time-specific LR further improves prediction accuracy by taking into account time heterogeneity.

Future work includes modeling intermediate winning tendency (Section 7.3) which is a more accurate indicator of game status than final result. Also, more replay data should be used in the real-time modeling, such as hero locations, equipment and major battle events. Lastly, it would be interesting to develop a system that takes in a public match id and automatically visualize the predicted winning probability in realtime.

References

  • [1] Thomas E. Batsford.

    Calculating optimal jungling routes in dota2 using neural networks and genetic algorithms.

    Project, University of Derby, 2014.
  • [2] Joseph C. Bonneau. Beyond “Playing the Percentages”: Application of collaborative filtering for predicting baseball matchups, 2006.
  • [3] Shuo Chen and Thorsten Joachims. Predicting matchups and preferences in context. KDD, 2016.
  • [4] Kevin Conley and Daniel Perry. How does he saw me? a recommendation engine for picking heroes in dota 2. Course project, Stanford University, 2013.
  • [5] Anthony C. Constantinou, Norman E. Fenton, and Martin Neil. pi-football: A bayesian network model for forecasting association football match outcomes. Knowledge-Based Systems, 36, 2012.
  • [6] Anders Drachen, Matthew Yancey, John Maguire, Derrek Chu, Iris Yuhui Wang, Tobias Mahlmann, Matthias Schubert, and Diego Klabajan. Skill-based differences in spatio-temporal team behaviour in defence of the ancients 2 (dota 2). IEEE-GEM, 2014.
  • [7] Lars Magnus Hvattuma and Halvard Arntzen. Using elo ratings for match result prediction in association football. International Journal of Forecasting, 26, 2010.
  • [8] Nicholas Kinkade and Kyung yul Kevin Lim. Dota 2 win prediction. Course project, University of California, San Diego, 2015.
  • [9] Jamie Lowder, Dave Wong, Lynn Gao, and James Judd. Classifying dota 2 hero characters based on play style and performance. Course project, The University of Utah, 2015.
  • [10] Hao Yi Ong, Sunil Deolalikar, and Mark Peng. Player behavior and optimal team composition for online multiplayer games. 2015.
  • [11] François Rioult, Jean-Philippe Metivier, Boris Helleu, Nicolas Scelles, and Christophe Durand. Mining tracks of competitive video games. AASRI, 2014.
  • [12] Kuangyan Song, Tianyi Zhang, and Chao Ma. Predicting the winning side of dota2. Course project, Stanford University, 2015.
  • [13] Pu Yang, Brent Harrison, and David L. Roberts. Identifying patterns in combat that are predictive of success in moba games. Proceedings of Foundations of Digital Games, 2014.