Blocking defector invasion by focusing on the most successful partner

06/15/2020
by   Attila Szolnoki, et al.
0

According to the standard protocol of spatial public goods game, a cooperator player invests not only into his own game but also into the games organized by neighboring partners. In this work, we relax this assumption by allowing cooperators to decide which neighboring group to prefer instead of supporting them uniformly. In particular, we assume that they select their most successful neighbor and focus external investments exclusively into the related group. We show that this very simple alteration of the dynamical rule results in a surprisingly positive evolutionary outcome – cooperators prevail even in harsh environment represented by small values of the synergy factor in the game. The microscopic mechanism behind the reported success of the cooperator strategy can be explained by a blocking mechanism which affects the propagations of competing strategies in a biased way. Our results, which remain intact by using different interaction topologies, reveal that it could be beneficial to concentrate individual efforts to reach a higher global wellbeing.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 7

12/04/2017

The Game of Blocking Pebbles

Graph Pebbling is a well-studied single-player game on graphs. We introd...
06/08/2021

Cooperation and competition between pair and multi-player social games in spatial populations

The conflict between individual and collective interests is in the heart...
09/26/2019

Gradual learning supports cooperation in spatial prisoner's dilemma game

According to the standard imitation protocol, a less successful player a...
07/05/2021

The self-organizing impact of averaged payoffs on the evolution of cooperation

According to the fundamental principle of evolutionary game theory, the ...
06/28/2021

Small Fraction of Selective Cooperators Can Elevate General Wellbeing Significantly

A cooperative player invests effort into a common venture without knowin...
10/12/2018

Granularity of wagers in games and the (im)possibility of savings

In a casino where arbitrarily small bets are admissible, any betting str...
10/29/2016

Multi-agent projective simulation: A starting point

We develop a two-defender (Alice and Bob) invasion game using the method...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Explaining the emergence of cooperation among selfish agents who are interested in their best personal interest is a long-standing problem that has attracted intensive scientific activity in the last two decades Szabó and Fáth (2007); Perc and Szolnoki (2010); Sigmund (2010); Szolnoki et al. (2014); Cheng et al. (2019); Murase and Baek (2018); Takeshue (2019); Liu et al. (2019). Several mechanisms have already been identified, which highlight the importance of different forms of reciprocity Nowak (2006). As expected, monitoring players by rewarding positive act or punishing bad behavior supports cooperation efficiently Sigmund et al. (2001); Szolnoki and Perc (2010); Cong et al. (2017); Szolnoki and Perc (2012); Takesue (2018). Notably, the punishment can be executed in different ways like by decreasing payoff or via exclusion from mutual benefit Szolnoki and Chen (2017); Liu et al. (2017); Quan et al. (2019). In these cases the dilemma is transformed to another stage because not all cooperators want to bear the cost of an additional institution. Consequently, they become the so-called second-order free-riders and we practically face the original dilemma Panchanathan and Boyd (2004). Interestingly, this problem can be resolved automatically in structured populations where players have limited range of interactions Helbing et al. (2010a, b). In spatial systems, those players who bear the costs of both cooperation and additional institution can separate from simple cooperators hence the former group can fight against defection more efficiently Szolnoki et al. (2011).

However, the most interesting intellectual challenge is to identify those rules and mechanisms which are strategy-neutral. In the latter cases, when we apply these rules, there is no obvious preliminary reason to support cooperative acts. An instructive example for a cooperator supporting environment is a highly heterogeneous interaction graph Santos and Pacheco (2005). By following this research path, the breaking of symmetry, or the introduction of social diversity among competitors are now believed to be conducive to cooperation Szolnoki and Szabó (2007); Perc and Szolnoki (2008); Rong et al. (2019). For the mentioned cases, a generally valid explanation is that stronger players, who have higher social influence, can spread their strategies in their close neighborhood, resulting in a local coordination in the involved patches Szolnoki and Perc (2015); Yang and Tian (2017); Szolnoki and Chen (2018a); Yang and Yang (2018). Consequently, this type of separation of competing strategies reveals the evolutionary advantage of cooperation.

Inhomogeneity can also be introduced in alternative ways. For example, in a public goods game, players are asked to contribute to a common pool. Their contributions are enlarged by a synergy factor and after it is redistributed among group members. In a structured population, a player is involved in different groups and cooperators are believed to contribute to all related games. However, there are real-life examples when players distribute their contributions in an unequal way.

Although the option of heterogeneous investment into different games has been already suggested by some previous works, these research papers can be grouped along the following directions. In the first group, models focused on heterogeneous interaction graphs. Consequently, they assumed that a player’s investment to an external group depends on the degree of the focal player Cao et al. (2010); Wang et al. (2018). In this way, the suggested microscopic rule strongly utilizes the heterogeneous topology of interaction graph and does not consider the limited source of cooperator players. The other groups of models assume sophisticated and demanding skills of players. In particular, they suggest that a player’s contribution to a specific group depends on their income received from the given group in the previous simulation step Vukov et al. (2011); Zhang et al. (2012). Not really surprisingly, by applying such kind of microscopic rule, we practically enforce the reciprocity mechanism between cooperator players. It is because a cooperator group, where the redistribution is high, can expect additional support from an external cooperator. The rest of related models of heterogeneous investment broke the “strategy-neutral” principle directly and considered actual strategy choice of group members. For example, in Ref. Yuan and Xia (0141) the contribution of a cooperator player into a group depends on the fraction of cooperators within that group. In an analogous work, it was suggested that the investment of a cooperator in a group organized by another partner depends on the reputation of the latter player Yang and Yang (2019). As expected, these rules resulted in a higher cooperation level because they directly support this strategy.

While our present model also considers heterogeneous investment in a public goods game, it does not belong to any of the previously mentioned paths. In particular, in our case, a player needs no additional information about the topology of interaction graph because his decision does not utilize the proper degree distribution of neighbors. Furthermore, players are not requested to record their previous incomes from specific groups for a decision about their investment. Instead they only need to know the payoff of their neighbors. The latter, however, should be available for every model, where strategy update is based on the payoff difference of interacting players. Last, and most importantly, our proposed microscopic rule is strategy-neutral, because when a player decides about his investment onto a specific group organized by one of his neighbors, then the actual strategy of his partner has no importance. Surprisingly, this very simple model, which requires nothing more than the traditional setup, provides a highly cooperative evolutionary income even at small values of synergy parameter which mimics harsh environment in general.

In fact, we will show that without increasing the total investment of players it could be beneficial for the whole population to concentrate individual efforts instead of keeping the uniform, and seemingly more democratic investment policy. Before presenting our observations in more detail, we first proceed with the accurate description of the proposed public goods game with unequal investment rule.

2 Focusing on the most successful partner

For simplicity, we define the applied public goods game on a square lattice with periodic boundary conditions, but the extension to other topologies is straightforward. In the mentioned case, players are arranged into overlapping groups of size in a way that everyone is connected to its nearest neighbors. Consequently, each individual belongs to different groups where the first is organized by the focal player, while the rest games are organized by neighboring partners.

Initially, each player on site is designated either as a defector (), or as a cooperator () randomly. According to the standard protocol, a cooperator player invests a amount to each game while defectors contribute nothing. The sum of all contributions in each group is multiplied by the synergy factor

and the resulting public goods are distributed equally amongst all group members independently of their strategies. Notably, the total payoff of every player is the sum of the incomes collected from related games. In the following we assume that a cooperator player considers an alternating investment policy with probability

. We refer to this as selective cooperator () state. Otherwise, with probability , he follows the standard investment protocol and invests into every external games equally. In the former case the cooperator invests into his own game the usual amount, but his remaining contribution is distributed unequally. More precisely, the mentioned player looks for the specific partner in his neighborhood with the highest payoff. After selective cooperator invests all his external contribution exclusively to the game organized by the most successful neighbor. Given that there are more than one neighbors with the highest payoff value in the neighborhood then the mentioned cooperator selects one of them randomly.

In Fig. 1 we have summarized the investment policy of our present model. As mentioned, the focal F player collects income from not only his own game, which is marked by a yellow set, but also from the games organized by his neighbors. One of its external groups is marked by a dashed green ellipse in the plot. Evidently, the payoff collected from the game organized by the neighboring player depends on the contribution of player. If this player is in a state, then contributes to ’s game only if the payoff of player exceeds the payoff values of , and neighboring players. In the mentioned case contributes to ’s game by amount, as illustrated by an arrow. Otherwise it contributes nothing, no matter is a cooperator. Notably, a cooperator player always contributes a amount into his own game independently whether he is in an unconditional or selective cooperator state.


Figure 1: The focal F player collects income from not only his own game, marked by a yellow set, but also from the game organized by his neighbor . The group of the latter game is marked by a dashed green ellipse. Note, however, if cooperator is focusing on the best neighbor, then he invests contribution to ’s game only if the payoff of player is higher than the payoff of players. If this is the case then player invests all his external contribution here. The latter act is marked by an arrow. Similarly, the focal F cooperator always contributes his own game, but his external investment depends on its own state. In normal case, that happens with probability , a regular cooperator contributes to ’s game by . With probability , focuses on the best neighbor and invests into ’s game only if the payoff of exceeds the payoff of players. Otherwise, contributes nothing to ’s game no matter he is in a cooperator state.

We should stress that contrary to previous works, our modified investment rule does not utilize the heterogeneous topology of interaction graph, hence it can be applied for homogeneous topology as well. We also note that our observations are not restricted to lattice topology, but remain valid on random graphs too. We note that since the investment decision of a selective cooperator requires the knowledge of actual payoff values of neighbors, therefore in the zero step we provide a random payoff value for all players from the interval. Naturally, in the following steps the players’ payoff values are updated according to the proper states of their neighbors. We highlight that the actual initial payoff values have no relevant consequence on the outcome, they only serve the proper launch of the simulation steps. When we modified these values, we observed identical final state at a specific values of and .

The rest of the dynamical rule follows the standard procedure. More precisely, during an elementary Monte Carlo step we choose a player and one of his nearest neighbors at random. If the strategies of these players are different, then the related and payoff values are calculated by summing all the incomes acquired in each individual group. Then player adopts the strategy from player with a probability given by the Fermi function , where quantifies the uncertainty by strategy adoptions Szabó and Tőke (1998). A full Monte Carlo step offers a chance to every player to change his strategy once on average.

The system size for the square grid was varied from to , and we have not observed relevant finite-size effect. As we will stress, our model is capable to support cooperation even in homogeneous graphs where players have identical degree. This is a striking difference from those previous cases where the proposed asymmetry applied in the microscopic rule utilized the inhomogeneity of interaction graphs intensively Cao et al. (2010); Zhang et al. (2012); Yuan and Xia (0141); Wang et al. (2018). To broaden the robustness of our observation, we will leave square-lattice topology and also consider a random graph where there is no translation invariance, but small-world character emerges. This can be done by using a regular random graph where links of an initial lattice are rewired hence the degree distribution remains uniform Szabó et al. (2004). In the latter case, when random interaction graph was applied, we monitored typically players. In all cases, the stationary value of cooperation level was determined after a typical relaxation steps and values were averaged 50 independent runs. In the light of results presented first in the next section, we have also studied a slightly modified model which details will be described in the next section.

3 Results

We first present some representative cooperation levels obtained at different values in dependence of the synergy factor. As Fig. 2 highlights, the introduction of unequal investment policy stimulates a positive evolutionary outcome. More precisely, by increasing , means when we increase the chance that a cooperator behaves as a selective cooperator, then cooperators survive even at small values of synergy factor . For example, at and , when there is equal chance that a cooperator distributes his contributions uniformly or focuses them into a single group, then the system evolves toward a full cooperator state. Note that at this value of synergy factor the system would always terminate into a full defector state at , when cooperators disseminate their contributions among their neighbors uniformly.


Figure 2: Cooperation level in dependence on synergy factor for different values of parameter as indicated in the figure legend. This plot suggests that cooperation is largely supported if cooperator players prefer to support exclusively the best neighbor independently of the latter strategy. The results were obtained on square lattice where the linear system size are and the error bars are comparable to the symbol size.

The complete behavior on the parameter plane is summarized in Fig. 3. This plot confirms that a higher cooperation level can be achieved when cooperator players prefer to focus their external investment toward a specific neighbor, instead of supporting the whole environment uniformly. The best results are obtained when cooperators give up traditional unconditional cooperator state and instead they select their investment target exclusively. We stress that we do not expect any additional effort or cognitive skill from players, which are not already available in the traditional model. In particular, players do not need anything to know about the interaction topology, which was a fundamental condition in previous works. Furthermore, they do not have to record their past income originated from earlier games played with their neighbors. Evidently, to collect the mentioned information would require an extra effort that should be considered via an extra cost or lowered payoff value. But in our present model, when cooperators make a decision about their investment, they only need to know the payoff of their neighbors. This information, however, is available in the traditional model because imitation probability is also based on the payoff difference of competing partners.


Figure 3: Phase diagram, depicting the stable solutions (-full cooperator state, -full defector state and -mixed state) on the parameter plane. In agreement with the previous plot, cooperators can fight more efficiently against defection at high values, where they focus their external contributions on a single neighbor, who does the best in their neighborhood.

We stress that our observations are not limited to square lattice but remain valid for other topologies. Evidently, if the interaction graph is highly heterogeneous, then hubs, who are able to collect high payoff, will successfully attract the investments of neighboring cooperators. Consequently, in this case we can observe the same mechanism as was previously observed for scale-free graphs Santos et al. (2008). Namely, cooperator hubs will collect high payoff and become strong. Initially, defector hubs can utilize their neighbors, but later, when the neighboring players adopts the most successful strategy, then defector hubs become vulnerable. In this way it is not really surprising that heterogeneous investment supports cooperation on highly heterogeneous graphs Cao et al. (2010); Wang et al. (2018).

From this point of view, it is more interesting to check homogeneous graphs where there is no relevant difference between the degree distribution of players, but the topology is not necessarily translation invariant as for square lattice. Motivated by these arguments, in Fig. 4 we present results obtained by using random regular graph. For proper comparison we used the same degree distribution as for square grid Szabó et al. (2004). This plot suggests very similar behavior we previously reported in Fig. 2. Consequently, the positive impact of selected investment on cooperation level is a more general phenomenon that is not restricted to translational invariance interaction topologies. Hence we can conclude that the reported effect can be observed even on homogeneous graphs where there is no significant difference in players’ degree. But more importantly, we do not need a highly heterogeneous degree distribution which was an essential condition to obtain a cooperation supporting mechanism previously.


Figure 4: Cooperation level in dependence on synergy factor for different values of parameter as indicated in the figure legend. Here random interaction graph was applied where we used the same degree as for square lattice. The cooperator supporting consequence of the selected investment protocol remained intact no matter random topology was used. The system contained players.

Until this point we assumed that cooperators were uniform and they all have a certain chance to switch from traditional cooperator into the selective cooperator state, which is controlled by parameter . The phase diagram, however, illustrates that the best solution can be reached at , which means that cooperators always behave as selective cooperator in the latter case. An intriguing question can be posed, here. Namely, is it possible to reach a higher global well-being via a selection mechanism? Put differently, how does the system evolve if we introduce pure cooperators and selective cooperators as permanent strategies simultaneously? In the latter case we have a three-strategy model where unconditional defection (), unconditional cooperation () and selective cooperation () strategies compete. Their relation is far from trivial because a and a player have identical cost, the only difference is how they distribute their investment. Furthermore, an supports just only one of his neighbors, therefore the emergence of networks reciprocity, which is a basic mechanism in structured populations, can hardly evolve among players. To clarify this question we have studied this modified model and found that unconditional cooperators always die out, hence the evolutionary outcome depends only on the relation of and strategies. In other words, the system always terminates into the state that was observed for the case in the previously studied homogeneous model. Therefore we can conclude that strategy, which is globally beneficial, could be selected during an evolutionary process.

To understand the mechanism more deeply, which is responsible for the advantage of strategy, in Fig. 5 we present a pattern formation process when the system was launched from a prepared initial state. Here the three competing strategies are designated by different colors. Namely, defectors are marked by red, unconditional cooperators by deep blue while selective cooperators are denoted by light blue. Intentionally, we here choose a low value of synergy factor that would result in a full defection in the traditional model. For easier comparison we marked by dashed yellow lines the original positions of border lines. In panel (b) and in panel (c) it is easy to see that both defectors and players invade unconditional cooperators. But the invasion of strategy is more effective and they invade the majority of space originally occupied by strategy. When players die out, the proper final state of the evolution depends only on the relation of and strategies. At the mentioned specific value of synergy factor, as already shown in Fig. 3, invade defectors and prevail the whole system. Note that this final state is not shown in the plot.

Figure 5: Characteristic snapshots of pattern formation starting from a prepared initial state. Here we have three pure strategies, namely defectors (red), unconditional cooperators (dark blue), and selective cooperators (light blue). The initial positions of frontiers are marked by dashed yellow lines in all panels. Panel (b) illustrates clearly that both defectors and selective cooperators invade unconditional cooperators. But defectors, shown in panel (c), do it more efficiently and conquer the majority of space originally occupied by unconditional cooperators. Selective cooperators, however, dominate defectors and finally prevail the whole system (not shown). The snapshots of system were taken at 0 (a), 100 (b), 200 (c) and 700 (d) full steps, and the synergy parameter value was .

For a full explanation, it is instructive to apply an alternative coloring technique that reveals the representative microscopic process. For this purpose, we use not just the previously introduced colors of strategies but we also add three extra colors. Namely, we mark by black, gray, and white colors those , and players respectively who are supported by a neighboring player with an extra large investment. This coloring technique is applied in Fig. 6 where we present a smaller system to make individual players visible. Similarly to the previous plot here we used the same parameter value, therefore the system will terminate again into the full state (not shown in the figure). In panel (a) we only see white “highly supported” players who are distributed randomly in the bulk of domain. This is due to the originally randomly distributed payoff values in the zero step. Later, when the strategy propagation is launched, fronts start moving between homogeneous domains. Interestingly, however, it is very rare that black or gray pixels emerge, which simply means that it almost never happens that an player supports a neighboring or player. Furthermore, which is also very important, white pixels cannot be detected in the front line. More precisely, at the front separating and domains, it is typical that red and light blue players are facing each other. Similar situation can be detected at the front between and domains, where black and white pixels are hardly detected. The representative feature of the emerging patterns are highlighted by yellow ellipses in the panels (b–c) of Fig. 6.

Figure 6: Pattern formation starting from the same initial setup as for Fig. 5. Here we used a special coloring to mark those players who have the highest payoff in a group and enjoy the support of a neighboring selective cooperator player. More specifically, we mark those defectors, unconditional cooperators, and selective cooperators by black, gray, and white color respectively. For clarity we present a smaller system where individual players are visible. The mentioned supported players are not present in the borderline between competing domains, but they are generally behind it in the next lines. Their typical positions during the evolution are highlighted by yellow ellipses in panels (b-d).

Based on these observations we can easily reveal the key mechanism that is responsible for the success of strategy. For simplicity, we describe the elementary step of domain wall propagation between and domains, but conceptually similar explanation can be given for the competition of and strategies. In Fig. 7 we show the competing domains, where neighboring and compare their payoff during the strategy invasion. In the traditional model would exploit a neighboring cooperator partner. First, because an unconditional cooperator would invest directly to the game organized by . Secondly, would largely benefit from the game organized by the mentioned cooperator because a substantial contribution is collected from cooperator members of the mentioned group. But now both elements are missing. First, does not invest directly into the game organized by because is more attractive target by having a higher payoff. Secondly, the income from the game organized by is minimal. It is because only invests into his own game marked by a solid yellow circle, all other neighboring selective cooperator support a more successful neighbor. In sum, has only a modest income in the neighborhood of an player.


Figure 7: Mechanism that blocks the invasion of defector strategy. Here we used the same color coding as for previous Fig. 6. Accordingly, defector and selective cooperator domains compete where white color marks those players who are supported exclusively by neighboring partners. cooperator at the border cannot utilize the selective cooperator player because donates all his external contribution to the game organized by player. Furthermore, has just a minimal benefit from the game organized by player because here the only contribution comes from . This group is marked by a solid yellow curve. On the other hand, is able to collect a reasonable income from the game organized by the player. The latter group is marked by a dashed yellow circle. As a result, ’s cumulative payoff can be larger than the payoff of player even for relatively small values.

As we argued, is weakened at the front, but he has an escape route not to be totally vulnerable. It is because benefits from the very successful game organized by the neighboring player. This game is marked by a dashed yellow circle in the plot. Here not just , but also other neighboring players invest a huge amount into the game, hence all enjoy a large split after multiplication. As a result, still has a reasonable payoff that is competitive to the payoff of . Summing up, the introduction of a selective investment policy results in weakened players in both sided of the front, but defectors suffer more, hence their invasions are largely blocked.

It is easy to see that similar argument can be given for the competition of and strategies, which explains why invades unconditional cooperation no matter they bear the same total cost and the emergence of network reciprocity is less obvious for the former strategy.

4 Conclusion

It is clear to see that when someone cooperates then the primary aim is to elevate the general well-being of the group or community. But one may ask which way serves this goal more efficiently? Is it better to support anyone or is there a smarter way to use our efforts? For instance, one may argue that it is useless to support a group which does not functioning well, where the leader is unsuccessful. On the other hand, our investment may reach the highest impact if we focus on a venture that is organized by a successful player. In this work we have elaborated this idea where we allowed cooperator players to concentrate their external investments to a single group led by the most successful neighbor. Importantly, a cooperator does not consider the strategy of the target neighbor, but checks only its payoff. In this way the decision about a cooperator’s investment requires no extra information comparing to the standard public goods game. Surprisingly, the suggested strategy-neutral investment policy elevates the cooperation level dramatically even at small values of synergy factor, where the traditional model would suggest a full defection state.

We note that different forms of heterogeneous investment was already studied by several earlier works Cao et al. (2010); Wang et al. (2018); Fan et al. (2017). However, they assumed more complicated rules which demand more intellectual effort, hence additional care from cooperator players. Our present model, however, is the simplest because it assumes nothing additional information than is already available for players during the strategy imitation process. It is worth stressing that the present positive effect also works in homogeneous graphs where some earlier models, which built on the strong heterogeneity of the interaction graph, would fail to support cooperation.

The microscopic mechanism, which explains the success of the suggested protocol, is based not on the usual reciprocity-based arguments. The latter can be found in various forms in models of structured populations, where limited number of interactions of players offers not just the chance to separate from those who exploit others but also enlarge the positive consequence of direct reciprocity Allen et al. (2018); Shao et al. (2019); Fotouhi et al. (2019); Wang et al. (2020). In our present case, as we argued, the introduced investment policy weaken all fighters who are in the front line between the competing domains - independently of their actual strategies. But this weakening effect is biased and defectors suffer more from it. As a consequence, they are unable to exploit the vicinity of cooperators hence they loose their evolutionary advantage. They become less attractive and their invasion is completely blocked. The mentioned weakened cooperators in the front line, however, still have a chance to enjoy the vicinity of successful cooperators behind them, hence they benefit modestly from the success of their neighbors. In sum, weakened cooperators still do better than weakened defectors, hence the direction of strategy propagation can be reversed.

It is worth noting that the reported cooperator supporting mechanism fits nicely to those observations where the introduced strategy-neutral rule has biased impact on the strategy invasion of competing strategies Szolnoki et al. (2009); Du et al. (2012); Szolnoki and Chen (2018b); Chang et al. (2018); Szolnoki and Perc (2019); Fu et al. (2019). Hence these mechanisms provide an alternative way to understand to original enigma and explain why cooperation may prevail among selfish agents.

This research was supported by the Hungarian National Research Fund (Grant K-120785) and by the National Natural Science Foundation of China (Grants No. 61976048 and No. 61503062).

References

  • Szabó and Fáth (2007) G. Szabó, G. Fáth, Evolutionary games on graphs, Phys. Rep. 446 (2007) 97–216.
  • Perc and Szolnoki (2010) M. Perc, A. Szolnoki, Coevolutionary games – a mini review, BioSystems 99 (2010) 109–125.
  • Sigmund (2010) K. Sigmund, The Calculus of Selfishness, Princeton University Press, Princeton, NJ, 2010.
  • Szolnoki et al. (2014) A. Szolnoki, M. Mobilia, L.-L. Jiang, B. Szczesny, A. M. Rucklidge, M. Perc, Cyclic dominance in evolutionary games: a review, J. R. Soc. Interface 11 (2014) 20140735.
  • Cheng et al. (2019) F. Cheng, T. Chen, Q. Chen, Matching donations based on social capital in Internet crowdfunding can promote cooperation, Physica A 531 (2019) 121766.
  • Murase and Baek (2018) Y. Murase, S. K. Baek, Seven rules to avoid the tragedy of the commons, J. Theor. Biol. 449 (2018) 94–102.
  • Takeshue (2019) H. Takeshue, Roles of mutation rate and co-existence of multiple strategy updating rules in evolutionary prisoner’s dilemma games, EPL 126 (2019) 58001.
  • Liu et al. (2019) D. Liu, C. Huang, Q. Dai, H. Li, Positive correlation between strategy persistence and teaching ability promotes cooperation in evolutionary prisoner’s dilemma games, Physica A 520 (2019) 267–274.
  • Nowak (2006) M. A. Nowak, Five Rules for the Evolution of Cooperation, Science 314 (2006) 1560–1563.
  • Sigmund et al. (2001) K. Sigmund, C. Hauert, M. A. Nowak, Reward and Punishment, Proc. Natl. Acad. Sci. USA 98 (2001) 10757–10762.
  • Szolnoki and Perc (2010) A. Szolnoki, M. Perc, Reward and cooperation in the spatial public goods game, EPL 92 (2010) 38003.
  • Cong et al. (2017) R. Cong, Q. Zhao, K. Li, L. Wang, Individual mobility promotes punishment in evolutionary public goods games, Sci. Rep. 7 (2017) 14015.
  • Szolnoki and Perc (2012) A. Szolnoki, M. Perc, Evolutionary advantages of adaptive rewarding, New J. Phys. 14 (2012) 093016.
  • Takesue (2018) H. Takesue, Evolutionary prisoner’s dilemma games on the network with punishment and opportunistic partner switching, EPL 121 (2018) 48005.
  • Szolnoki and Chen (2017) A. Szolnoki, X. Chen, Alliance formation with exclusion in the spatial public goods game, Phys. Rev. E 95 (2017) 052316.
  • Liu et al. (2017) L. Liu, X. Chen, A. Szolnoki, Competitions between prosocial exclusions and punishments in finite populations, Sci. Rep. 7 (2017) 46634.
  • Quan et al. (2019) J. Quan, X. Li, X. Wang, The evolution of cooperation in spatial public goods game with conditional peer exclusion, Chaos 29 (2019) 103137.
  • Panchanathan and Boyd (2004) K. Panchanathan, R. Boyd, Indirect reciprocity can stabilize cooperation without the second-order free rider problem, Nature 432 (2004) 499–502.
  • Helbing et al. (2010a) D. Helbing, A. Szolnoki, M. Perc, G. Szabó, Evolutionary establishment of moral and double moral standards through spatial interactions, PLoS Comput. Biol. 6 (2010a) e1000758.
  • Helbing et al. (2010b) D. Helbing, A. Szolnoki, M. Perc, G. Szabó, Punish, but not too hard: how costly punishment spreads in the spatial public goods game, New J. Phys. 12 (2010b) 083005.
  • Szolnoki et al. (2011) A. Szolnoki, G. Szabó, L. Czakó, Competition of individual and institutional punishments in spatial public goods games, Phys. Rev. E 84 (2011) 046106.
  • Santos and Pacheco (2005) F. C. Santos, J. M. Pacheco, Scale-free networks provide a unifying framework for the emergence of cooperation, Phys. Rev. Lett. 95 (2005) 098104.
  • Szolnoki and Szabó (2007) A. Szolnoki, G. Szabó, Cooperation enhanced by inhomogeneous activity of teaching for evolutionary Prisoner’s Dilemma games, EPL 77 (2007) 30004.
  • Perc and Szolnoki (2008) M. Perc, A. Szolnoki, Social diversity and promotion of cooperation in the spatial prisoner’s dilemma game, Phys. Rev. E 77 (2008) 011904.
  • Rong et al. (2019) Z. Rong, Z.-X. Wu, X. Li, P. Holme, G. Chen, Heterogeneous cooperative leadership structure emerging from random regular graphs, Chaos 29 (2019) 103103.
  • Szolnoki and Perc (2015) A. Szolnoki, M. Perc, Conformity enhances network reciprocity in evolutionary social dilemmas, J. R. Soc. Interface 12 (2015) 20141299.
  • Yang and Tian (2017) H.-X. Yang, L. Tian, Enhancement of cooperation through conformity-driven reproductive ability, Chaos, Solitons and Fractals 103 (2017) 159–162.
  • Szolnoki and Chen (2018a) A. Szolnoki, X. Chen, Competition and partnership between conformity and payoff-based imitations in social dilemmas, New J. Phys. 20 (2018a) 093008.
  • Yang and Yang (2018) H.-X. Yang, J. Yang, Cooperation percolation in spatial evolutionary games, EPL 124 (2018) 60005.
  • Cao et al. (2010) X.-B. Cao, W.-B. Du, Z.-H. Rong, Evolutionary public goods game on scale-free networks with heterogeneous investment, Physica A 389 (2010) 1273–1280.
  • Wang et al. (2018) H. Wang, Y. Sun, L. Zheng, W. Du, Y. Li, The public goods game on scale-free networks with heterogeneous investment, Physica A 509 (2018) 396–404.
  • Vukov et al. (2011) J. Vukov, F. Santos, J. Pacheco, Escaping the tragedy of the commons via directed investments, J. Theor. Biol. 287 (2011) 37–41.
  • Zhang et al. (2012) H. Zhang, D. Shi, R. Liu, B. Wang, Dynamic allocation of investments promotes cooperation in spatial public goods game, Physica A 391 (2012) 2617–2622.
  • Yuan and Xia (0141) W.-J. Yuan, C.-Y. Xia, Role of Investment Heterogeneity in the Cooperation on Spatial Public Goods Game, PLoS ONE 9 (20141) e91012.
  • Yang and Yang (2019) H.-X. Yang, J. Yang, Reputation-based investment strategy promotes cooperation in public goods games, Physica A 523 (2019) 886–893.
  • Szabó et al. (2004) G. Szabó, A. Szolnoki, R. Izsák, Rock-scissors-paper game on regular small-world networks J. Phys. A: Math. Gen. 37 (2004) 2599–2609.
  • Szabó and Tőke (1998) G. Szabó, C. Tőke, Evolutionary prisoner’s dilemma game on a square lattice, Phys. Rev. E 58 (1998) 69–73.
  • Santos et al. (2008) F. C. Santos, M. D. Santos, J. M. Pacheco, Social diversity promotes the emergence of cooperation in public goods games, Nature 454 (2008) 213–216.
  • Fan et al. (2017) R. Fan, Y. Zhang, M. Luo, H. Zhang, Promotion of cooperation induced by heterogeneity of both investment and payoff allocation in spatial public goods game, Physica A 465 (2017) 454–463.
  • Allen et al. (2018) J. M. Allen, A. C. Skeldon, R. B. Hoyle, Social influence preserves cooperative strategies in the conditional cooperator public goods game on a multiplex network, Phys. Rev. E 98 (2018) 062305.
  • Shao et al. (2019) Y. Shao, X. Wang, F. Fu, Evolutionary dynamics of group cooperation with asymmetrical environmental feedback, EPL 126 (2019) 40005.
  • Fotouhi et al. (2019) B. Fotouhi, N. Momeni, B. Allen, M. A. Nowak, Evolution of cooperation on large networks with community structure, J. R. Soc. Interface 16 (2019) 20180677.
  • Wang et al. (2020) X. Wang, Z. Zheng, F. Fu, Steering eco-evolutionary game dynamics with manifold control, Proc. R. Soc. A 476 (2020) 20190643.
  • Szolnoki et al. (2009) A. Szolnoki, M. Perc, G. Szabó, H.-U. Stark, Impact of aging on the evolution of cooperation in the spatial prisoner’s dilemma game, Phys. Rev. E 80 (2009) 021901.
  • Du et al. (2012) W.-B. Du, X.-B. Cao, R.-R. Liu, Z. Wang, Effects of Inertia on Evolutionary Prisoner’s Dilemma Game, Commun. Theor. Phys. 58 (2012) 451–455.
  • Szolnoki and Chen (2018b) A. Szolnoki, X. Chen, Reciprocity-based cooperative phalanx maintained by overconfident players, Phys. Rev. E 98 (2018b) 022309.
  • Chang et al. (2018) S. Chang, Z. Zhang, Y. Wu, Y. Xie, Cooperation is enhanced by inhomogeneous inertia in spatial prisoner’s dilemma game, Physica A 490 (2018) 419–425.
  • Szolnoki and Perc (2019) A. Szolnoki, M. Perc, Seasonal payoff variations and the evolution of cooperation in social dilemmas, Sci. Rep. 9 (2019) 12575.
  • Fu et al. (2019) M. Fu, W. Guo, L. Cheng, S. Huang, D. Chen, History loyalty-based reward promotes cooperation in the spatial public goods game, Physica A 525 (2019) 1323–1329.