Catastrophe by Design in Population Games: Destabilizing Wasteful Locked-in Technologies

07/25/2020
by   Stefanos Leonardos, et al.
0

In multi-agent environments in which coordination is desirable, the history of play often causes lock-in at sub-optimal outcomes. Notoriously, technologies with a significant environmental footprint or high social cost persist despite the successful development of more environmentally friendly and/or socially efficient alternatives. The displacement of the status quo is hindered by entrenched economic interests and network effects. To exacerbate matters, the standard mechanism design approaches based on centralized authorities with the capacity to use preferential subsidies to effectively dictate system outcomes are not always applicable to modern decentralized economies. What other types of mechanisms are feasible? In this paper, we develop and analyze a mechanism that induces transitions from inefficient lock-ins to superior alternatives. This mechanism does not exogenously favor one option over another – instead, the phase transition emerges endogenously via a standard evolutionary learning model, Q-learning, where agents trade-off exploration and exploitation. Exerting the same transient influence to both the efficient and inefficient technologies encourages exploration and results in irreversible phase transitions and permanent stabilization of the efficient one. On a technical level, our work is based on bifurcation and catastrophe theory, a branch of mathematics that deals with changes in the number and stability properties of equilibria. Critically, our analysis is shown to be structurally robust to significant and even adversarially chosen perturbations to the parameters of both our game and our behavioral model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/05/2020

Exploration-Exploitation in Multi-Agent Learning: Catastrophe Theory Meets Game Theory

Exploration-exploitation is a powerful and practical tool in multi-agent...
research
12/27/2022

Strangeness-driven Exploration in Multi-Agent Reinforcement Learning

Efficient exploration strategy is one of essential issues in cooperative...
research
07/10/2023

An evolutionary game with environmental feedback and players' opinions

Evolutionary games are a developing sub-field of game theory. This branc...
research
09/24/2020

Evolution of Coordination in Pairwise and Multi-player Interactions via Prior Commitments

Upon starting a collective endeavour, it is important to understand your...
research
10/04/2021

Inducing Equilibria via Incentives: Simultaneous Design-and-Play Finds Global Optima

To regulate a social system comprised of self-interested agents, economi...
research
05/01/2023

Multi-Agent Systems with Quantitative Satisficing Goals

In the study of reactive systems, qualitative properties are usually eas...

Please sign up or login with your details

Forgot password? Click here to reset