A Game-Theoretic Model and Best-Response Learning Method for Ad Hoc Coordination in Multiagent Systems

06/03/2015
by   Stefano V. Albrecht, et al.
0

The ad hoc coordination problem is to design an autonomous agent which is able to achieve optimal flexibility and efficiency in a multiagent system with no mechanisms for prior coordination. We conceptualise this problem formally using a game-theoretic model, called the stochastic Bayesian game, in which the behaviour of a player is determined by its private information, or type. Based on this model, we derive a solution, called Harsanyi-Bellman Ad Hoc Coordination (HBA), which utilises the concept of Bayesian Nash equilibrium in a planning procedure to find optimal actions in the sense of Bellman optimal control. We evaluate HBA in a multiagent logistics domain called level-based foraging, showing that it achieves higher flexibility and efficiency than several alternative algorithms. We also report on a human-machine experiment at a public science exhibition in which the human participants played repeated Prisoner's Dilemma and Rock-Paper-Scissors against HBA and alternative algorithms, showing that HBA achieves equal efficiency and a significantly higher welfare and winning rate.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2018

A Courteous Learning Rule for Ad-hoc Anti-coordination

In this paper, we investigate the problem of anti-coordination under rat...
research
02/10/2019

Learning Best Response Strategies for Agents in Ad Exchanges

Ad exchanges are widely used in platforms for online display advertising...
research
09/12/2017

Enemy At the Gateways: A Game Theoretic Approach to Proxy Distribution

A core technique used by popular proxy-based circumvention systems like ...
research
02/11/2016

Modeling Human Ad Hoc Coordination

Whether in groups of humans or groups of computer agents, collaboration ...
research
06/19/2023

Controlling Type Confounding in Ad Hoc Teamwork with Instance-wise Teammate Feedback Rectification

Ad hoc teamwork requires an agent to cooperate with unknown teammates wi...
research
04/12/2021

From partners to populations: A hierarchical Bayesian account of coordination and convention

Languages are powerful solutions to coordination problems: they provide ...
research
01/10/2022

Assisting Unknown Teammates in Unknown Tasks: Ad Hoc Teamwork under Partial Observability

In this paper, we present a novel Bayesian online prediction algorithm f...

Please sign up or login with your details

Forgot password? Click here to reset