Emergent Coordination through Game-Induced Nonlinear Opinion Dynamics

04/05/2023
by   Haimin Hu, et al.
0

We present a multi-agent decision-making framework for the emergent coordination of autonomous agents whose intents are initially undecided. Dynamic non-cooperative games have been used to encode multi-agent interaction, but ambiguity arising from factors such as goal preference or the presence of multiple equilibria may lead to coordination issues, ranging from the "freezing robot" problem to unsafe behavior in safety-critical events. The recently developed nonlinear opinion dynamics (NOD) provide guarantees for breaking deadlocks. However, choosing the appropriate model parameters automatically in general multi-agent settings remains a challenge. In this paper, we first propose a novel and principled procedure for synthesizing NOD based on the value functions of dynamic games conditioned on agents' intents. In particular, we provide for the two-player two-option case precise stability conditions for equilibria of the game-induced NOD based on the mismatch between agents' opinions and their game values. We then propose an optimization-based trajectory optimization algorithm that computes agents' policies guided by the evolution of opinions. The efficacy of our method is illustrated with a simulated toll station coordination example.

READ FULL TEXT

page 3

page 8

research
08/02/2021

Tuning Cooperative Behavior in Games with Nonlinear Opinion Dynamics

We examine the tuning of cooperative behavior in repeated multi-agent ga...
research
05/31/2022

Learning Generalizable Risk-Sensitive Policies to Coordinate in Decentralized Multi-Agent General-Sum Games

While various multi-agent reinforcement learning methods have been propo...
research
07/14/2020

On a Competitive Secretary Problem with Deferred Selections

We study secretary problems in settings with multiple agents. In the sta...
research
01/30/2022

Multimodal Maximum Entropy Dynamic Games

Environments with multi-agent interactions often result a rich set of mo...
research
03/08/2023

Distributed Potential iLQR: Scalable Game-Theoretic Trajectory Planning for Multi-Agent Interactions

In this work, we develop a scalable, local trajectory optimization algor...
research
07/18/2022

Learning multi-robot coordination from demonstrations

This paper develops a Distributed Differentiable Dynamic Game (DDDG) fra...
research
04/11/2023

Contingency Games for Multi-Agent Interaction

Contingency planning, wherein an agent generates a set of possible plans...

Please sign up or login with your details

Forgot password? Click here to reset