A Bayesian Framework for Nash Equilibrium Inference in Human-Robot Parallel Play

06/10/2020
by   Shray Bansal, et al.
44

We consider shared workspace scenarios with humans and robots acting to achieve independent goals, termed as parallel play. We model these as general-sum games and construct a framework that utilizes the Nash equilibrium solution concept to consider the interactive effect of both agents while planning. We find multiple Pareto-optimal equilibria in these tasks. We hypothesize that people act by choosing an equilibrium based on social norms and their personalities. To enable coordination, we infer the equilibrium online using a probabilistic model that includes these two factors and use it to select the robot's action. We apply our approach to a close-proximity pick-and-place task involving a robot and a simulated human with three potential behaviors - defensive, selfish, and norm-following. We showed that using a Bayesian approach to infer the equilibrium enables the robot to complete the task with less than half the number of collisions while also reducing the task execution time as compared to the best baseline. We also performed a study with human participants interacting either with other humans or with different robot agents and observed that our proposed approach performs similar to human-human parallel play interactions. The code is available at https://github.com/shray/bayes-nash

READ FULL TEXT

page 1

page 6

page 7

research
02/11/2020

Inference-Based Strategy Alignment for General-Sum Differential Games

In many settings where multiple agents interact, the optimal choices for...
research
12/30/2021

From Behavioral Theories to Econometrics: Inferring Preferences of Human Agents from Data on Repeated Interactions

We consider the problem of estimating preferences of human agents from d...
research
01/27/2022

Decentralized Fictitious Play Converges Near a Nash Equilibrium in Near-Potential Games

We investigate convergence of decentralized fictitious play (DFP) in nea...
research
04/23/2023

Should Collaborative Robots be Transparent?

Today's robots often assume that their behavior should be transparent. T...
research
12/06/2021

Invitation in Crowdsourcing Contests

In a crowdsourcing contest, a requester holding a task posts it to a cro...
research
12/21/2022

Strategic multi-task coordination over regular networks of robots with limited computation and communication capabilities

Coordination is a desirable feature in multi-agent systems, allowing the...
research
07/18/2021

Distributed Planning for Serving Cooperative Tasks with Time Windows: A Game Theoretic Approach

We study distributed planning for multi-robot systems to provide optimal...

Please sign up or login with your details

Forgot password? Click here to reset