Anytime Game-Theoretic Planning with Active Reasoning About Humans' Latent States for Human-Centered Robots

09/26/2021
by   Ran Tian, et al.
0

A human-centered robot needs to reason about the cognitive limitation and potential irrationality of its human partner to achieve seamless interactions. This paper proposes an anytime game-theoretic planner that integrates iterative reasoning models, a partially observable Markov decision process, and chance-constrained Monte-Carlo belief tree search for robot behavioral planning. Our planner enables a robot to safely and actively reason about its human partner's latent cognitive states (bounded intelligence and irrationality) in real-time to maximize its utility better. We validate our approach in an autonomous driving domain where our behavioral planner and a low-level motion controller hierarchically control an autonomous car to negotiate traffic merges. Simulations and user studies are conducted to show our planner's effectiveness.

READ FULL TEXT
research
01/22/2023

Game Theoretic Decision Making by Actively Learning Human Intentions Applied on Autonomous Driving

The ability to estimate human intentions and interact with human drivers...
research
03/05/2020

Autonomous Driving at Intersections: A Critical-Turning-Point Approach for Left Turns

Left-turn planning is one of the formidable challenges for autonomous ve...
research
09/23/2022

LEADER: Learning Attention over Driving Behaviors for Planning under Uncertainty

Uncertainty on human behaviors poses a significant challenge to autonomo...
research
01/11/2021

Closing the Planning-Learning Loop with Application to Autonomous Driving in a Crowd

Imagine an autonomous robot vehicle driving in dense, possibly unregulat...
research
05/28/2020

Improving Automated Driving through Planning with Human Internal States

This work examines the hypothesis that partially observable Markov decis...
research
02/02/2017

The Value of Inferring the Internal State of Traffic Participants for Autonomous Freeway Driving

Safe interaction with human drivers is one of the primary challenges for...
research
05/29/2019

LeTS-Drive: Driving in a Crowd by Learning from Tree Search

Autonomous driving in a crowded environment, e.g., a busy traffic inters...

Please sign up or login with your details

Forgot password? Click here to reset