Inferring Human Intentions from Predicted Action Probabilities

08/23/2023
by   Lei Shi, et al.
0

Predicting the next action that a human is most likely to perform is key to human-AI collaboration and has consequently attracted increasing research interests in recent years. An important factor for next action prediction are human intentions: If the AI agent knows the intention it can predict future actions and plan collaboration more effectively. Existing Bayesian methods for this task struggle with complex visual input while deep neural network (DNN) based methods do not provide uncertainty quantifications. In this work we combine both approaches for the first time and show that the predicted next action probabilities contain information that can be used to infer the underlying intention. We propose a two-step approach to human intention prediction: While a DNN predicts the probabilities of the next action, MCMC-based Bayesian inference is used to infer the underlying intention from these predictions. This approach not only allows for independent design of the DNN architecture but also the subsequently fast, design-independent inference of human intentions. We evaluate our method using a series of experiments on the Watch-And-Help (WAH) and a keyboard and mouse interaction dataset. Our results show that our approach can accurately predict human intentions from observed actions and the implicit information contained in next action probabilities. Furthermore, we show that our approach can predict the correct intention even if only few actions have been observed.

READ FULL TEXT

page 4

page 10

page 11

page 12

page 19

page 20

page 21

page 22

research
07/25/2022

Intention-Conditioned Long-Term Human Egocentric Action Forecasting @ EGO4D Challenge 2022

To anticipate how a human would act in the future, it is essential to un...
research
06/04/2021

History Encoding Representation Design for Human Intention Inference

In this extended abstract, we investigate the design of learning represe...
research
04/26/2020

Predicting Plans and Actions in Two-Player Repeated Games

Artificial intelligence (AI) agents will need to interact with both othe...
research
10/20/2017

Anticipating Daily Intention using On-Wrist Motion Triggered Sensing

Anticipating human intention by observing one's actions has many applica...
research
11/22/2019

Cost-Based Goal Recognition Meets Deep Learning

The ability to observe the effects of actions performed by others and to...
research
09/05/2017

Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention

We present a first-person method for cooperative basketball intention pr...
research
10/28/2022

HaptiX: Extending Cobot's Motion Intention Visualization by Haptic Feedback

Nowadays, robots are found in a growing number of areas where they colla...

Please sign up or login with your details

Forgot password? Click here to reset