Location-Based Reasoning about Complex Multi-Agent Behavior

01/18/2014
by   Adam Sadilek, et al.
0

Recent research has shown that surprisingly rich models of human activity can be learned from GPS (positional) data. However, most effort to date has concentrated on modeling single individuals or statistical properties of groups of people. Moreover, prior work focused solely on modeling actual successful executions (and not failed or attempted executions) of the activities of interest. We, in contrast, take on the task of understanding human interactions, attempted interactions, and intentions from noisy sensor data in a fully relational multi-agent setting. We use a real-world game of capture the flag to illustrate our approach in a well-defined domain that involves many distinct cooperative and competitive joint activities. We model the domain using Markov logic, a statistical-relational language, and learn a theory that jointly denoises the data and infers occurrences of high-level activities, such as a player capturing an enemy. Our unified model combines constraints imposed by the geometry of the game area, the motion model of the players, and by the rules and dynamics of the game in a probabilistically and logically sound fashion. We show that while it may be impossible to directly detect a multi-agent activity due to sensor noise or malfunction, the occurrence of the activity can still be inferred by considering both its impact on the future behaviors of the people involved as well as the events that could have preceded it. Further, we show that given a model of successfully performed multi-agent activities, along with a set of examples of failed attempts at the same activities, our system automatically learns an augmented model that is capable of recognizing success and failure, as well as goals of peoples actions with high accuracy. We compare our approach with other alternatives and show that our unified model, which takes into account not only relationships among individual players, but also relationships among activities over the entire length of a game, although more computationally costly, is significantly more accurate. Finally, we demonstrate that explicitly modeling unsuccessful attempts boosts performance on other important recognition tasks.

READ FULL TEXT

page 4

page 5

page 33

page 34

research
09/19/2018

Pommerman: A Multi-Agent Playground

We present Pommerman, a multi-agent environment based on the classic con...
research
06/13/2007

Towards understanding and modelling office daily life

Measuring and modeling human behavior is a very complex task. In this pa...
research
07/12/2022

Reward-Sharing Relational Networks in Multi-Agent Reinforcement Learning as a Framework for Emergent Behavior

In this work, we integrate `social' interactions into the MARL setup thr...
research
01/19/2022

RunnerDNA: Interpretable indicators and model to characterize human activity pattern and individual difference

Human activity analysis based on sensor data plays a significant role in...
research
02/05/2021

baller2vec: A Multi-Entity Transformer For Multi-Agent Spatiotemporal Modeling

Multi-agent spatiotemporal modeling is a challenging task from both an a...
research
06/19/2018

VirtualHome: Simulating Household Activities via Programs

In this paper, we are interested in modeling complex activities that occ...
research
08/21/2020

Evaluation of the cumulated impacts on the marine resource of a socio-ecological coral system: approach by agent-based modeling

In the context of climate change and significant changes in human activi...

Please sign up or login with your details

Forgot password? Click here to reset