Tensor Decomposition for Multi-agent Predictive State Representation

05/27/2020
by   Bilian Chen, et al.
0

Predictive state representation (PSR) uses a vector of action-observation sequence to represent the system dynamics and subsequently predicts the probability of future events. It is a concise knowledge representation that is well studied in a single-agent planning problem domain. To the best of our knowledge, there is no existing work on using PSR to solve multi-agent planning problems. Learning a multi-agent PSR model is quite difficult especially with the increasing number of agents, not to mention the complexity of a problem domain. In this paper, we resort to tensor techniques to tackle the challenging task of multi-agent PSR model development problems. By first focusing on a two-agent setting, we construct the system dynamics matrix as a high order tensor for a PSR model, learn the prediction parameters and deduce state vectors directly through two different tensor decomposition methods respectively, and derive the transition parameters via linear regression. Subsequently, we generalize the PSR learning approaches in a multi-agent setting. Experimental results show that our methods can effectively solve multi-agent PSR modelling problems in multiple problem domains.

READ FULL TEXT

page 12

page 14

page 15

research
06/19/2017

VAIN: Attentional Multi-agent Predictive Modeling

Multi-agent predictive modeling is an essential step for understanding p...
research
09/11/2018

Factorized Q-Learning for Large-Scale Multi-Agent Systems

Deep Q-learning has achieved a significant success in single-agent decis...
research
10/28/2022

Forecasting local behavior of multi-agent system and its application to forest fire model

In this paper, we study a CNN-LSTM model to forecast the state of a spec...
research
10/27/2021

Model based Multi-agent Reinforcement Learning with Tensor Decompositions

A challenge in multi-agent reinforcement learning is to be able to gener...
research
09/02/2023

Multi-agent Collective Construction using 3D Decomposition

This paper addresses a Multi-Agent Collective Construction (MACC) proble...
research
11/06/2020

Learning Online Data Association

When an agent interacts with a complex environment, it receives a stream...
research
06/23/2021

Robust Task Scheduling for Heterogeneous Robot Teams under Capability Uncertainty

This paper develops a stochastic programming framework for multi-agent s...

Please sign up or login with your details

Forgot password? Click here to reset