DeepAI AI Chat
Log In Sign Up

Policy learning with partial observation and mechanical constraints for multi-person modeling

by   Keisuke Fujii, et al.

Extracting the rules of real-world biological multi-agent behaviors is a current challenge in various scientific and engineering fields. Biological agents generally have limited observation and mechanical constraints; however, most of the conventional data-driven models ignore such assumptions, resulting in lack of biological plausibility and model interpretability for behavioral analyses in biological and cognitive science. Here we propose sequential generative models with partial observation and mechanical constraints, which can visualize whose information the agents utilize and can generate biologically plausible actions. We formulate this as a decentralized multi-agent imitation learning problem, leveraging binary partial observation models with a Gumbel-Softmax reparameterization and policy models based on hierarchical variational recurrent neural networks with physical and biomechanical constraints. We investigate the empirical performances using real-world multi-person motion datasets from basketball and soccer games.


page 16

page 17


Data-driven Analysis for Understanding Team Sports Behaviors

Understanding the principles of real-world biological multi-agent behavi...

Imitation Learning of Factored Multi-agent Reactive Models

We apply recent advances in deep generative modeling to the task of imit...

Modeling Social Group Communication with Multi-Agent Imitation Learning

In crowded social scenarios with a myriad of external stimuli, human bra...

Learning interaction rules from multi-animal trajectories via augmented behavioral models

Extracting the interaction rules of biological agents from moving sequen...

Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations

Modeling of real-world biological multi-agents is a fundamental problem ...

Analysis for full face mechanical behaviors through spatial deduction model with real-time monitoring data

Mechanical analysis for the full face of tunnel structure is crucial to ...