Motron: Multimodal Probabilistic Human Motion Forecasting

03/08/2022
by   Tim Salzmann, et al.
0

Autonomous systems and humans are increasingly sharing the same space. Robots work side by side or even hand in hand with humans to balance each other's limitations. Such cooperative interactions are ever more sophisticated. Thus, the ability to reason not just about a human's center of gravity position, but also its granular motion is an important prerequisite for human-robot interaction. Though, many algorithms ignore the multimodal nature of humans or neglect uncertainty in their motion forecasts. We present Motron, a multimodal, probabilistic, graph-structured model, that captures human's multimodality using probabilistic methods while being able to output deterministic maximum-likelihood motions and corresponding confidence values for each mode. Our model aims to be tightly integrated with the robotic planning-control-interaction loop; outputting physically feasible human motions and being computationally efficient. We demonstrate the performance of our model on several challenging real-world motion forecasting datasets, outperforming a wide array of generative/variational methods while providing state-of-the-art single-output motions if required. Both using significantly less computational power than state-of-the art algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2020

Trajectron++: Multi-Agent Generative Trajectory Forecasting With Heterogeneous Data for Control

Reasoning about human motion through an environment is an important prer...
research
07/14/2021

Probabilistic Human Motion Prediction via A Bayesian Neural Network

Human motion prediction is an important and challenging topic that has p...
research
08/11/2023

A Game-Theoretic Framework for Joint Forecasting and Planning

Planning safe robot motions in the presence of humans requires reliable ...
research
09/16/2020

MATS: An Interpretable Trajectory Forecasting Representation for Planning and Control

Reasoning about human motion is a core component of modern human-robot i...
research
06/18/2023

Language-Guided Generation of Physically Realistic Robot Motion and Control

We aim to control a robot to physically behave in the real world followi...
research
03/06/2018

Generative Modeling of Multimodal Multi-Human Behavior

This work presents a methodology for modeling and predicting human behav...
research
02/27/2017

Anticipating many futures: Online human motion prediction and synthesis for human-robot collaboration

Fluent and safe interactions of humans and robots require both partners ...

Please sign up or login with your details

Forgot password? Click here to reset