Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction

06/09/2019
by   Osama Makansi, et al.
8

Future prediction is a fundamental principle of intelligence that helps plan actions and avoid possible dangers. As the future is uncertain to a large extent, modeling the uncertainty and multimodality of the future states is of great relevance. Existing approaches are rather limited in this regard and mostly yield a single hypothesis of the future or, at the best, strongly constrained mixture components that suffer from instabilities in training and mode collapse. In this work, we present an approach that involves the prediction of several samples of the future with a winner-takes-all loss and iterative grouping of samples to multiple modes. Moreover, we discuss how to evaluate predicted multimodal distributions, including the common real scenario, where only a single sample from the ground-truth distribution is available for evaluation. We show on synthetic and real data that the proposed approach triggers good estimates of multimodal distributions and avoids mode collapse.

READ FULL TEXT

page 1

page 5

page 8

page 12

page 18

research
04/09/2020

6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference

We present a multimodal camera relocalization framework that captures am...
research
03/28/2023

Multimodal Manoeuvre and Trajectory Prediction for Autonomous Vehicles Using Transformer Networks

Predicting the behaviour (i.e. manoeuvre/trajectory) of other road users...
research
08/20/2021

MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Prediction

Pedestrian trajectory prediction is challenging due to its uncertain and...
research
10/08/2021

On the Limitations of Multimodal VAEs

Multimodal variational autoencoders (VAEs) have shown promise as efficie...
research
10/12/2022

DiPA: Diverse and Probabilistically Accurate Interactive Prediction

Accurate prediction is important for operating an autonomous vehicle in ...
research
12/14/2022

Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Expert

Equipping predicted segmentation with calibrated uncertainty is essentia...
research
11/30/2020

RegFlow: Probabilistic Flow-based Regression for Future Prediction

Predicting future states or actions of a given system remains a fundamen...

Please sign up or login with your details

Forgot password? Click here to reset