Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective

11/29/2021
by   Yuejiang Liu, et al.
24

Learning behavioral patterns from observational data has been a de-facto approach to motion forecasting. Yet, the current paradigm suffers from two shortcomings: brittle under covariate shift and inefficient for knowledge transfer. In this work, we propose to address these challenges from a causal representation perspective. We first introduce a causal formalism of motion forecasting, which casts the problem as a dynamic process with three groups of latent variables, namely invariant mechanisms, style confounders, and spurious features. We then introduce a learning framework that treats each group separately: (i) unlike the common practice of merging datasets collected from different locations, we exploit their subtle distinctions by means of an invariance loss encouraging the model to suppress spurious correlations; (ii) we devise a modular architecture that factorizes the representations of invariant mechanisms and style confounders to approximate a causal graph; (iii) we introduce a style consistency loss that not only enforces the structure of style representations but also serves as a self-supervisory signal for test-time refinement on the fly. Experiment results on synthetic and real datasets show that our three proposed components significantly improve the robustness and reusability of the learned motion representations, outperforming prior state-of-the-art motion forecasting models for out-of-distribution generalization and low-shot transfer.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/18/2021

Causal Forecasting:Generalization Bounds for Autoregressive Models

Despite the increasing relevance of forecasting methods, the causal impl...
11/04/2020

Latent Causal Invariant Model

Current supervised learning can learn spurious correlation during the da...
06/08/2021

Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style

Self-supervised representation learning has shown remarkable success in ...
12/10/2021

Causal Knowledge Guided Societal Event Forecasting

Data-driven societal event forecasting methods exploit relevant historic...
07/05/2021

Causally Invariant Predictor with Shift-Robustness

This paper proposes an invariant causal predictor that is robust to dist...
02/27/2020

How Much Can A Retailer Sell? Sales Forecasting on Tmall

Time-series forecasting is an important task in both academic and indust...
06/12/2020

Domain Generalization using Causal Matching

Learning invariant representations has been proposed as a key technique ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.