Systematic Generalization for Predictive Control in Multivariate Time Series

02/10/2021
by   Hritik Bansal, et al.
18

Prior work has focused on evaluating the ability of neural networks to reason about novel combinations from known components, an intrinsic property of human cognition. In this work, we aim to study systematic generalization in predicting future state trajectories of a dynamical system, conditioned on past states' trajectory (dependent variables), past and future actions (control variables). In our context, systematic generalization implies that a good model should perform well on all new combinations of future actions after being trained on all of them, but only on a limited set of their combinations. For models to generalize out-of-distribution to unseen action combinations, they should reason about the states and their dependency relation with the applied actions. We conduct a rigorous study of useful inductive biases that learn to predict the trajectories up to large horizons well, and capture true dependency relations between the states and the controls through our synthetic setup, and simulated data from electric motors.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

03/12/2017

Prediction and Control with Temporal Segment Models

We introduce a method for learning the dynamics of complex nonlinear sys...
11/28/2021

ORCHARD: A Benchmark For Measuring Systematic Generalization of Multi-Hierarchical Reasoning

The ability to reason with multiple hierarchical structures is an attrac...
11/13/2020

Learning Predictive Models for Ergonomic Control of Prosthetic Devices

We present Model-Predictive Interaction Primitives – a robot learning fr...
12/12/2016

Generalizable Features From Unsupervised Learning

Humans learn a predictive model of the world and use this model to reaso...
07/09/2021

Probabilistic Trajectory Prediction with Structural Constraints

This work addresses the problem of predicting the motion trajectories of...
07/15/2020

On the Capability of Neural Networks to Generalize to Unseen Category-Pose Combinations

Recognizing an object's category and pose lies at the heart of visual un...
06/08/2021

PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning

Learning good feature representations is important for deep reinforcemen...

Code Repositories

MultivariateTimeSeries_Generalization

None


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.