Latent ODEs for Irregularly-Sampled Time Series

07/08/2019
by   Yulia Rubanova, et al.
1

Time series with non-uniform intervals occur in many applications, and are difficult to model using standard recurrent neural networks (RNNs). We generalize RNNs to have continuous-time hidden dynamics defined by ordinary differential equations (ODEs), a model we call ODE-RNNs. Furthermore, we use ODE-RNNs to replace the recognition network of the recently-proposed Latent ODE model. Both ODE-RNNs and Latent ODEs can naturally handle arbitrary time gaps between observations, and can explicitly model the probability of observation times using Poisson processes. We show experimentally that these ODE-based models outperform their RNN-based counterparts on irregularly-sampled data.

READ FULL TEXT

page 7

page 20

research
07/11/2023

Enhancing Continuous Time Series Modelling with a Latent ODE-LSTM Approach

Due to their dynamic properties such as irregular sampling rate and high...
research
12/28/2022

Continuous Depth Recurrent Neural Differential Equations

Recurrent neural networks (RNNs) have brought a lot of advancements in s...
research
04/11/2022

Time-Adaptive Recurrent Neural Networks

Data are often sampled irregularly in time. Dealing with this using Recu...
research
12/09/2019

An empirical study of neural networks for trend detection in time series

Detecting structure in noisy time series is a difficult task. One intuit...
research
04/07/2015

Bidirectional Recurrent Neural Networks as Generative Models - Reconstructing Gaps in Time Series

Bidirectional recurrent neural networks (RNN) are trained to predict bot...
research
09/17/2020

Neural CDEs for Long Time Series via the Log-ODE Method

Neural Controlled Differential Equations (Neural CDEs) are the continuou...
research
07/02/2020

Accurate Characterization of Non-Uniformly Sampled Time Series using Stochastic Differential Equations

Non-uniform sampling arises when an experimenter does not have full cont...

Please sign up or login with your details

Forgot password? Click here to reset