DeepAI AI Chat
Log In Sign Up

Unsupervised Discovery of Temporal Structure in Noisy Data with Dynamical Components Analysis

by   David G. Clark, et al.
Berkeley Lab

Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than meaningful dynamics when applied to time series data. At the same time, many successful unsupervised learning methods for temporal, sequential and spatial data extract features which are predictive of their surrounding context. Combining these approaches, we introduce Dynamical Components Analysis (DCA), a linear dimensionality reduction method which discovers a subspace of high-dimensional time series data with maximal predictive information, defined as the mutual information between the past and future. We test DCA on synthetic examples and demonstrate its superior ability to extract dynamical structure compared to commonly used linear methods. We also apply DCA to several real-world datasets, showing that the dimensions extracted by DCA are more useful than those extracted by other methods for predicting future states and decoding auxiliary variables. Overall, DCA robustly extracts dynamical structure in noisy, high-dimensional data while retaining the computational efficiency and geometric interpretability of linear dimensionality reduction methods.


page 1

page 2

page 3

page 4


Dynamical Component Analysis (DyCA): Dimensionality Reduction For High-Dimensional Deterministic Time-Series

Multivariate signal processing is often based on dimensionality reductio...

Visualizing High Dimensional Dynamical Processes

Manifold learning techniques for dynamical systems and time series have ...

Deep learning of dynamical attractors from time series measurements

Experimental measurements of physical systems often have a finite number...

Dimensionality reduction to maximize prediction generalization capability

This work develops an analytically solvable unsupervised learning scheme...

Compressed Predictive Information Coding

Unsupervised learning plays an important role in many fields, such as ar...

Sifting Common Information from Many Variables

Measuring the relationship between any pair of variables is a rich and a...

Natural data structure extracted from neighborhood-similarity graphs

'Big' high-dimensional data are commonly analyzed in low-dimensions, aft...