Zoom-SVD: Fast and Memory Efficient Method for Extracting Key Patterns in an Arbitrary Time Range

by   Jun-Gi Jang, et al.

Given multiple time series data, how can we efficiently find latent patterns in an arbitrary time range? Singular value decomposition (SVD) is a crucial tool to discover hidden factors in multiple time series data, and has been used in many data mining applications including dimensionality reduction, principal component analysis, recommender systems, etc. Along with its static version, incremental SVD has been used to deal with multiple semi infinite time series data and to identify patterns of the data. However, existing SVD methods for the multiple time series data analysis do not provide functionality for detecting patterns of data in an arbitrary time range: standard SVD requires data for all intervals corresponding to a time range query, and incremental SVD does not consider an arbitrary time range. In this paper, we propose Zoom-SVD, a fast and memory efficient method for finding latent factors of time series data in an arbitrary time range. Zoom-SVD incrementally compresses multiple time series data block by block to reduce the space cost in storage phase, and efficiently computes singular value decomposition (SVD) for a given time range query in query phase by carefully stitching stored SVD results. Through extensive experiments, we demonstrate that Zoom-SVD is up to 15x faster, and requires 15x less space than existing methods. Our case study shows that Zoom-SVD is useful for capturing past time ranges whose patterns are similar to a query time range.


TR-SVD: Fast and Memory Efficient Method for Time Ranged Singular Value Decomposition

Given multiple time series data, how can we efficiently find latent patt...

Data-driven pattern identification and outlier detection in time series

We address the problem of data-driven pattern identification and outlier...

Time-series image denoising of pressure-sensitive paint data by projected multivariate singular spectrum analysis

Time-series data, such as unsteady pressure-sensitive paint (PSP) measur...

Regularized Singular Value Decomposition and Application to Recommender System

Singular value decomposition (SVD) is the mathematical basis of principa...

MOSES: A Streaming Algorithm for Linear Dimensionality Reduction

This paper introduces Memory-limited Online Subspace Estimation Scheme (...

Enhancing keyword correlation for event detection in social networks using SVD and k-means: Twitter case study

Extracting textual features from tweets is a challenging process due to ...

Please sign up or login with your details

Forgot password? Click here to reset