FastDTW is approximate and Generally Slower than the Algorithm it Approximates

03/25/2020
by   Renjie Wu, et al.
0

Many time series data mining problems can be solved with repeated use of distance measure. Examples of such tasks include similarity search, clustering, classification, anomaly detection and segmentation. For over two decades it has been known that the Dynamic Time Warping (DTW) distance measure is the best measure to use for most tasks, in most domains. Because the classic DTW algorithm has quadratic time complexity, many ideas have been introduced to reduce its amortized time, or to quickly approximate it. One of the most cited approximate approaches is FastDTW. The FastDTW algorithm has well over a thousand citations and has been explicitly used in several hundred research efforts. In this work, we make a surprising claim. In any realistic data mining application, the approximate FastDTW is much slower than the exact DTW. This fact clearly has implications for the community that uses this algorithm: allowing it to address much larger datasets, get exact results, and do so in less time. Our observation also has a more sobering lesson for the community. This work may serve as a reminder to the community to exercise more caution in uncritically accepting published results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/05/2018

Towards a Near Universal Time Series Data Mining Tool: Introducing the Matrix Profile

The last decade has seen a flurry of research on all-pairs-similarity-se...
research
04/17/2020

Exploring time-series motifs through DTW-SOM

Motif discovery is a fundamental step in data mining tasks for time-seri...
research
09/29/2020

Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress

Time series anomaly detection has been a perennially important topic in ...
research
09/16/2020

Matrix Profile XXII: Exact Discovery of Time Series Motifs under DTW

Over the last decade, time series motif discovery has emerged as a usefu...
research
10/17/2018

The UCR Time Series Archive

The UCR Time Series Archive - introduced in 2002, has become an importan...
research
10/11/2020

Early Abandoning PrunedDTW and its application to similarity search

The Dynamic Time Warping ("DTW") distance is widely used in time series ...
research
02/05/2019

Temporal Convolutional Networks and Dynamic Time Warping can Drastically Improve the Early Prediction of Sepsis

Motivation: Sepsis is a life-threatening host response to infection asso...

Please sign up or login with your details

Forgot password? Click here to reset