FastDTW is approximate and Generally Slower than the Algorithm it Approximates

03/25/2020
by   Renjie Wu, et al.
0

Many time series data mining problems can be solved with repeated use of distance measure. Examples of such tasks include similarity search, clustering, classification, anomaly detection and segmentation. For over two decades it has been known that the Dynamic Time Warping (DTW) distance measure is the best measure to use for most tasks, in most domains. Because the classic DTW algorithm has quadratic time complexity, many ideas have been introduced to reduce its amortized time, or to quickly approximate it. One of the most cited approximate approaches is FastDTW. The FastDTW algorithm has well over a thousand citations and has been explicitly used in several hundred research efforts. In this work, we make a surprising claim. In any realistic data mining application, the approximate FastDTW is much slower than the exact DTW. This fact clearly has implications for the community that uses this algorithm: allowing it to address much larger datasets, get exact results, and do so in less time. Our observation also has a more sobering lesson for the community. This work may serve as a reminder to the community to exercise more caution in uncritically accepting published results.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/05/2018

Towards a Near Universal Time Series Data Mining Tool: Introducing the Matrix Profile

The last decade has seen a flurry of research on all-pairs-similarity-se...
04/17/2020

Exploring time-series motifs through DTW-SOM

Motif discovery is a fundamental step in data mining tasks for time-seri...
09/29/2020

Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress

Time series anomaly detection has been a perennially important topic in ...
09/16/2020

Matrix Profile XXII: Exact Discovery of Time Series Motifs under DTW

Over the last decade, time series motif discovery has emerged as a usefu...
10/17/2018

The UCR Time Series Archive

The UCR Time Series Archive - introduced in 2002, has become an importan...
12/24/2021

Error-bounded Approximate Time Series Joins using Compact Dictionary Representations of Time Series

The matrix profile is an effective data mining tool that provides simila...
10/11/2020

Early Abandoning PrunedDTW and its application to similarity search

The Dynamic Time Warping ("DTW") distance is widely used in time series ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.